-- Logs begin at Wed 2022-08-03 12:08:41 UTC, end at Wed 2022-08-03 13:27:09 UTC. -- Aug 03 12:40:08.632320 dv-cinder-850836-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 03 12:40:08.643436 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 03 12:40:08.645623 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 12:40:08 2022] *** Aug 03 12:40:08.645623 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 12:40:08.645623 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 12:40:08.645623 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: nodename: dv-cinder-850836-4-iscsi Aug 03 12:40:08.645623 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: machine: x86_64 Aug 03 12:40:08.645623 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: clock source: unix Aug 03 12:40:08.645623 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: pcre jit disabled Aug 03 12:40:08.645623 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: detected number of CPU cores: 4 Aug 03 12:40:08.645623 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: current working directory: / Aug 03 12:40:08.645623 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: detected binary path: /usr/bin/uwsgi-core Aug 03 12:40:08.645623 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: your processes number limit is 47680 Aug 03 12:40:08.645623 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: your memory page size is 4096 bytes Aug 03 12:40:08.645623 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: detected max file descriptor number: 2048 Aug 03 12:40:08.645623 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: lock engine: pthread robust mutexes Aug 03 12:40:08.646355 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: thunder lock: enabled Aug 03 12:40:08.646355 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 03 12:40:08.646355 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 12:40:08.691440 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: Python main interpreter initialized at 0x558d10da59c0 Aug 03 12:40:08.691440 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: python threads support enabled Aug 03 12:40:08.691440 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: your server socket listen backlog is limited to 100 connections Aug 03 12:40:08.691440 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: your mercy for graceful operations on workers is 90 seconds Aug 03 12:40:08.691822 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 12:40:08.691898 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: *** Operational MODE: preforking *** Aug 03 12:40:08.692146 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: *** uWSGI is running in multiple interpreter mode *** Aug 03 12:40:08.692146 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: spawned uWSGI master process (pid: 81196) Aug 03 12:40:08.692349 dv-cinder-850836-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 03 12:40:08.693797 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: spawned uWSGI worker 1 (pid: 81208, cores: 1) Aug 03 12:40:08.693797 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: spawned uWSGI worker 2 (pid: 81209, cores: 1) Aug 03 12:40:08.693797 dv-cinder-850836-4-iscsi devstack@keystone.service[81196]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 12:40:14.216723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:40:14.216723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: from cryptography.utils import int_from_bytes Aug 03 12:40:14.217377 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:40:14.217377 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: from cryptography.utils import int_from_bytes Aug 03 12:40:14.217776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:40:14.217776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: from cryptography.utils import int_from_bytes Aug 03 12:40:14.217881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:40:14.217881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: from cryptography.utils import int_from_bytes Aug 03 12:40:14.266995 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 12:40:14.267156 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 12:40:14.267231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 12:40:14.267319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 12:40:14.267401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] command line args: [] {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 12:40:14.267477 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] command line args: [] {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 12:40:14.267636 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 12:40:14.267721 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 12:40:14.267800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ================================================================================ {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 12:40:14.267870 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ================================================================================ {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 12:40:14.268058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] admin_token = **** {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.268143 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] admin_token = **** {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.268311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] config_dir = [] {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.268396 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] config_dir = [] {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.268503 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.268580 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.268687 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] config_source = [] {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.268764 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] config_source = [] {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.268871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] debug = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.268950 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] debug = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.269073 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.269344 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.269433 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.269497 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.269634 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.269724 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.269873 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.269985 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.270124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.270227 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.270360 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] list_limit = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.270470 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] list_limit = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.270574 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] log_config_append = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.270674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] log_config_append = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.270808 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.270923 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.271027 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] log_dir = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.271127 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] log_dir = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.271241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] log_file = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.271349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] log_file = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.271427 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.271534 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.271646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.271726 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.271807 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.271929 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.272008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.272135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.272212 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.272336 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.272412 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.272527 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.272601 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.272722 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.272828 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.272915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.273069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.273209 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.273291 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.273360 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.273530 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.273613 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.273765 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.273846 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.274014 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.274098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.274262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.274348 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.274543 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.274624 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.275066 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.275159 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.275256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] publish_errors = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.275339 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] publish_errors = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.275494 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.275573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.275732 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.275810 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.275919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.275992 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.276172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.276268 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.276409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.276485 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.276652 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] standard_threads = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.276737 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] standard_threads = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.276887 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.276968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.277136 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.277787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.277871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.277949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.278026 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] use_journal = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.278097 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] use_journal = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.278204 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] use_json = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.278282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] use_json = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.278381 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] use_stderr = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.278463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] use_stderr = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.278561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] use_syslog = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.278644 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] use_syslog = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.278824 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.278904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:40:14.279088 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.279245 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.279326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.279396 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.279584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.279660 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.279830 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.279913 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.280084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.280160 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.280327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.280402 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.280580 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.280662 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.280823 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.280898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.281073 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.281154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.281325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.281409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.281581 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.281664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.281823 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.281943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.282075 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.282159 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.282317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.282409 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.282567 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.282648 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.282847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.282926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.283092 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.283167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.283350 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.283427 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.283608 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.283685 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.283861 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.283937 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.284104 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.284189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.284361 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.284437 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.284629 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.284705 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.284889 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.284963 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.285142 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.285220 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.285379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.285456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.285616 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.285691 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.285855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.285932 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.286099 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.286175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.286351 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.286432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.286602 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.286679 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.286891 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.286964 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.287090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.287175 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.287342 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.287418 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.287594 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.287674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.287837 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.287912 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.288089 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.288165 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.288325 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.288399 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.288566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.288667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.288805 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.288909 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.289040 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.289142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.289268 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.289376 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.289497 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.289577 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.289733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.289811 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.289974 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.290092 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.290226 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.290314 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.290463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.290563 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.290705 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.290809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.290965 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.291041 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.291209 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.291286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.291449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.291546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.291702 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.291786 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.291940 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.292017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.292179 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.292261 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.292420 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.292503 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.292661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.293033 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.293204 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.293280 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.293448 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.293532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.293682 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.293765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.293939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.294016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.294181 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.294260 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.294421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.294504 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.294657 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.294798 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.294945 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.295030 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.295188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.295263 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.295424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.295505 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.295666 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.295752 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.295910 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.295986 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.296182 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.296257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.296426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.296510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.296680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.296755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.296928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.297003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.297172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.297324 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.297397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.297471 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.297643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.297725 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.297895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.297981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.298137 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.298217 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.298377 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.298454 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.298624 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.298711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.298890 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.298969 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.299133 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.299207 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.299373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.299448 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.299615 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.299691 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.299854 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.299936 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.300120 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.300201 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.300365 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.300443 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.300610 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.300685 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.300853 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.300935 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.301100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.301178 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.301342 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.301414 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.301584 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.301659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.301823 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.301900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.302056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.302132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.302290 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.302365 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.302526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.302603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.302787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.302867 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.303025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.303109 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.303271 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.303347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.303512 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.303587 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.303764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.303838 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.304006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.304083 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.304265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.304340 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.304528 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.304604 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.304774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.304851 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.305008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] auth.external = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.305083 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] auth.external = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.305242 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.305316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.305543 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.305648 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.305782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.305861 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.306018 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] auth.password = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.306094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] auth.password = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.306252 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] auth.token = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.306327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] auth.token = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.306496 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.306579 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.306748 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.306838 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.307010 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.307088 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.307249 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.307332 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.307501 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.307584 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.307753 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.307831 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.307990 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.308067 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.308232 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] credential.caching = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.308308 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] credential.caching = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.308543 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.308630 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.308801 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.308881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.309057 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.309141 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.309302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.309387 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.309555 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.309632 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.309799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.309877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.310068 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.310374 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.310374 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.310513 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.310583 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.310653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.310829 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.310924 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.311119 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.311197 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.311370 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.311446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.311642 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.311800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.311877 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.311952 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.312140 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.312225 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.312381 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] federation.caching = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.312470 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] federation.caching = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.312626 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.312703 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.312875 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.312952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.313130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.313216 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.313367 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.313444 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.313619 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.313696 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.313864 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.313950 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.314123 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.314200 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.314365 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.314448 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.314621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.314706 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.314887 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.314965 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.315139 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.315215 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.315382 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] identity.caching = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.315472 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] identity.caching = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.315636 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.315714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.315890 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.315970 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.316134 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.316221 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.316378 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.316455 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.316629 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.316711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.316867 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.316951 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.317110 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.317187 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.317364 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.317448 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.317619 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.317704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.317855 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.317948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.318092 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.318169 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.318328 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.318412 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.318577 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.318654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.318853 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.318935 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.319105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.319194 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.319364 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.319443 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.319616 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.319693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.319888 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.319966 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.320131 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.320207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.320372 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.320447 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.320608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.320686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.320849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.320925 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.321085 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.321161 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.321327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.321405 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.321571 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.321647 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.321814 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.321889 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.322065 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.322143 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.322300 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.322378 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.322550 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.322626 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.322824 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.322905 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.323070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.323148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.323320 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.323397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.323571 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.323649 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.323809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.323887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.324559 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.324650 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.324813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.324943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.325067 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.325192 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.325318 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.325439 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.325570 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.325691 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.325814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.325944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.326068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.326204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.326344 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.326471 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.326471 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.326703 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.326853 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.326975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.327115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.327239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.327359 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.327482 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.327603 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.327725 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.327859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.327993 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.328124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.328248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.328372 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.328496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.328630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.user = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.328750 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.user = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.328878 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.329004 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.329128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.329253 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.329384 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.329506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.329638 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.329762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.329884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.331190 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.331339 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.331472 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.331600 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.331723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.331848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.331970 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.332101 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.332710 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.332851 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.332977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.333128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.333254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.333389 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.333510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.333635 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.333761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.333888 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.334015 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.334149 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.334269 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.334398 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.334522 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.334645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.336227 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.336396 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.336524 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.336649 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.336773 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.336896 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.337029 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.337158 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.337286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.337413 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.337540 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.337667 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.337801 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.337929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.338067 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.338202 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.338330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.340728 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.340877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.341004 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.341180 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.341329 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.341463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.341592 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.341798 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.341926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.342072 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.342202 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.342280 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.342402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.342488 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.342563 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.342633 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.342704 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.342794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.342878 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.342963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.343037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.343107 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.343177 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] resource.caching = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.343247 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] resource.caching = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.343325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.343405 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.343479 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.343549 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.343619 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.343689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.343759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.343837 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.343910 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.343981 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.344051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.344121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.344191 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.344269 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.344341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.344412 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.344482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.344552 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.344621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] role.caching = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.344699 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] role.caching = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.344699 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] role.driver = sql {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.344829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] role.driver = sql {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.344899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.344969 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.345038 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.345116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.345188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.345259 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.345329 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.345398 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.345468 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.345546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.345619 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.345690 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.345760 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.345830 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.345900 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.345979 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.346051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.346121 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.346191 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.346261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.346330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.346408 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.346481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.346551 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.346621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.346691 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.346787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.346862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.346933 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.347003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.347073 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.347142 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.347219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.347292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.347362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.347432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.347502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.347571 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.347652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.347725 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.347795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.347865 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.347935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.348005 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.348086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.348158 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.348229 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.348299 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.348369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.348439 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.348516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.348589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.348660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.348730 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.348800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.348869 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.348947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.349018 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.349087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.349157 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.349227 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.349296 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.349374 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.349446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.349515 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.349584 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.349653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] token.caching = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.349722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] token.caching = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.349806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.349879 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.349949 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.350019 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.350089 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.350159 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.350236 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.350309 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.350379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.350449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.350519 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.350588 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.350666 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.350766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.350841 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.350912 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.350981 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.351056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.351139 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.351212 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.351283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.351353 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.351424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.351493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.351678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.351760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.351933 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.352015 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.352169 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.352255 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.352419 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.352497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.352716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.352793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.352982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] database.connection = **** {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.353071 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] database.connection = **** {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.353233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.353319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.353483 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.353562 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.353726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.353804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.353973 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.354050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.354216 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.354294 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.354457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.354533 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.354699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.354823 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.354977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.355052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.355209 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.355352 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.355474 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.355591 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.355724 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.355967 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.356092 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.356254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.356393 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.356522 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.356657 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.356786 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.356913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.357041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.357168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.357295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.357430 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.357558 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.357686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.357812 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 12:40:14.357940 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:40:14.357940 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 12:40:14.387420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.387420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.388415 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.388549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.388652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.388652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.396000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.396276 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.426725 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.426964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.427112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.427244 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.494352 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.494582 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.545412 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.545646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.546467 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.546711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.612073 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.612313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.612551 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.612782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.613008 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.613233 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.619382 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.619627 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.619931 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.620158 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.620379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.620598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.638841 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.639025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.639126 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.639258 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.639341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.639485 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.639568 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.639706 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.639790 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.639926 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.640007 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.640145 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.640235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.640359 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.651493 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.651595 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.664234 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.664465 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.664551 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.664770 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.664865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.664940 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.665013 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.665147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.665231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.665364 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.665447 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.665578 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.665669 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.665798 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:40:14.682932 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.683098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 03 12:40:14.683937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.684036 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.684143 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 03 12:40:14.684223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 03 12:40:14.684414 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.684499 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.684674 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.684764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 03 12:40:14.684927 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.685099 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.685180 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.685252 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.685440 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.685701 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.694796 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.695071 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.695337 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.695418 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.695616 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.695702 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.695958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.696247 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.703018 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=81209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.703858 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=81208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.707686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=81209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.707966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.708249 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.708530 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.708622 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=81208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.708811 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.708892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.709070 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.709152 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.709338 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.709430 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.709612 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.709694 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.709881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.709961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.710152 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.710234 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.710418 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.710498 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.710690 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.710997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.711270 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.733003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.734209 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.734472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.734769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.735733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.736019 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.739342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=81209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.739623 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.739904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.740614 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=81208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.740902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.741188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.746993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=81209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.747273 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.748346 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=81208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.748638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.751347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.751637 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.751920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.752200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.752472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.752761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.752841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.753026 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.753106 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.753310 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.753393 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.753605 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.753894 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.754195 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.754472 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.754775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.769614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.769891 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.771170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.771458 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.773780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.775394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.776930 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.777249 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.778585 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.778912 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.781590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.783311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.784777 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.786504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.787938 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.788235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.788519 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.788804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.789082 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.789368 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.789680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.789997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.790275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.790567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.790883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.791181 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.805417 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.805701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.805967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.806229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.807406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.807704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.807973 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.808238 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.813590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.815146 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.815422 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.815778 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.817327 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.817607 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.818198 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=81209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.818477 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.818797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.819087 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.819372 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.820447 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=81208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.820735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.821041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.821335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.821627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.833213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=81209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.833493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.833723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=81208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.833805 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.834013 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.834108 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.834300 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.834382 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.834572 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.834654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.834870 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.834955 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.835160 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.835450 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.850340 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=81209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.851039 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=81208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.853295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.854012 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.856307 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.857037 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.858792 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.868793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.869090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=81209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.869090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.869090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.869277 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=81208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.869277 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.869277 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.869482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.869554 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.869626 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=81209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.869785 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=81208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.872307 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.872594 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.872879 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.873156 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.873237 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.873535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.873826 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.874109 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.881149 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.881438 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.881721 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.882134 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.882431 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.882720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.889221 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=81209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.889499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.889785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.890088 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.890179 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=81208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:40:14.890347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.890451 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.890626 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.890709 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.890925 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.891008 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.891207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.891291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.891520 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.891600 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.891802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.891892 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.892087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.892169 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.892390 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.892472 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.892668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.892758 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.892929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.893010 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.893275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.893559 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.893829 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:40:14.927931 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558d10da59c0 pid: 81209 (default app) Aug 03 12:40:14.928034 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558d10da59c0 pid: 81208 (default app) Aug 03 12:40:14.931273 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f0878-2d91-4d0f-97d1-4ed4254dcbc8 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:14.931568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f0878-2d91-4d0f-97d1-4ed4254dcbc8 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:14.931851 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f0878-2d91-4d0f-97d1-4ed4254dcbc8 None None] PATH_INFO: `/v3` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:14.936886 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Wed Aug 3 12:40:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:23.503344 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847ca10-435d-44d1-8477-e198398fecec None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:23.503857 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847ca10-435d-44d1-8477-e198398fecec None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:23.503961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847ca10-435d-44d1-8477-e198398fecec None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:23.508388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:40:23.513532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f28c75-b16b-44be-99de-5860694787af None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:23.513922 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f28c75-b16b-44be-99de-5860694787af None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:23.514104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f28c75-b16b-44be-99de-5860694787af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:23.585393 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: INFO dbcounter [None req-a3f28c75-b16b-44be-99de-5860694787af None None] Registered counter for database keystone Aug 03 12:40:23.605591 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG oslo_db.sqlalchemy.engines [None req-a3f28c75-b16b-44be-99de-5860694787af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81208) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:40:23.611795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writer thread running {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:40:23.792925 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG passlib.handlers.bcrypt [None req-a3f28c75-b16b-44be-99de-5860694787af None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81208) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 03 12:40:23.793629 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG passlib.handlers.bcrypt [None req-a3f28c75-b16b-44be-99de-5860694787af None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81208) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 03 12:40:23.847218 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-a3f28c75-b16b-44be-99de-5860694787af None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:23.848847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a3f28c75-b16b-44be-99de-5860694787af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:23.980465 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 03 12:40:24.117364 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847ca10-435d-44d1-8477-e198398fecec None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:24.187158 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: INFO dbcounter [None req-c847ca10-435d-44d1-8477-e198398fecec None None] Registered counter for database keystone Aug 03 12:40:24.208460 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG oslo_db.sqlalchemy.engines [None req-c847ca10-435d-44d1-8477-e198398fecec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:40:24.215330 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writer thread running {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:40:24.336708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847ca10-435d-44d1-8477-e198398fecec None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:24.341544 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838cbd9-6efe-428b-9e4b-f43026823a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:24.342200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838cbd9-6efe-428b-9e4b-f43026823a0c admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:24.342493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838cbd9-6efe-428b-9e4b-f43026823a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:24.342817 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838cbd9-6efe-428b-9e4b-f43026823a0c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:24.351477 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838cbd9-6efe-428b-9e4b-f43026823a0c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:24.408760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3838cbd9-6efe-428b-9e4b-f43026823a0c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 03 12:40:24.408760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838cbd9-6efe-428b-9e4b-f43026823a0c admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:24.415781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1324 bytes} [Wed Aug 3 12:40:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:40:24.422179 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f28c75-b16b-44be-99de-5860694787af None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:24.437299 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f28c75-b16b-44be-99de-5860694787af None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:24.441977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ff5bb-1386-40c8-a214-73c4a880e8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:24.443166 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ff5bb-1386-40c8-a214-73c4a880e8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:24.443457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ff5bb-1386-40c8-a214-73c4a880e8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:24.443747 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ff5bb-1386-40c8-a214-73c4a880e8d7 admin admin] PATH_INFO: `/v3/projects/5d023a6b024c4cbd9df738e8fd9e9a97` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:24.445400 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ff5bb-1386-40c8-a214-73c4a880e8d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=5d023a6b024c4cbd9df738e8fd9e9a97)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:24.498221 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3f2ff5bb-1386-40c8-a214-73c4a880e8d7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 03 12:40:24.498570 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ff5bb-1386-40c8-a214-73c4a880e8d7 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:24.503308 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 3/5] 10.222.0.64 () {56 vars in 1207 bytes} [Wed Aug 3 12:40:24 2022] GET /identity/v3/projects/5d023a6b024c4cbd9df738e8fd9e9a97 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:40:26.458135 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17246df-43ce-4484-86d8-1f111fa86830 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:26.458651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17246df-43ce-4484-86d8-1f111fa86830 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:26.458769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17246df-43ce-4484-86d8-1f111fa86830 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:26.462850 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 3/6] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:40:26.468164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708da8a-3627-4ce7-8654-7b87a44e897f None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:26.468525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708da8a-3627-4ce7-8654-7b87a44e897f None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:26.468735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708da8a-3627-4ce7-8654-7b87a44e897f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:26.489044 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-9708da8a-3627-4ce7-8654-7b87a44e897f None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:26.490591 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-9708da8a-3627-4ce7-8654-7b87a44e897f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:26.499066 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 03 12:40:26.520767 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17246df-43ce-4484-86d8-1f111fa86830 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:26.533346 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17246df-43ce-4484-86d8-1f111fa86830 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:26.537611 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2dafb-949a-450a-81e0-d29ec95d5100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:26.538219 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2dafb-949a-450a-81e0-d29ec95d5100 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:26.538510 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2dafb-949a-450a-81e0-d29ec95d5100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:26.538837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2dafb-949a-450a-81e0-d29ec95d5100 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:26.547186 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2dafb-949a-450a-81e0-d29ec95d5100 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:26.548974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2dafb-949a-450a-81e0-d29ec95d5100 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:26.557769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1324 bytes} [Wed Aug 3 12:40:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:40:26.562976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708da8a-3627-4ce7-8654-7b87a44e897f None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:26.571898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708da8a-3627-4ce7-8654-7b87a44e897f None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:26.576292 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23846ecb-758a-4203-9fe3-9ed1963c9db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:26.576915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23846ecb-758a-4203-9fe3-9ed1963c9db6 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:26.577200 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23846ecb-758a-4203-9fe3-9ed1963c9db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:26.577482 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23846ecb-758a-4203-9fe3-9ed1963c9db6 admin admin] PATH_INFO: `/v3/users/9b2212edbdbd4786821e28173abce27f` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:26.578893 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23846ecb-758a-4203-9fe3-9ed1963c9db6 admin admin] RBAC: Authorizing `identity:get_user(user_id=9b2212edbdbd4786821e28173abce27f)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:26.580693 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23846ecb-758a-4203-9fe3-9ed1963c9db6 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:26.582215 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 5/9] 10.222.0.64 () {56 vars in 1198 bytes} [Wed Aug 3 12:40:26 2022] GET /identity/v3/users/9b2212edbdbd4786821e28173abce27f => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:28.650208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cbe21-962a-4ce6-9049-28677b4aedb0 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:28.650767 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cbe21-962a-4ce6-9049-28677b4aedb0 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:28.650767 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cbe21-962a-4ce6-9049-28677b4aedb0 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:28.652830 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:40:28.657782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425ad36-8738-4d43-ab22-ee6a659fddfc None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:28.658163 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425ad36-8738-4d43-ab22-ee6a659fddfc None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:28.658354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425ad36-8738-4d43-ab22-ee6a659fddfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:28.678305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-c425ad36-8738-4d43-ab22-ee6a659fddfc None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:28.679551 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-c425ad36-8738-4d43-ab22-ee6a659fddfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:28.686384 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1f109-6953-4573-a337-8d22949228a5 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:28.686680 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1f109-6953-4573-a337-8d22949228a5 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:28.687125 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1f109-6953-4573-a337-8d22949228a5 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:28.688444 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 6/11] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:40:28.693191 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af361af4-a5b9-4f0a-90bc-a76f9ce07550 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:28.693484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af361af4-a5b9-4f0a-90bc-a76f9ce07550 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:28.693763 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af361af4-a5b9-4f0a-90bc-a76f9ce07550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:28.736063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG passlib.handlers.bcrypt [None req-af361af4-a5b9-4f0a-90bc-a76f9ce07550 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81209) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 03 12:40:28.736489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG passlib.handlers.bcrypt [None req-af361af4-a5b9-4f0a-90bc-a76f9ce07550 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81209) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 03 12:40:28.758930 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:28.781745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-af361af4-a5b9-4f0a-90bc-a76f9ce07550 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:28.781934 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425ad36-8738-4d43-ab22-ee6a659fddfc None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:28.783364 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-af361af4-a5b9-4f0a-90bc-a76f9ce07550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:28.805529 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:28.883970 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:40:28.884394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425ad36-8738-4d43-ab22-ee6a659fddfc None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:28.906366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af361af4-a5b9-4f0a-90bc-a76f9ce07550 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:28.920200 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd53c8-e31b-4060-a8be-76c310aca51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:28.921100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd53c8-e31b-4060-a8be-76c310aca51f None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:28.921389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd53c8-e31b-4060-a8be-76c310aca51f None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:28.921725 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd53c8-e31b-4060-a8be-76c310aca51f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:28.932888 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd53c8-e31b-4060-a8be-76c310aca51f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:28.941809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-dacd53c8-e31b-4060-a8be-76c310aca51f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:28.941809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:28.941809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:28.941809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:28.941809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:28.941809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:28.941809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:28.941809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:28.941809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:28.941809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:28.941809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:28.941809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:28.941809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:28.941809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:28.941809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:28.941809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:28.942707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:28.942707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:28.942707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:28.942707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:28.942707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:28.942707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:28.942707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:28.942707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:28.942707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:28.942707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:28.942707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:28.942707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:28.942707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:28.942707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:28.942707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:28.942707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:28.943567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:28.943567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:28.943567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:28.943567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:28.943567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:28.943567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:28.943567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:28.943567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:28.943567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:28.943567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:28.943567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:28.943567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:40:28.943567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 7/14] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:40:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:40:28.949411 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd53c8-e31b-4060-a8be-76c310aca51f None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:29.006516 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af361af4-a5b9-4f0a-90bc-a76f9ce07550 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:29.008867 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:29.030959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:29.045887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0a1fe-d2b2-44d2-865c-4f83b1840a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:29.046875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0a1fe-d2b2-44d2-865c-4f83b1840a07 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:29.047159 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0a1fe-d2b2-44d2-865c-4f83b1840a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:29.047441 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0a1fe-d2b2-44d2-865c-4f83b1840a07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:29.049232 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd53c8-e31b-4060-a8be-76c310aca51f None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:29.083169 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b93aac-977d-46da-b608-579a9a31b623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:29.083786 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b93aac-977d-46da-b608-579a9a31b623 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:29.084070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b93aac-977d-46da-b608-579a9a31b623 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:29.084348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b93aac-977d-46da-b608-579a9a31b623 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:29.085070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b93aac-977d-46da-b608-579a9a31b623 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:29.085382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b93aac-977d-46da-b608-579a9a31b623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:29.086802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b93aac-977d-46da-b608-579a9a31b623 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:29.100438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 8/15] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:40:29.105940 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b93aac-977d-46da-b608-579a9a31b623 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:29.116187 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0a1fe-d2b2-44d2-865c-4f83b1840a07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:29.117725 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0a1fe-d2b2-44d2-865c-4f83b1840a07 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:29.223460 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 8/16] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:40:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 12:40:29.229688 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0a1fe-d2b2-44d2-865c-4f83b1840a07 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:29.233268 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:29.311251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b93aac-977d-46da-b608-579a9a31b623 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:29.329061 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0a1fe-d2b2-44d2-865c-4f83b1840a07 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:29.345124 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37aace-6392-4a38-bcab-837220c112e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:29.345772 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37aace-6392-4a38-bcab-837220c112e1 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:29.346061 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37aace-6392-4a38-bcab-837220c112e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:29.346346 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37aace-6392-4a38-bcab-837220c112e1 None admin] PATH_INFO: `/v3/users/9b2212edbdbd4786821e28173abce27f` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:29.347566 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37aace-6392-4a38-bcab-837220c112e1 None admin] RBAC: Authorizing `identity:get_user(user_id=9b2212edbdbd4786821e28173abce27f)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:29.349034 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37aace-6392-4a38-bcab-837220c112e1 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:29.350644 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 9/17] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:29 2022] GET /identity/v3/users/9b2212edbdbd4786821e28173abce27f => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:40:29.355983 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37aace-6392-4a38-bcab-837220c112e1 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:29.363887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677c2ce-f91c-4fa1-aa67-59a85f6076b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:29.364764 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677c2ce-f91c-4fa1-aa67-59a85f6076b3 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:29.365048 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677c2ce-f91c-4fa1-aa67-59a85f6076b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:29.365329 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677c2ce-f91c-4fa1-aa67-59a85f6076b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:29.370892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:29.384024 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677c2ce-f91c-4fa1-aa67-59a85f6076b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:29.385487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677c2ce-f91c-4fa1-aa67-59a85f6076b3 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:29.404261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-5677c2ce-f91c-4fa1-aa67-59a85f6076b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:40:29.404261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:29.404261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:29.404261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:29.404261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:29.404261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:29.404261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:29.404261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:29.404261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:29.404261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:29.404261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:29.404261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:29.404261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:40:29.404261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:40:29.404261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:40:29.405079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:40:29.405079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:29.405079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:29.405079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:29.405079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:29.405079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:29.405079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:29.405079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:29.405079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:29.405079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:29.405079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:29.405079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:29.405079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:29.405079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:29.405079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:29.405079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:29.405079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:29.406054 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:40:29.406054 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:40:29.406054 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:40:29.406054 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:40:29.406054 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 9/18] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:40:29.411273 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677c2ce-f91c-4fa1-aa67-59a85f6076b3 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:29.456661 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37aace-6392-4a38-bcab-837220c112e1 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:29.467066 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:29.490203 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b75469-48dc-4f9e-a5ef-94dbb3eaf0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:29.490863 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b75469-48dc-4f9e-a5ef-94dbb3eaf0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:29.491151 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b75469-48dc-4f9e-a5ef-94dbb3eaf0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:29.491432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b75469-48dc-4f9e-a5ef-94dbb3eaf0d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:29.492615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b75469-48dc-4f9e-a5ef-94dbb3eaf0d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:29.494082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b75469-48dc-4f9e-a5ef-94dbb3eaf0d4 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:29.496211 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 10/19] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:40:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:29.501910 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b75469-48dc-4f9e-a5ef-94dbb3eaf0d4 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:29.512257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677c2ce-f91c-4fa1-aa67-59a85f6076b3 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:29.546834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631f285-4417-467b-b0b9-3af8359922c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:29.547456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631f285-4417-467b-b0b9-3af8359922c6 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:29.547742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631f285-4417-467b-b0b9-3af8359922c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:29.548312 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631f285-4417-467b-b0b9-3af8359922c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:29.548718 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631f285-4417-467b-b0b9-3af8359922c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:29.549029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631f285-4417-467b-b0b9-3af8359922c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:29.550420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631f285-4417-467b-b0b9-3af8359922c6 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:29.567932 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 10/20] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:40:29.583735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:29.604081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b75469-48dc-4f9e-a5ef-94dbb3eaf0d4 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:29.641281 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4f657-a4bd-404d-bbf2-5e476956a87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:29.641928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4f657-a4bd-404d-bbf2-5e476956a87b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:29.642355 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4f657-a4bd-404d-bbf2-5e476956a87b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:29.643150 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4f657-a4bd-404d-bbf2-5e476956a87b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:29.643965 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4f657-a4bd-404d-bbf2-5e476956a87b None admin] RBAC: Adding query filter params (role.id=a6d209169b77456f9f1cc3ff53646cfc, scope.domain.id=default, user.id=9b2212edbdbd4786821e28173abce27f) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:29.644287 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4f657-a4bd-404d-bbf2-5e476956a87b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:29.645810 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4f657-a4bd-404d-bbf2-5e476956a87b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:29.653395 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 11/21] 10.222.0.64 () {56 vars in 1322 bytes} [Wed Aug 3 12:40:29 2022] GET /identity/v3/role_assignments?user.id=9b2212edbdbd4786821e28173abce27f&scope.domain.id=default&role.id=a6d209169b77456f9f1cc3ff53646cfc => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:40:31.760574 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227e0d2-80d9-4feb-a666-c18154fbc836 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:31.761601 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227e0d2-80d9-4feb-a666-c18154fbc836 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:31.762119 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227e0d2-80d9-4feb-a666-c18154fbc836 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:31.763729 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 11/22] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:31.769275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de1606-2b47-49d8-b9bd-dddda7696de4 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:31.770087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de1606-2b47-49d8-b9bd-dddda7696de4 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:31.770568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de1606-2b47-49d8-b9bd-dddda7696de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:31.794906 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-45de1606-2b47-49d8-b9bd-dddda7696de4 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:31.796432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-45de1606-2b47-49d8-b9bd-dddda7696de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:31.868180 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 12/23] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:31.890595 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227e0d2-80d9-4feb-a666-c18154fbc836 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:31.999152 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227e0d2-80d9-4feb-a666-c18154fbc836 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:32.016766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:32.034618 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b158d53-3cff-4458-a873-ebdb4a954760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:32.035303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b158d53-3cff-4458-a873-ebdb4a954760 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:32.035594 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b158d53-3cff-4458-a873-ebdb4a954760 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:32.035886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b158d53-3cff-4458-a873-ebdb4a954760 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:32.048129 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b158d53-3cff-4458-a873-ebdb4a954760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:32.054760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-1b158d53-3cff-4458-a873-ebdb4a954760 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:32.054760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:32.054760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:32.054760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:32.054760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:32.054760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:32.054760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:32.054760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:32.054760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:32.054760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:32.054760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:32.054760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:32.054760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:32.054760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:32.054760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:32.054760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:32.055604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:32.055604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:32.055604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:32.055604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:32.055604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:32.055604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:32.055604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:32.055604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:32.055604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:32.055604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:32.055604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:32.055604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:32.055604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:32.055604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:32.055604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:32.055604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:32.056349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:32.056349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:32.056349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:32.056349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:32.056349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:32.056349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:32.056349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:32.056349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:32.056349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:32.056349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:32.056349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:32.056349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:40:32.056349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 12/24] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:40:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:32.062624 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de1606-2b47-49d8-b9bd-dddda7696de4 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:32.092317 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196123b-8868-4435-a24b-94a901c93a56 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:32.093111 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196123b-8868-4435-a24b-94a901c93a56 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:32.093643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196123b-8868-4435-a24b-94a901c93a56 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:32.095388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 13/25] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:40:32.103969 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670d24b-1dc9-4a83-8090-11e122635bdf None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:32.105045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670d24b-1dc9-4a83-8090-11e122635bdf None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:32.105704 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670d24b-1dc9-4a83-8090-11e122635bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:32.127003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-0670d24b-1dc9-4a83-8090-11e122635bdf None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:32.128541 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-0670d24b-1dc9-4a83-8090-11e122635bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:32.196888 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:32.243800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de1606-2b47-49d8-b9bd-dddda7696de4 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:32.250572 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 14/26] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:32.252149 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a900af-e8d2-43a0-b8f9-01a2340782e4 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:32.258752 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a900af-e8d2-43a0-b8f9-01a2340782e4 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:32.259299 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a900af-e8d2-43a0-b8f9-01a2340782e4 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:32.260886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 15/27] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:32.278038 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a900af-e8d2-43a0-b8f9-01a2340782e4 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:32.296526 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2c9ae-8788-4aaa-95f7-683957fb98f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:32.296526 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2c9ae-8788-4aaa-95f7-683957fb98f1 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:32.296526 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2c9ae-8788-4aaa-95f7-683957fb98f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:32.296853 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2c9ae-8788-4aaa-95f7-683957fb98f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:32.300541 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2c9ae-8788-4aaa-95f7-683957fb98f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:32.300854 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2c9ae-8788-4aaa-95f7-683957fb98f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:32.302247 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2c9ae-8788-4aaa-95f7-683957fb98f1 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:32.325924 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 13/28] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:32.327231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852f807-20cf-4afb-b6f9-994c04cc5492 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:32.327718 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852f807-20cf-4afb-b6f9-994c04cc5492 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:32.328000 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852f807-20cf-4afb-b6f9-994c04cc5492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:32.364257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-c852f807-20cf-4afb-b6f9-994c04cc5492 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:32.365602 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-c852f807-20cf-4afb-b6f9-994c04cc5492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:32.479377 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a900af-e8d2-43a0-b8f9-01a2340782e4 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:32.518879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 14/29] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:32.519626 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852f807-20cf-4afb-b6f9-994c04cc5492 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:32.635007 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:32.682100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:32.698788 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86738d5d-4bf0-4565-9327-0d9ae261df65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:32.699469 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86738d5d-4bf0-4565-9327-0d9ae261df65 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:32.699758 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86738d5d-4bf0-4565-9327-0d9ae261df65 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:32.700040 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86738d5d-4bf0-4565-9327-0d9ae261df65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:32.724376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852f807-20cf-4afb-b6f9-994c04cc5492 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:32.728073 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86738d5d-4bf0-4565-9327-0d9ae261df65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:32.729662 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86738d5d-4bf0-4565-9327-0d9ae261df65 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:32.765996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-86738d5d-4bf0-4565-9327-0d9ae261df65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:40:32.765996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:32.765996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:32.765996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:32.765996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:32.765996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:32.765996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:32.765996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:32.765996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:32.765996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:32.765996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:32.765996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:32.765996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:40:32.765996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:40:32.765996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:40:32.767313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:40:32.767313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:32.767313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:32.767313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:32.767313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:32.767313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:32.767313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:32.767313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:32.767313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:32.767313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:32.767313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:32.767313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:32.767313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:32.767313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:32.767313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:32.767313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:32.767313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:32.768106 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:40:32.768106 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:40:32.768106 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:40:32.768106 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:40:32.768106 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 16/30] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 490 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:32.768826 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f8f21-85f5-4357-82a1-4bd6a47143bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:32.769989 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f8f21-85f5-4357-82a1-4bd6a47143bb None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:32.769989 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f8f21-85f5-4357-82a1-4bd6a47143bb None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:32.769989 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f8f21-85f5-4357-82a1-4bd6a47143bb None admin] PATH_INFO: `/v3/users/9b2212edbdbd4786821e28173abce27f` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:32.774271 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86738d5d-4bf0-4565-9327-0d9ae261df65 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:32.774400 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f8f21-85f5-4357-82a1-4bd6a47143bb None admin] RBAC: Authorizing `identity:get_user(user_id=9b2212edbdbd4786821e28173abce27f)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:32.774400 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f8f21-85f5-4357-82a1-4bd6a47143bb None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:32.776744 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 15/31] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:32 2022] GET /identity/v3/users/9b2212edbdbd4786821e28173abce27f => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:32.778447 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f8f21-85f5-4357-82a1-4bd6a47143bb None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:32.894030 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86738d5d-4bf0-4565-9327-0d9ae261df65 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:32.896557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f8f21-85f5-4357-82a1-4bd6a47143bb None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:32.932093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c5e89-dedc-4ee2-ab46-926a1bffbe35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:32.933237 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c5e89-dedc-4ee2-ab46-926a1bffbe35 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:32.933527 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c5e89-dedc-4ee2-ab46-926a1bffbe35 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:32.933806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c5e89-dedc-4ee2-ab46-926a1bffbe35 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:32.934015 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176da72-6cc8-4983-ad97-a4c48fd143e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:32.934508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c5e89-dedc-4ee2-ab46-926a1bffbe35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:32.934845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c5e89-dedc-4ee2-ab46-926a1bffbe35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:32.935297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176da72-6cc8-4983-ad97-a4c48fd143e6 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:32.935812 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176da72-6cc8-4983-ad97-a4c48fd143e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:32.936265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c5e89-dedc-4ee2-ab46-926a1bffbe35 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:32.936480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176da72-6cc8-4983-ad97-a4c48fd143e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:32.937389 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176da72-6cc8-4983-ad97-a4c48fd143e6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:32.938068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:32.939509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176da72-6cc8-4983-ad97-a4c48fd143e6 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:32.955563 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 16/32] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:32.962723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574d7cf-f987-4702-9e31-1c8ddcb3cddd None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:32.962723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574d7cf-f987-4702-9e31-1c8ddcb3cddd None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:32.962723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574d7cf-f987-4702-9e31-1c8ddcb3cddd None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:32.962723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 17/33] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:32.962723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574d7cf-f987-4702-9e31-1c8ddcb3cddd None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:33.084309 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574d7cf-f987-4702-9e31-1c8ddcb3cddd None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:33.123087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de756779-b372-4e5e-ba8d-b512d4b77e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:33.123830 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de756779-b372-4e5e-ba8d-b512d4b77e66 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:33.124123 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de756779-b372-4e5e-ba8d-b512d4b77e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:33.124406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de756779-b372-4e5e-ba8d-b512d4b77e66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:33.125615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de756779-b372-4e5e-ba8d-b512d4b77e66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:33.127230 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de756779-b372-4e5e-ba8d-b512d4b77e66 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:33.129113 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 18/34] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:40:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:33.129660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de756779-b372-4e5e-ba8d-b512d4b77e66 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:33.167700 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 17/35] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Aug 3 12:40:32 2022] POST /identity/v3/roles => generated 219 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:40:33.169631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5f397-8214-47a5-b960-773b850c3092 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:33.170131 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5f397-8214-47a5-b960-773b850c3092 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:33.170614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5f397-8214-47a5-b960-773b850c3092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:33.192048 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-a4f5f397-8214-47a5-b960-773b850c3092 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:33.194092 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-a4f5f397-8214-47a5-b960-773b850c3092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:33.211758 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:33.214890 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:33.269201 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de756779-b372-4e5e-ba8d-b512d4b77e66 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:33.280163 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 18/36] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:33.281471 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5f397-8214-47a5-b960-773b850c3092 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:33.341214 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd7d61-7b52-4ab7-9dbc-cc75f8e7034a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:33.342258 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd7d61-7b52-4ab7-9dbc-cc75f8e7034a None admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:33.342762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd7d61-7b52-4ab7-9dbc-cc75f8e7034a None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:33.343264 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd7d61-7b52-4ab7-9dbc-cc75f8e7034a None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:33.344339 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd7d61-7b52-4ab7-9dbc-cc75f8e7034a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:33.347775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd7d61-7b52-4ab7-9dbc-cc75f8e7034a None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:33.448970 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5f397-8214-47a5-b960-773b850c3092 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:33.490404 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeca5e6-580b-4ad9-b072-c17bfc97b862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:33.491121 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeca5e6-580b-4ad9-b072-c17bfc97b862 None admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:33.491411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeca5e6-580b-4ad9-b072-c17bfc97b862 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:33.491696 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeca5e6-580b-4ad9-b072-c17bfc97b862 None admin] PATH_INFO: `/v3/domains/default/users/9b2212edbdbd4786821e28173abce27f/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:33.494123 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeca5e6-580b-4ad9-b072-c17bfc97b862 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9b2212edbdbd4786821e28173abce27f, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:33.496309 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeca5e6-580b-4ad9-b072-c17bfc97b862 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:33.577295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 19/37] 10.222.0.64 () {58 vars in 1361 bytes} [Wed Aug 3 12:40:33 2022] PUT /identity/v3/domains/default/users/9b2212edbdbd4786821e28173abce27f/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:40:33.578110 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeca5e6-580b-4ad9-b072-c17bfc97b862 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:33.590090 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 19/38] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 3 12:40:33 2022] POST /identity/v3/projects => generated 301 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:40:33.591330 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:33.591734 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a5dc0-73ab-4b36-9595-dfc8520b1c59 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:33.592040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a5dc0-73ab-4b36-9595-dfc8520b1c59 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:33.592331 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a5dc0-73ab-4b36-9595-dfc8520b1c59 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:33.593796 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 20/39] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:33.602776 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027acb80-b9de-463d-93f0-a9e4bd919731 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:33.602776 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027acb80-b9de-463d-93f0-a9e4bd919731 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:33.602776 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027acb80-b9de-463d-93f0-a9e4bd919731 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:33.602776 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 21/40] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:33.602776 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9757ab-8bc3-4dd9-ba9d-b195b17672c9 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:33.602776 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9757ab-8bc3-4dd9-ba9d-b195b17672c9 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:33.603281 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9757ab-8bc3-4dd9-ba9d-b195b17672c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:33.636487 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-1c9757ab-8bc3-4dd9-ba9d-b195b17672c9 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:33.638288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-1c9757ab-8bc3-4dd9-ba9d-b195b17672c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:33.727167 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeca5e6-580b-4ad9-b072-c17bfc97b862 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:33.744952 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 22/41] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 03 12:40:33.749382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acbd43-37ac-47fa-baa7-b4ac35f5e34d None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:33.749382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acbd43-37ac-47fa-baa7-b4ac35f5e34d None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:33.749382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acbd43-37ac-47fa-baa7-b4ac35f5e34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:33.774711 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4fd74-b7b7-44f0-b5aa-fffa6f7af41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:33.775399 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4fd74-b7b7-44f0-b5aa-fffa6f7af41c None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:33.775669 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4fd74-b7b7-44f0-b5aa-fffa6f7af41c None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:33.775776 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-76acbd43-37ac-47fa-baa7-b4ac35f5e34d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:33.776668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4fd74-b7b7-44f0-b5aa-fffa6f7af41c None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:33.777206 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4fd74-b7b7-44f0-b5aa-fffa6f7af41c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:33.778310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-76acbd43-37ac-47fa-baa7-b4ac35f5e34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:33.778604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4fd74-b7b7-44f0-b5aa-fffa6f7af41c None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:33.826337 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:33.847556 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 20/42] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Aug 3 12:40:33 2022] POST /identity/v3/roles => generated 225 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:40:33.848689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4fd74-b7b7-44f0-b5aa-fffa6f7af41c None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:33.867310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 23/43] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:33.891827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acbd43-37ac-47fa-baa7-b4ac35f5e34d None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:33.942542 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:33.982997 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4fd74-b7b7-44f0-b5aa-fffa6f7af41c None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:34.023324 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322d474-14df-4f15-8383-967c1fe440a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:34.024113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322d474-14df-4f15-8383-967c1fe440a9 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:34.024411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322d474-14df-4f15-8383-967c1fe440a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:34.024700 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322d474-14df-4f15-8383-967c1fe440a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:34.026464 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322d474-14df-4f15-8383-967c1fe440a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:34.027945 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322d474-14df-4f15-8383-967c1fe440a9 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:34.029574 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 21/44] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:40:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:34.036314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322d474-14df-4f15-8383-967c1fe440a9 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:34.047291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acbd43-37ac-47fa-baa7-b4ac35f5e34d None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:34.094383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2ecba-5fea-49c7-bbe9-c3a490a0240c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:34.095050 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2ecba-5fea-49c7-bbe9-c3a490a0240c None admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:34.095337 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2ecba-5fea-49c7-bbe9-c3a490a0240c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:34.095620 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2ecba-5fea-49c7-bbe9-c3a490a0240c None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:34.096453 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2ecba-5fea-49c7-bbe9-c3a490a0240c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:34.097974 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2ecba-5fea-49c7-bbe9-c3a490a0240c None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:34.153103 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322d474-14df-4f15-8383-967c1fe440a9 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:34.179953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 24/45] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Aug 3 12:40:33 2022] POST /identity/v3/roles => generated 223 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:40:34.193874 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182edea9-2015-4e0f-b108-cbbcd0c92c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:34.194973 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182edea9-2015-4e0f-b108-cbbcd0c92c31 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:34.195460 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182edea9-2015-4e0f-b108-cbbcd0c92c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:34.196038 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182edea9-2015-4e0f-b108-cbbcd0c92c31 None admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:34.196962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182edea9-2015-4e0f-b108-cbbcd0c92c31 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:34.199267 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182edea9-2015-4e0f-b108-cbbcd0c92c31 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:34.206919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:34.295207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 22/46] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 3 12:40:34 2022] POST /identity/v3/projects => generated 312 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:40:35.654934 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b710d2-eaab-4ff8-87e8-e32fd8f68acb None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:35.655453 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b710d2-eaab-4ff8-87e8-e32fd8f68acb None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:35.655535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b710d2-eaab-4ff8-87e8-e32fd8f68acb None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:35.656842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 25/47] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:35.661891 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f85f0-0b7a-482b-9232-59ced93e120c None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:35.662263 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f85f0-0b7a-482b-9232-59ced93e120c None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:35.662595 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f85f0-0b7a-482b-9232-59ced93e120c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:35.680666 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-e87f85f0-0b7a-482b-9232-59ced93e120c None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:35.681863 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e87f85f0-0b7a-482b-9232-59ced93e120c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:35.749823 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 23/48] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:35.772001 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b710d2-eaab-4ff8-87e8-e32fd8f68acb None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:35.806988 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:35.873925 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b710d2-eaab-4ff8-87e8-e32fd8f68acb None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:35.908559 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9d32b-cee1-457c-90f5-9a39073518dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:35.909135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9d32b-cee1-457c-90f5-9a39073518dc None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:35.909477 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9d32b-cee1-457c-90f5-9a39073518dc None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:35.909765 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9d32b-cee1-457c-90f5-9a39073518dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:35.920681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9d32b-cee1-457c-90f5-9a39073518dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:35.925635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-3cc9d32b-cee1-457c-90f5-9a39073518dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:35.925635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:35.925635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:35.925635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:35.925635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:35.925635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:35.925635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:35.925635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:35.925635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:35.925635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:35.925635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:35.925635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:35.925635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:35.925635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:35.925635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:35.925635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:35.926667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:35.926667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:35.926667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:35.926667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:35.926667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:35.926667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:35.926667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:35.926667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:35.926667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:35.926667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:35.926667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:35.926667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:35.926667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:35.926667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:35.926667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:35.926667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:35.932246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:35.932246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:35.932246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:35.932246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:35.932246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:35.932246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:35.932246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:35.932246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:35.932246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:35.932246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:35.932246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:35.932246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:40:35.932246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 26/49] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:40:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:35.933645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f85f0-0b7a-482b-9232-59ced93e120c None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:36.030008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f85f0-0b7a-482b-9232-59ced93e120c None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:36.047650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:36.063857 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b85b1-0a3f-46cf-a933-86b422b68a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:36.064481 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b85b1-0a3f-46cf-a933-86b422b68a6e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:36.064769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b85b1-0a3f-46cf-a933-86b422b68a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:36.065051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b85b1-0a3f-46cf-a933-86b422b68a6e None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:36.065771 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b85b1-0a3f-46cf-a933-86b422b68a6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:36.066085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b85b1-0a3f-46cf-a933-86b422b68a6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:36.067498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b85b1-0a3f-46cf-a933-86b422b68a6e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:36.079559 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 24/50] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:36.085123 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9d32b-cee1-457c-90f5-9a39073518dc None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:36.181451 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:36.188196 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9d32b-cee1-457c-90f5-9a39073518dc None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:36.222043 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6f31b-8818-41bf-b4e1-88d5ea945ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:36.222691 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6f31b-8818-41bf-b4e1-88d5ea945ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:36.223002 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6f31b-8818-41bf-b4e1-88d5ea945ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:36.223279 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6f31b-8818-41bf-b4e1-88d5ea945ee9 None admin] PATH_INFO: `/v3/users/9b2212edbdbd4786821e28173abce27f` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:36.224457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6f31b-8818-41bf-b4e1-88d5ea945ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=9b2212edbdbd4786821e28173abce27f)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:36.225932 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6f31b-8818-41bf-b4e1-88d5ea945ee9 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:36.227550 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 27/51] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:36 2022] GET /identity/v3/users/9b2212edbdbd4786821e28173abce27f => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:40:36.233580 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b85b1-0a3f-46cf-a933-86b422b68a6e None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:36.278640 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dee67a-692f-4fab-94d8-d6f11e9ef837 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:36.278954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dee67a-692f-4fab-94d8-d6f11e9ef837 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:36.279242 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dee67a-692f-4fab-94d8-d6f11e9ef837 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:36.280721 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 28/52] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:40:36.285236 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e211fa0-489e-419c-bc2f-6fa243974faf None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:36.285530 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e211fa0-489e-419c-bc2f-6fa243974faf None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:36.285816 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e211fa0-489e-419c-bc2f-6fa243974faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:36.304179 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-2e211fa0-489e-419c-bc2f-6fa243974faf None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:36.305382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-2e211fa0-489e-419c-bc2f-6fa243974faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:36.333194 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b85b1-0a3f-46cf-a933-86b422b68a6e None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:36.367651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7596f4a-d8ec-4163-9c48-75a5509ef648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:36.368303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7596f4a-d8ec-4163-9c48-75a5509ef648 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:36.368595 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7596f4a-d8ec-4163-9c48-75a5509ef648 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:36.368880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7596f4a-d8ec-4163-9c48-75a5509ef648 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:36.370097 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7596f4a-d8ec-4163-9c48-75a5509ef648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:36.371198 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 29/53] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:40:36.374851 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7596f4a-d8ec-4163-9c48-75a5509ef648 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:36.374851 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 25/54] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:40:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:36.378911 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e211fa0-489e-419c-bc2f-6fa243974faf None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:36.394111 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7596f4a-d8ec-4163-9c48-75a5509ef648 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:36.443243 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:36.471487 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:36.480200 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e211fa0-489e-419c-bc2f-6fa243974faf None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:36.494172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7596f4a-d8ec-4163-9c48-75a5509ef648 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:36.516436 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faae3e-9173-4118-9f05-23fcbf625ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:36.517063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faae3e-9173-4118-9f05-23fcbf625ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:36.517354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faae3e-9173-4118-9f05-23fcbf625ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:36.517637 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faae3e-9173-4118-9f05-23fcbf625ec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:36.518440 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79faae3e-9173-4118-9f05-23fcbf625ec0 None admin] RBAC: Adding query filter params (role.id=a6d209169b77456f9f1cc3ff53646cfc, scope.domain.id=default, user.id=9b2212edbdbd4786821e28173abce27f) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:36.518786 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79faae3e-9173-4118-9f05-23fcbf625ec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:36.520253 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79faae3e-9173-4118-9f05-23fcbf625ec0 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:36.526985 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 30/55] 10.222.0.64 () {56 vars in 1322 bytes} [Wed Aug 3 12:40:36 2022] GET /identity/v3/role_assignments?user.id=9b2212edbdbd4786821e28173abce27f&scope.domain.id=default&role.id=a6d209169b77456f9f1cc3ff53646cfc => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:36.529753 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a3c0d-4b10-4690-b8db-242cd5523b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:36.530484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a3c0d-4b10-4690-b8db-242cd5523b23 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:36.530879 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a3c0d-4b10-4690-b8db-242cd5523b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:36.531161 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a3c0d-4b10-4690-b8db-242cd5523b23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:36.532565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a3c0d-4b10-4690-b8db-242cd5523b23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:36.539153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a3c0d-4b10-4690-b8db-242cd5523b23 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:36.539153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 26/56] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:40:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:36.541838 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faae3e-9173-4118-9f05-23fcbf625ec0 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:36.648905 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faae3e-9173-4118-9f05-23fcbf625ec0 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:36.686237 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20456fd0-6a40-43d0-af27-d602b06a816c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:36.686965 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20456fd0-6a40-43d0-af27-d602b06a816c None admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:36.687217 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20456fd0-6a40-43d0-af27-d602b06a816c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:36.687506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20456fd0-6a40-43d0-af27-d602b06a816c None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:36.688199 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20456fd0-6a40-43d0-af27-d602b06a816c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:36.689662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20456fd0-6a40-43d0-af27-d602b06a816c None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:36.819382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 31/57] 10.222.0.64 () {60 vars in 1140 bytes} [Wed Aug 3 12:40:36 2022] POST /identity/v3/projects => generated 298 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:40:38.781022 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bf874-65cf-42b9-868f-0ef779962fec None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:38.781531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bf874-65cf-42b9-868f-0ef779962fec None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:38.781636 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bf874-65cf-42b9-868f-0ef779962fec None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:38.782941 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 27/58] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:38.787969 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f03861-5825-4188-92ce-34068cce8c33 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:38.788393 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f03861-5825-4188-92ce-34068cce8c33 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:38.788543 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f03861-5825-4188-92ce-34068cce8c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:38.807585 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-b6f03861-5825-4188-92ce-34068cce8c33 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:38.808799 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b6f03861-5825-4188-92ce-34068cce8c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:38.810772 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:38.873780 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 32/59] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:38.897435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bf874-65cf-42b9-868f-0ef779962fec None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:38.995638 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bf874-65cf-42b9-868f-0ef779962fec None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:39.011217 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:39.028423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ee278-dd97-467d-8ba0-bcbeb9ed643e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:39.029055 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ee278-dd97-467d-8ba0-bcbeb9ed643e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:39.029344 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ee278-dd97-467d-8ba0-bcbeb9ed643e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:39.029626 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ee278-dd97-467d-8ba0-bcbeb9ed643e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:39.030806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ee278-dd97-467d-8ba0-bcbeb9ed643e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:39.032302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ee278-dd97-467d-8ba0-bcbeb9ed643e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:39.033820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 28/60] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:40:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:39.039236 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f03861-5825-4188-92ce-34068cce8c33 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:39.139063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f03861-5825-4188-92ce-34068cce8c33 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:39.174489 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faca3c9-4642-47f4-b22d-1b46810adbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:39.175137 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faca3c9-4642-47f4-b22d-1b46810adbdf None admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:39.175424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faca3c9-4642-47f4-b22d-1b46810adbdf None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:39.175701 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faca3c9-4642-47f4-b22d-1b46810adbdf None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:39.176391 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faca3c9-4642-47f4-b22d-1b46810adbdf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:39.177831 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faca3c9-4642-47f4-b22d-1b46810adbdf None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:39.191558 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:39.281164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 33/61] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 3 12:40:39 2022] POST /identity/v3/users => generated 275 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:40:42.433180 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9070a8f-3feb-47e4-a748-ecff5b0943fd None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:42.434109 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9070a8f-3feb-47e4-a748-ecff5b0943fd None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:42.434557 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9070a8f-3feb-47e4-a748-ecff5b0943fd None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:42.436388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 29/62] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:42.442452 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83188e14-3bf0-4aef-acf1-66490c9b6d4e None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:42.443343 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83188e14-3bf0-4aef-acf1-66490c9b6d4e None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:42.443814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83188e14-3bf0-4aef-acf1-66490c9b6d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:42.471928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-83188e14-3bf0-4aef-acf1-66490c9b6d4e None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:42.474287 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-83188e14-3bf0-4aef-acf1-66490c9b6d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:42.577205 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 34/63] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:40:42.625220 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9070a8f-3feb-47e4-a748-ecff5b0943fd None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:42.713408 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578d6e4-f17c-4149-b00e-b1480c6f8852 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:42.713695 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578d6e4-f17c-4149-b00e-b1480c6f8852 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:42.713940 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578d6e4-f17c-4149-b00e-b1480c6f8852 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:42.715306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 35/64] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:42.728272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220df94-a387-4323-ba6b-48c4878c2668 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:42.728645 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220df94-a387-4323-ba6b-48c4878c2668 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:42.728906 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220df94-a387-4323-ba6b-48c4878c2668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:42.771396 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-0220df94-a387-4323-ba6b-48c4878c2668 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:42.773058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-0220df94-a387-4323-ba6b-48c4878c2668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:42.793356 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9070a8f-3feb-47e4-a748-ecff5b0943fd None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:42.837227 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4f2a6-d3e1-47ec-b8b1-5185aa154154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:42.837911 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4f2a6-d3e1-47ec-b8b1-5185aa154154 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:42.838205 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4f2a6-d3e1-47ec-b8b1-5185aa154154 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:42.838486 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4f2a6-d3e1-47ec-b8b1-5185aa154154 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:42.848981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4f2a6-d3e1-47ec-b8b1-5185aa154154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:42.855564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-b2f4f2a6-d3e1-47ec-b8b1-5185aa154154 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:40:42.855564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:42.855564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:42.855564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:42.855564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:42.855564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:42.855564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:42.855564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:42.855564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:42.855564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:42.855564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:42.855564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:42.855564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:42.855564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:42.855564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:42.855564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:42.856429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:42.856429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:42.856429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:42.856429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:42.856429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:42.856429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:42.856429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:42.856429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:42.856429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:42.856429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:42.856429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:42.856429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:42.856429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:42.856429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:42.856429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:42.856429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:42.857188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:42.857188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:42.857188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:42.857188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:42.857188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:42.857188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:42.857188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:42.857188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:42.857188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:42.857188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:42.857188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:40:42.857188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:40:42.857188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 30/65] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:42.859221 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4051f-83a2-4963-8b1f-9bf24f8ed43d None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:42.859517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4051f-83a2-4963-8b1f-9bf24f8ed43d None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:42.859802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4051f-83a2-4963-8b1f-9bf24f8ed43d None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:42.862981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 31/66] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:42.862981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254cc30-ff43-45cd-8b52-a150f209a2af None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:42.862981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254cc30-ff43-45cd-8b52-a150f209a2af None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:42.863206 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254cc30-ff43-45cd-8b52-a150f209a2af None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:42.864278 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 32/67] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:42.865145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254cc30-ff43-45cd-8b52-a150f209a2af None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:42.868502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 36/68] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 03 12:40:42.870392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd1f76-2633-43c4-b01d-dc5032e6984e None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:42.870772 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd1f76-2633-43c4-b01d-dc5032e6984e None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:42.871060 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd1f76-2633-43c4-b01d-dc5032e6984e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:42.893556 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-0fdd1f76-2633-43c4-b01d-dc5032e6984e None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:42.894809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-0fdd1f76-2633-43c4-b01d-dc5032e6984e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:42.922666 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:42.949380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:42.967082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 37/69] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:42.968255 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c1c8a-207c-4e33-b613-f0c260405361 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:42.968548 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c1c8a-207c-4e33-b613-f0c260405361 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:42.968831 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c1c8a-207c-4e33-b613-f0c260405361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:42.984580 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254cc30-ff43-45cd-8b52-a150f209a2af None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:42.986387 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-815c1c8a-207c-4e33-b613-f0c260405361 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:42.987801 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-815c1c8a-207c-4e33-b613-f0c260405361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:43.021177 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a40d48-54d9-4092-8ae5-43f0cf76d49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:43.021818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a40d48-54d9-4092-8ae5-43f0cf76d49d None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:43.022093 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a40d48-54d9-4092-8ae5-43f0cf76d49d None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:43.022377 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a40d48-54d9-4092-8ae5-43f0cf76d49d None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:43.023140 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a40d48-54d9-4092-8ae5-43f0cf76d49d None admin] RBAC: Adding query filter params (name=member) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:43.023463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a40d48-54d9-4092-8ae5-43f0cf76d49d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:43.024875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a40d48-54d9-4092-8ae5-43f0cf76d49d None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:43.032946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 33/70] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:40:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:43.032946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a40d48-54d9-4092-8ae5-43f0cf76d49d None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:43.058431 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 38/71] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:43.059946 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163d920-b9f3-4473-8805-f988a52cfce8 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:43.060242 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163d920-b9f3-4473-8805-f988a52cfce8 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:43.060526 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163d920-b9f3-4473-8805-f988a52cfce8 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:43.065614 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 39/72] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:43.065614 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163d920-b9f3-4473-8805-f988a52cfce8 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:43.135746 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a40d48-54d9-4092-8ae5-43f0cf76d49d None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:43.143147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:43.165409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163d920-b9f3-4473-8805-f988a52cfce8 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:43.170705 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d7278-f30e-44ca-9249-668ca5534123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:43.171400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d7278-f30e-44ca-9249-668ca5534123 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:43.171873 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d7278-f30e-44ca-9249-668ca5534123 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:43.172323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d7278-f30e-44ca-9249-668ca5534123 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:43.180460 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:43.183251 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d7278-f30e-44ca-9249-668ca5534123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:43.188607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-1e1d7278-f30e-44ca-9249-668ca5534123 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:40:43.188607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:43.188607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:43.188607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:43.188607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:43.188607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:43.188607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:43.188607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:43.188607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:43.188607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:43.188607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:43.188607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:43.188607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:43.188607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:43.188607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:43.188607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:43.189480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:43.189480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:43.189480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:43.189480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:43.189480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:43.189480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:43.189480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:43.189480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:43.189480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:43.189480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:43.189480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:43.189480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:43.189480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:43.189480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:43.189480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:43.189480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:43.190248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:43.190248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:43.190248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:43.190248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:43.190248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:43.190248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:43.190248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:43.190248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:43.190248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:43.190248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:43.190248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:40:43.190248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:40:43.190934 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 34/73] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:40:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:43.191734 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d7278-f30e-44ca-9249-668ca5534123 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:43.201207 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336dbb38-f67b-4280-8398-726be1ab8d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:43.201855 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dbb38-f67b-4280-8398-726be1ab8d00 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:43.202145 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dbb38-f67b-4280-8398-726be1ab8d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:43.202425 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dbb38-f67b-4280-8398-726be1ab8d00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:43.213142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336dbb38-f67b-4280-8398-726be1ab8d00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:43.218435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-336dbb38-f67b-4280-8398-726be1ab8d00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:40:43.218435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:43.218435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:43.218435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:43.218435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:43.218435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:43.218435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:43.218435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:43.218435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:43.218435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:43.218435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:43.218435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:43.218435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:43.218435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:43.218435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:43.218435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:43.219324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:43.219324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:43.219324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:43.219324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:43.219324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:43.219324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:43.219324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:43.219324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:43.219324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:43.219324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:43.219324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:43.219324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:43.219324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:43.219324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:43.219324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:43.219324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:43.220081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:43.220081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:43.220081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:43.220081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:43.220081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:43.220081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:43.220081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:43.220081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:43.220081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:43.220081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:43.220081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:40:43.220081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:40:43.220081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 40/74] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:43.221332 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fac426-068b-4524-b686-dc6b9d0bfc03 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:43.221622 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fac426-068b-4524-b686-dc6b9d0bfc03 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:43.221905 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fac426-068b-4524-b686-dc6b9d0bfc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:43.238819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-d4fac426-068b-4524-b686-dc6b9d0bfc03 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:43.240008 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-d4fac426-068b-4524-b686-dc6b9d0bfc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:43.297168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d7278-f30e-44ca-9249-668ca5534123 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:43.305365 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 41/75] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:43.306203 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fac426-068b-4524-b686-dc6b9d0bfc03 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:43.332412 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54859d9-3feb-4033-b47b-24a54924755c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:43.333043 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54859d9-3feb-4033-b47b-24a54924755c None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:43.333334 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54859d9-3feb-4033-b47b-24a54924755c None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:43.333618 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54859d9-3feb-4033-b47b-24a54924755c None admin] PATH_INFO: `/v3/users/c428456e9e294402b87552a9b190d23b` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:43.348963 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54859d9-3feb-4033-b47b-24a54924755c None admin] RBAC: Authorizing `identity:get_user(user_id=c428456e9e294402b87552a9b190d23b)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:43.350433 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54859d9-3feb-4033-b47b-24a54924755c None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:43.352099 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 35/76] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:43 2022] GET /identity/v3/users/c428456e9e294402b87552a9b190d23b => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:43.352858 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54859d9-3feb-4033-b47b-24a54924755c None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:43.378195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:43.410960 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fac426-068b-4524-b686-dc6b9d0bfc03 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:43.413348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:43.445419 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086999e-56ad-48f9-afdd-9ee4e6f7de61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:43.446069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086999e-56ad-48f9-afdd-9ee4e6f7de61 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:43.446349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086999e-56ad-48f9-afdd-9ee4e6f7de61 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:43.446628 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086999e-56ad-48f9-afdd-9ee4e6f7de61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:43.453465 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54859d9-3feb-4033-b47b-24a54924755c None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:43.456641 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086999e-56ad-48f9-afdd-9ee4e6f7de61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:43.461568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-f086999e-56ad-48f9-afdd-9ee4e6f7de61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:43.461568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:43.461568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:43.461568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:43.461568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:43.461568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:43.461568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:43.461568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:43.461568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:43.461568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:43.461568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:43.461568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:43.461568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:43.461568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:43.461568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:43.461568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:43.462394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:43.462394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:43.462394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:43.462394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:43.462394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:43.462394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:43.462394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:43.462394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:43.462394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:43.462394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:43.462394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:43.462394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:43.462394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:43.462394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:43.462394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:43.462394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:43.463700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:43.463700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:43.463700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:43.463700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:43.463700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:43.463700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:43.463700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:43.463700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:43.463700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:43.463700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:43.463700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:43.463700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:40:43.463700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 42/77] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:40:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:43.465500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086999e-56ad-48f9-afdd-9ee4e6f7de61 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:43.488514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2438c47-05cf-4c35-a20e-61f0b89e11ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:43.489070 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2438c47-05cf-4c35-a20e-61f0b89e11ed None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:43.489360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2438c47-05cf-4c35-a20e-61f0b89e11ed None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:43.489644 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2438c47-05cf-4c35-a20e-61f0b89e11ed None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:43.490433 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2438c47-05cf-4c35-a20e-61f0b89e11ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:43.490755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2438c47-05cf-4c35-a20e-61f0b89e11ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:43.492168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2438c47-05cf-4c35-a20e-61f0b89e11ed None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:43.499904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 36/78] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:40:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:43.500675 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2438c47-05cf-4c35-a20e-61f0b89e11ed None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:43.568774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086999e-56ad-48f9-afdd-9ee4e6f7de61 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:43.584193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:43.599874 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2438c47-05cf-4c35-a20e-61f0b89e11ed None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:43.602312 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca10d14-338c-436e-ab90-eccd34ea50c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:43.602992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca10d14-338c-436e-ab90-eccd34ea50c8 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:43.603285 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca10d14-338c-436e-ab90-eccd34ea50c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:43.604164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca10d14-338c-436e-ab90-eccd34ea50c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:43.604894 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca10d14-338c-436e-ab90-eccd34ea50c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:43.605218 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca10d14-338c-436e-ab90-eccd34ea50c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:43.606630 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca10d14-338c-436e-ab90-eccd34ea50c8 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:43.614686 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 43/79] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:40:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:43.619606 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca10d14-338c-436e-ab90-eccd34ea50c8 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:43.633250 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64a412-50b3-4bb0-b4df-de238ae3ac4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:43.633897 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64a412-50b3-4bb0-b4df-de238ae3ac4b None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:43.634182 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64a412-50b3-4bb0-b4df-de238ae3ac4b None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:43.634466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64a412-50b3-4bb0-b4df-de238ae3ac4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:43.635664 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64a412-50b3-4bb0-b4df-de238ae3ac4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:43.637114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64a412-50b3-4bb0-b4df-de238ae3ac4b None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:43.638691 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 37/80] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:40:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:43.639463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64a412-50b3-4bb0-b4df-de238ae3ac4b None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:43.643786 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:43.715524 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca10d14-338c-436e-ab90-eccd34ea50c8 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:43.740817 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64a412-50b3-4bb0-b4df-de238ae3ac4b None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:43.749613 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf301dd-8d38-4dfd-9dd8-332d853d1f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:43.750232 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf301dd-8d38-4dfd-9dd8-332d853d1f45 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:43.750518 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf301dd-8d38-4dfd-9dd8-332d853d1f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:43.750836 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf301dd-8d38-4dfd-9dd8-332d853d1f45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:43.773582 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bb026-dd36-46cd-a012-fc003265f83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:43.774198 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bb026-dd36-46cd-a012-fc003265f83b None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:43.774479 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bb026-dd36-46cd-a012-fc003265f83b None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:43.774793 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bb026-dd36-46cd-a012-fc003265f83b None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:43.776013 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0bb026-dd36-46cd-a012-fc003265f83b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:43.776327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0bb026-dd36-46cd-a012-fc003265f83b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:43.777713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0bb026-dd36-46cd-a012-fc003265f83b None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:43.787499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 38/81] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:43.789002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bb026-dd36-46cd-a012-fc003265f83b None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:43.810727 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:43.822771 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf301dd-8d38-4dfd-9dd8-332d853d1f45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:43.824236 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf301dd-8d38-4dfd-9dd8-332d853d1f45 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:43.849997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:43.890544 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bb026-dd36-46cd-a012-fc003265f83b None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:43.922233 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 44/82] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:40:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:40:43.923085 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf301dd-8d38-4dfd-9dd8-332d853d1f45 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:43.925162 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3f9a9-4c86-4cc7-9e0c-4968959d81bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:43.925815 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3f9a9-4c86-4cc7-9e0c-4968959d81bc None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:43.926109 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3f9a9-4c86-4cc7-9e0c-4968959d81bc None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:43.926397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3f9a9-4c86-4cc7-9e0c-4968959d81bc None admin] PATH_INFO: `/v3/users/c428456e9e294402b87552a9b190d23b` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:43.927882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3f9a9-4c86-4cc7-9e0c-4968959d81bc None admin] RBAC: Authorizing `identity:get_user(user_id=c428456e9e294402b87552a9b190d23b)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:43.929345 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3f9a9-4c86-4cc7-9e0c-4968959d81bc None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:43.935312 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 39/83] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:43 2022] GET /identity/v3/users/c428456e9e294402b87552a9b190d23b => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:43.935312 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3f9a9-4c86-4cc7-9e0c-4968959d81bc None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:44.015213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:44.020274 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf301dd-8d38-4dfd-9dd8-332d853d1f45 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:44.030607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3f9a9-4c86-4cc7-9e0c-4968959d81bc None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:44.045993 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:44.054724 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660145e4-1a9b-4386-a399-68d4235595b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:44.055402 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660145e4-1a9b-4386-a399-68d4235595b4 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:44.055698 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660145e4-1a9b-4386-a399-68d4235595b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:44.055983 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660145e4-1a9b-4386-a399-68d4235595b4 None admin] PATH_INFO: `/v3/users/c428456e9e294402b87552a9b190d23b` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:44.057366 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660145e4-1a9b-4386-a399-68d4235595b4 None admin] RBAC: Authorizing `identity:get_user(user_id=c428456e9e294402b87552a9b190d23b)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:44.058887 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660145e4-1a9b-4386-a399-68d4235595b4 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:44.060520 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 45/84] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:43 2022] GET /identity/v3/users/c428456e9e294402b87552a9b190d23b => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:44.061289 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660145e4-1a9b-4386-a399-68d4235595b4 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:44.063934 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98403c4a-f715-4d75-8bb9-c71ea21786e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:44.064556 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98403c4a-f715-4d75-8bb9-c71ea21786e4 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:44.065015 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98403c4a-f715-4d75-8bb9-c71ea21786e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:44.065262 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98403c4a-f715-4d75-8bb9-c71ea21786e4 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:44.065954 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98403c4a-f715-4d75-8bb9-c71ea21786e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:44.067438 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98403c4a-f715-4d75-8bb9-c71ea21786e4 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:44.154068 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 40/85] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 3 12:40:43 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:40:44.154936 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98403c4a-f715-4d75-8bb9-c71ea21786e4 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:44.170009 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660145e4-1a9b-4386-a399-68d4235595b4 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:44.211630 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796200e6-9c17-4ecc-a302-98fa6d5e03bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:44.212305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796200e6-9c17-4ecc-a302-98fa6d5e03bf None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:44.212591 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796200e6-9c17-4ecc-a302-98fa6d5e03bf None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:44.212896 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796200e6-9c17-4ecc-a302-98fa6d5e03bf None admin] PATH_INFO: `/v3/users/9b2212edbdbd4786821e28173abce27f` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:44.214134 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796200e6-9c17-4ecc-a302-98fa6d5e03bf None admin] RBAC: Authorizing `identity:get_user(user_id=9b2212edbdbd4786821e28173abce27f)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:44.215675 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796200e6-9c17-4ecc-a302-98fa6d5e03bf None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:44.217334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 46/86] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:44 2022] GET /identity/v3/users/9b2212edbdbd4786821e28173abce27f => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:44.218132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796200e6-9c17-4ecc-a302-98fa6d5e03bf None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:44.270336 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98403c4a-f715-4d75-8bb9-c71ea21786e4 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:44.289562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:44.316949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8bf8f-b068-4bdc-874a-b7788e4989d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:44.317615 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8bf8f-b068-4bdc-874a-b7788e4989d4 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:44.317909 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8bf8f-b068-4bdc-874a-b7788e4989d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:44.318193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8bf8f-b068-4bdc-874a-b7788e4989d4 None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:44.319429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8bf8f-b068-4bdc-874a-b7788e4989d4 None admin] RBAC: Authorizing `identity:get_project(project_id=d6b0a8a1377b4435987dffefaad3e6d7)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:44.320900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8bf8f-b068-4bdc-874a-b7788e4989d4 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:44.323568 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 41/87] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:44 2022] GET /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:44.324874 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8bf8f-b068-4bdc-874a-b7788e4989d4 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:44.337893 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796200e6-9c17-4ecc-a302-98fa6d5e03bf None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:44.339840 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:44.376333 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35231bf-2b7a-4ec9-bd53-9a79da8256be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:44.377001 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35231bf-2b7a-4ec9-bd53-9a79da8256be None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:44.377271 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35231bf-2b7a-4ec9-bd53-9a79da8256be None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:44.377563 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35231bf-2b7a-4ec9-bd53-9a79da8256be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:44.461522 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35231bf-2b7a-4ec9-bd53-9a79da8256be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:44.463162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35231bf-2b7a-4ec9-bd53-9a79da8256be None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:44.482859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8bf8f-b068-4bdc-874a-b7788e4989d4 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:44.531627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:44.534848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b706312-2a38-4a1b-8f07-ceef9786018e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:44.535491 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b706312-2a38-4a1b-8f07-ceef9786018e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:44.535780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b706312-2a38-4a1b-8f07-ceef9786018e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:44.536061 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b706312-2a38-4a1b-8f07-ceef9786018e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:44.583171 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 47/88] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:40:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:40:44.583949 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35231bf-2b7a-4ec9-bd53-9a79da8256be None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:44.616572 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b706312-2a38-4a1b-8f07-ceef9786018e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:44.618070 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b706312-2a38-4a1b-8f07-ceef9786018e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:44.629902 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:44.717507 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35231bf-2b7a-4ec9-bd53-9a79da8256be None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:44.731014 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 42/89] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:40:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:40:44.732049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b706312-2a38-4a1b-8f07-ceef9786018e None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:44.760666 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513c78b-b09b-4e1b-80b9-8b9a6652d2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:44.761331 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513c78b-b09b-4e1b-80b9-8b9a6652d2ad None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:44.761619 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513c78b-b09b-4e1b-80b9-8b9a6652d2ad None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:44.761898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513c78b-b09b-4e1b-80b9-8b9a6652d2ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:44.794722 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:44.837335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513c78b-b09b-4e1b-80b9-8b9a6652d2ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:44.840286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513c78b-b09b-4e1b-80b9-8b9a6652d2ad None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:44.855231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b706312-2a38-4a1b-8f07-ceef9786018e None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:44.868115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:44.901969 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b0684-06dc-4c00-973a-8399dd4a41e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:44.903195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b0684-06dc-4c00-973a-8399dd4a41e6 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:44.903969 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b0684-06dc-4c00-973a-8399dd4a41e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:44.904729 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b0684-06dc-4c00-973a-8399dd4a41e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:44.905945 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b0684-06dc-4c00-973a-8399dd4a41e6 None admin] RBAC: Adding query filter params (role.id=26c9fe6916a4412d96492e41ff62cca6, scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7, user.id=c428456e9e294402b87552a9b190d23b) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:44.906915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b0684-06dc-4c00-973a-8399dd4a41e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:44.908845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b0684-06dc-4c00-973a-8399dd4a41e6 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:44.919453 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 43/90] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:40:44 2022] GET /identity/v3/role_assignments?user.id=c428456e9e294402b87552a9b190d23b&scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7&role.id=26c9fe6916a4412d96492e41ff62cca6 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:44.921075 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b0684-06dc-4c00-973a-8399dd4a41e6 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:44.960783 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 48/91] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:40:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:40:44.962023 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513c78b-b09b-4e1b-80b9-8b9a6652d2ad None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:45.047670 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b0684-06dc-4c00-973a-8399dd4a41e6 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:45.075082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:45.096857 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b4832-99f8-4467-b5ce-2977a3466f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:45.097547 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b4832-99f8-4467-b5ce-2977a3466f43 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:45.097838 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b4832-99f8-4467-b5ce-2977a3466f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:45.098125 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b4832-99f8-4467-b5ce-2977a3466f43 None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:45.102546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b4832-99f8-4467-b5ce-2977a3466f43 None admin] RBAC: Authorizing `identity:get_project(project_id=d6b0a8a1377b4435987dffefaad3e6d7)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:45.108052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b4832-99f8-4467-b5ce-2977a3466f43 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:45.113928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 44/92] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:44 2022] GET /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:45.114571 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b4832-99f8-4467-b5ce-2977a3466f43 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:45.172389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513c78b-b09b-4e1b-80b9-8b9a6652d2ad None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:45.186490 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:45.213586 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615dd538-087c-4f5f-b159-014ac430bf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:45.214399 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dd538-087c-4f5f-b159-014ac430bf37 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:45.214868 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dd538-087c-4f5f-b159-014ac430bf37 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:45.215255 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dd538-087c-4f5f-b159-014ac430bf37 None admin] PATH_INFO: `/v3/projects/4d2811145321472a88df80d4243051cc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:45.216559 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615dd538-087c-4f5f-b159-014ac430bf37 None admin] RBAC: Authorizing `identity:get_project(project_id=4d2811145321472a88df80d4243051cc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:45.218121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615dd538-087c-4f5f-b159-014ac430bf37 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:45.220114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 49/93] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:44 2022] GET /identity/v3/projects/4d2811145321472a88df80d4243051cc => generated 312 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:45.220875 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615dd538-087c-4f5f-b159-014ac430bf37 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:45.252202 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b4832-99f8-4467-b5ce-2977a3466f43 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:45.296903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d2ed2-fd99-4d1d-b5e4-808e71a2ca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:45.297908 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d2ed2-fd99-4d1d-b5e4-808e71a2ca0e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:45.298392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d2ed2-fd99-4d1d-b5e4-808e71a2ca0e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:45.298885 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d2ed2-fd99-4d1d-b5e4-808e71a2ca0e None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:45.303476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d2ed2-fd99-4d1d-b5e4-808e71a2ca0e None admin] RBAC: Authorizing `identity:get_project(project_id=d6b0a8a1377b4435987dffefaad3e6d7)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:45.305148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d2ed2-fd99-4d1d-b5e4-808e71a2ca0e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:45.307610 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 45/94] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:45 2022] GET /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:45.308570 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d2ed2-fd99-4d1d-b5e4-808e71a2ca0e None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:45.338888 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615dd538-087c-4f5f-b159-014ac430bf37 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:45.370886 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:45.374539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e702c22-217e-4ff0-ab02-6b9bc4646a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:45.375250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e702c22-217e-4ff0-ab02-6b9bc4646a95 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:45.375545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e702c22-217e-4ff0-ab02-6b9bc4646a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:45.386843 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e702c22-217e-4ff0-ab02-6b9bc4646a95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:45.386843 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e702c22-217e-4ff0-ab02-6b9bc4646a95 None admin] RBAC: Adding query filter params (role.id=e39a3afcb14442a08e9a24b8a56d17cf, scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7, user.id=c428456e9e294402b87552a9b190d23b) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:45.386843 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e702c22-217e-4ff0-ab02-6b9bc4646a95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:45.386843 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e702c22-217e-4ff0-ab02-6b9bc4646a95 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:45.386843 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 50/95] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:40:45 2022] GET /identity/v3/role_assignments?user.id=c428456e9e294402b87552a9b190d23b&scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7&role.id=e39a3afcb14442a08e9a24b8a56d17cf => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:45.387208 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e702c22-217e-4ff0-ab02-6b9bc4646a95 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:45.504226 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e702c22-217e-4ff0-ab02-6b9bc4646a95 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:45.544436 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1880bd-038c-4c2f-b151-61743f3a444b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:45.545189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1880bd-038c-4c2f-b151-61743f3a444b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:45.545593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1880bd-038c-4c2f-b151-61743f3a444b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:45.545951 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1880bd-038c-4c2f-b151-61743f3a444b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:45.546883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1880bd-038c-4c2f-b151-61743f3a444b None admin] RBAC: Adding query filter params (role.id=a6d209169b77456f9f1cc3ff53646cfc, scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7, user.id=9b2212edbdbd4786821e28173abce27f) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:45.547291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1880bd-038c-4c2f-b151-61743f3a444b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:45.549025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1880bd-038c-4c2f-b151-61743f3a444b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:45.555545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 51/96] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:40:45 2022] GET /identity/v3/role_assignments?user.id=9b2212edbdbd4786821e28173abce27f&scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7&role.id=a6d209169b77456f9f1cc3ff53646cfc => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:45.557500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d2ed2-fd99-4d1d-b5e4-808e71a2ca0e None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:45.577354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:45.625179 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23fcc7c-e842-4bb5-af2f-d23cca77b8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:45.625819 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fcc7c-e842-4bb5-af2f-d23cca77b8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:45.626115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fcc7c-e842-4bb5-af2f-d23cca77b8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:45.626579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fcc7c-e842-4bb5-af2f-d23cca77b8d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:45.627457 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23fcc7c-e842-4bb5-af2f-d23cca77b8d9 None admin] RBAC: Adding query filter params (role.id=26c9fe6916a4412d96492e41ff62cca6, scope.project.id=4d2811145321472a88df80d4243051cc, user.id=c428456e9e294402b87552a9b190d23b) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:45.627776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23fcc7c-e842-4bb5-af2f-d23cca77b8d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:45.629305 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23fcc7c-e842-4bb5-af2f-d23cca77b8d9 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:45.636278 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 46/97] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:40:45 2022] GET /identity/v3/role_assignments?user.id=c428456e9e294402b87552a9b190d23b&scope.project.id=4d2811145321472a88df80d4243051cc&role.id=26c9fe6916a4412d96492e41ff62cca6 => generated 259 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:46.675957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad153-52c0-4211-bae7-f065e1ba37c4 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:46.677015 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad153-52c0-4211-bae7-f065e1ba37c4 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:46.677505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad153-52c0-4211-bae7-f065e1ba37c4 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:46.679097 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 52/98] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:46.685153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f35a2b-b6dc-4cc7-9905-024f35f70dee None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:46.685973 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f35a2b-b6dc-4cc7-9905-024f35f70dee None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:46.686442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f35a2b-b6dc-4cc7-9905-024f35f70dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:46.709723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-e5f35a2b-b6dc-4cc7-9905-024f35f70dee None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:46.711262 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e5f35a2b-b6dc-4cc7-9905-024f35f70dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:46.809744 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 47/99] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:40:46.832617 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dad153-52c0-4211-bae7-f065e1ba37c4 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:46.856926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d76e11-d832-4cc6-ab6a-071a6b19dd53 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:46.857526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d76e11-d832-4cc6-ab6a-071a6b19dd53 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:46.858005 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d76e11-d832-4cc6-ab6a-071a6b19dd53 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:46.859619 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 48/100] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:40:46.876123 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14854d-af31-4be9-b716-e51b6d5348ac None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:46.876703 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14854d-af31-4be9-b716-e51b6d5348ac None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:46.877263 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14854d-af31-4be9-b716-e51b6d5348ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:46.906515 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-5b14854d-af31-4be9-b716-e51b6d5348ac None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:46.908313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-5b14854d-af31-4be9-b716-e51b6d5348ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:46.910428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:46.972148 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dad153-52c0-4211-bae7-f065e1ba37c4 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:47.030477 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67048149-53d2-4efa-8121-b8cde92e0d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:47.031167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67048149-53d2-4efa-8121-b8cde92e0d8c None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:47.031462 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67048149-53d2-4efa-8121-b8cde92e0d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:47.031750 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67048149-53d2-4efa-8121-b8cde92e0d8c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:47.046357 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 49/101] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:40:47.056950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67048149-53d2-4efa-8121-b8cde92e0d8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:47.062383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-67048149-53d2-4efa-8121-b8cde92e0d8c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:40:47.062383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:47.062383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:47.062383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:47.062383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:47.062383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:47.062383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:47.062383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:47.062383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:47.062383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:47.062383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:47.062383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:47.062383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:47.062383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:47.062383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:47.062383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:47.063239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:47.063239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:47.063239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:47.063239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:47.063239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:47.063239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:47.063239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:47.063239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:47.063239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:47.063239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:47.063239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:47.063239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:47.063239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:47.063239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:47.063239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:47.063239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:47.064397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:47.064397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:47.064397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:47.064397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:47.064397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:47.064397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:47.064397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:47.064397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:47.064397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:47.064397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:47.064397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:40:47.064397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:40:47.064397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 53/102] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:47.071006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14854d-af31-4be9-b716-e51b6d5348ac None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:47.082674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67048149-53d2-4efa-8121-b8cde92e0d8c None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:47.134539 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:47.235746 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14854d-af31-4be9-b716-e51b6d5348ac None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:47.270105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4475e2-a6b1-4a93-a7b6-bcee9fd1cef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:47.271100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4475e2-a6b1-4a93-a7b6-bcee9fd1cef7 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:47.271578 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4475e2-a6b1-4a93-a7b6-bcee9fd1cef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:47.272049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4475e2-a6b1-4a93-a7b6-bcee9fd1cef7 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:47.272971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4475e2-a6b1-4a93-a7b6-bcee9fd1cef7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:47.273468 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4475e2-a6b1-4a93-a7b6-bcee9fd1cef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:47.275604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4475e2-a6b1-4a93-a7b6-bcee9fd1cef7 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:47.288687 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 50/103] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:40:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:47.290300 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4475e2-a6b1-4a93-a7b6-bcee9fd1cef7 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:47.380953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67048149-53d2-4efa-8121-b8cde92e0d8c None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:47.439924 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:47.449544 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4475e2-a6b1-4a93-a7b6-bcee9fd1cef7 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:47.469349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:47.480087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3e27a-3c55-4047-88c4-59a4ed7445b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:47.480768 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3e27a-3c55-4047-88c4-59a4ed7445b6 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:47.481144 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3e27a-3c55-4047-88c4-59a4ed7445b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:47.481629 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3e27a-3c55-4047-88c4-59a4ed7445b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:47.486390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3e27a-3c55-4047-88c4-59a4ed7445b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:47.486390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3e27a-3c55-4047-88c4-59a4ed7445b6 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:47.486556 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 54/104] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:40:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:47.494756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3e27a-3c55-4047-88c4-59a4ed7445b6 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:47.500512 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac12477-3c12-43e5-9d59-f1512437ff61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:47.501392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac12477-3c12-43e5-9d59-f1512437ff61 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:47.502106 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac12477-3c12-43e5-9d59-f1512437ff61 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:47.502335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac12477-3c12-43e5-9d59-f1512437ff61 None admin] PATH_INFO: `/v3/users/b8e1bab3be2c40f7a2dc3f7152c72fca` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:47.528403 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac12477-3c12-43e5-9d59-f1512437ff61 None admin] RBAC: Authorizing `identity:get_user(user_id=b8e1bab3be2c40f7a2dc3f7152c72fca)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:47.530185 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac12477-3c12-43e5-9d59-f1512437ff61 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:47.532111 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 51/105] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:47 2022] GET /identity/v3/users/b8e1bab3be2c40f7a2dc3f7152c72fca => generated 289 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:40:47.537774 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac12477-3c12-43e5-9d59-f1512437ff61 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:47.660314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac12477-3c12-43e5-9d59-f1512437ff61 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:47.680549 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3e27a-3c55-4047-88c4-59a4ed7445b6 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:47.711995 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658d9c2-02fc-4711-940b-66f9c0170b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:47.713315 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658d9c2-02fc-4711-940b-66f9c0170b97 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:47.713792 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658d9c2-02fc-4711-940b-66f9c0170b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:47.714352 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658d9c2-02fc-4711-940b-66f9c0170b97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:47.751475 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4185a5-e3f7-4f65-a057-26e9bbe360fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:47.752043 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4185a5-e3f7-4f65-a057-26e9bbe360fe None admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:47.752338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4185a5-e3f7-4f65-a057-26e9bbe360fe None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:47.752626 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4185a5-e3f7-4f65-a057-26e9bbe360fe None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:47.754777 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4185a5-e3f7-4f65-a057-26e9bbe360fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:47.754900 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4185a5-e3f7-4f65-a057-26e9bbe360fe None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:47.767402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:47.827817 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658d9c2-02fc-4711-940b-66f9c0170b97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:47.829455 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658d9c2-02fc-4711-940b-66f9c0170b97 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:47.904064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 55/106] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 3 12:40:47 2022] POST /identity/v3/projects => generated 302 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:40:47.934308 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 52/107] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:40:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 12:40:47.940645 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4185a5-e3f7-4f65-a057-26e9bbe360fe None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:47.987147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:48.065209 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4185a5-e3f7-4f65-a057-26e9bbe360fe None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:48.120873 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4223d9-2612-476b-8e14-f805fa2110d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:48.121535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4223d9-2612-476b-8e14-f805fa2110d5 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:48.121941 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4223d9-2612-476b-8e14-f805fa2110d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:48.122346 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4223d9-2612-476b-8e14-f805fa2110d5 None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:48.123708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4223d9-2612-476b-8e14-f805fa2110d5 None admin] RBAC: Authorizing `identity:get_project(project_id=d6b0a8a1377b4435987dffefaad3e6d7)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:48.125187 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4223d9-2612-476b-8e14-f805fa2110d5 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:48.127319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 56/108] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:47 2022] GET /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:40:48.133376 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658d9c2-02fc-4711-940b-66f9c0170b97 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:48.203621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:48.254487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658d9c2-02fc-4711-940b-66f9c0170b97 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:48.289855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39236555-7e2b-4bf5-abbd-2718a6a96888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:48.290491 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39236555-7e2b-4bf5-abbd-2718a6a96888 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:48.291362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39236555-7e2b-4bf5-abbd-2718a6a96888 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:48.291907 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39236555-7e2b-4bf5-abbd-2718a6a96888 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:48.292722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39236555-7e2b-4bf5-abbd-2718a6a96888 None admin] RBAC: Adding query filter params (role.id=a68c1386e9434ef9b5aff7d46f61c2b4, scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7, user.id=b8e1bab3be2c40f7a2dc3f7152c72fca) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:48.293047 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39236555-7e2b-4bf5-abbd-2718a6a96888 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:48.294616 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39236555-7e2b-4bf5-abbd-2718a6a96888 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:48.300661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 53/109] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:40:48 2022] GET /identity/v3/role_assignments?user.id=b8e1bab3be2c40f7a2dc3f7152c72fca&scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7&role.id=a68c1386e9434ef9b5aff7d46f61c2b4 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:48.306819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ca50a-674f-4d1e-9a5c-d8cb44061ffc None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:48.307719 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ca50a-674f-4d1e-9a5c-d8cb44061ffc None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:48.308487 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ca50a-674f-4d1e-9a5c-d8cb44061ffc None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:48.311756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 57/110] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:48.316490 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361533cd-a001-4dc9-98b2-d14324dd4dec None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:48.316735 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361533cd-a001-4dc9-98b2-d14324dd4dec None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:48.316998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361533cd-a001-4dc9-98b2-d14324dd4dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:48.343823 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-361533cd-a001-4dc9-98b2-d14324dd4dec None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:48.345083 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-361533cd-a001-4dc9-98b2-d14324dd4dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:48.388607 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9cabc-731c-4b5a-842f-478fd7180be1 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:48.388903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9cabc-731c-4b5a-842f-478fd7180be1 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:48.389189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9cabc-731c-4b5a-842f-478fd7180be1 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:48.391061 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 58/111] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:48.399168 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244f8ec-4b72-4bb5-b976-247bf2d8705a None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:48.399889 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244f8ec-4b72-4bb5-b976-247bf2d8705a None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:48.399889 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244f8ec-4b72-4bb5-b976-247bf2d8705a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:48.433898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-3244f8ec-4b72-4bb5-b976-247bf2d8705a None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:48.435198 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3244f8ec-4b72-4bb5-b976-247bf2d8705a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:48.477800 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 54/112] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:40:48.520930 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361533cd-a001-4dc9-98b2-d14324dd4dec None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:48.567527 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 59/113] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 03 12:40:48.595468 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244f8ec-4b72-4bb5-b976-247bf2d8705a None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:48.604571 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:48.647219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:48.710794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361533cd-a001-4dc9-98b2-d14324dd4dec None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:48.738011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244f8ec-4b72-4bb5-b976-247bf2d8705a None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:48.775076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5033f8-5a8a-467f-b2c2-3aaeba31ad8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:48.775761 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5033f8-5a8a-467f-b2c2-3aaeba31ad8e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:48.776054 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5033f8-5a8a-467f-b2c2-3aaeba31ad8e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:48.776340 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5033f8-5a8a-467f-b2c2-3aaeba31ad8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:48.792978 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6c80a-01cc-4f06-b5f6-092f870de8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:48.794007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6c80a-01cc-4f06-b5f6-092f870de8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:48.794482 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6c80a-01cc-4f06-b5f6-092f870de8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:48.795024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6c80a-01cc-4f06-b5f6-092f870de8b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:48.804085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5033f8-5a8a-467f-b2c2-3aaeba31ad8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:48.810650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-ab5033f8-5a8a-467f-b2c2-3aaeba31ad8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:40:48.810650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:48.810650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:48.810650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:48.810650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:48.810650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:48.810650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:48.810650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:48.810650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:48.810650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:48.810650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:48.810650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:48.810650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:48.810650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:48.810650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:48.810650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:48.811476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:48.811476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:48.811476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:48.811476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:48.811476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:48.811476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:48.811476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:48.811476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:48.811476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:48.811476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:48.811476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:48.811476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:48.811476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:48.811476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:48.811476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:48.811476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:48.812229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:48.812229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:48.812229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:48.812229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:48.812229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:48.812229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:48.812229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:48.812229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:48.812229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:48.812229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:48.812229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:40:48.812229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:40:48.818660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6c80a-01cc-4f06-b5f6-092f870de8b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:48.824509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-4eb6c80a-01cc-4f06-b5f6-092f870de8b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:40:48.824509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:48.824509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:48.824509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:48.824509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:48.824509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:48.824509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:48.824509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:48.824509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:48.824509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:48.824509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:48.824509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:48.824509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:48.824509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:48.824509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:48.824509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:48.825353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:48.825353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:48.825353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:48.825353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:48.825353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:48.825353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:48.825353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:48.825353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:48.825353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:48.825353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:48.825353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:48.825353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:48.825353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:48.825353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:48.825353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:48.825353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:48.826108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:48.826108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:48.826108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:48.826108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:48.826108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:48.826108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:48.826108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:48.826108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:48.826108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:48.826108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:48.826108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:40:48.826108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:40:48.828091 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 55/114] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:40:48.828647 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 60/115] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:40:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:40:48.831983 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe14dea-19f3-44ac-b22e-49d3fc923f50 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:48.831983 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe14dea-19f3-44ac-b22e-49d3fc923f50 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:48.831983 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe14dea-19f3-44ac-b22e-49d3fc923f50 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:48.831983 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 56/116] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:48.835248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6c80a-01cc-4f06-b5f6-092f870de8b6 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:48.836886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe14dea-19f3-44ac-b22e-49d3fc923f50 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:48.978588 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:48.987022 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6c80a-01cc-4f06-b5f6-092f870de8b6 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:48.995032 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe14dea-19f3-44ac-b22e-49d3fc923f50 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:49.005661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:49.029198 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e17c3-e54e-4bea-b763-b732e238d7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:49.029825 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e17c3-e54e-4bea-b763-b732e238d7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:49.030111 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e17c3-e54e-4bea-b763-b732e238d7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:49.030388 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e17c3-e54e-4bea-b763-b732e238d7b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:49.031166 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e17c3-e54e-4bea-b763-b732e238d7b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:49.031477 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e17c3-e54e-4bea-b763-b732e238d7b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:49.032924 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e17c3-e54e-4bea-b763-b732e238d7b9 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:49.036444 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c360c9-4365-42d5-ab02-7f49c3a455b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:49.037073 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c360c9-4365-42d5-ab02-7f49c3a455b0 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:49.037362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c360c9-4365-42d5-ab02-7f49c3a455b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:49.037701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c360c9-4365-42d5-ab02-7f49c3a455b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:49.038542 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c360c9-4365-42d5-ab02-7f49c3a455b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:49.038891 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c360c9-4365-42d5-ab02-7f49c3a455b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:49.040281 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c360c9-4365-42d5-ab02-7f49c3a455b0 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:49.042238 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 61/117] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:40:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:49.043692 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00744cf9-5596-4479-9e4f-bb90e39458cf None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:49.043985 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00744cf9-5596-4479-9e4f-bb90e39458cf None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:49.044268 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00744cf9-5596-4479-9e4f-bb90e39458cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:49.050046 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 57/118] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:40:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:40:49.051252 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caa178-2abf-4b96-81a7-9b76ef19750b None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:49.051554 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caa178-2abf-4b96-81a7-9b76ef19750b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:49.051842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caa178-2abf-4b96-81a7-9b76ef19750b None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:49.053057 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 58/119] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:49.053761 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56caa178-2abf-4b96-81a7-9b76ef19750b None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:49.072812 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-00744cf9-5596-4479-9e4f-bb90e39458cf None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:49.074024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-00744cf9-5596-4479-9e4f-bb90e39458cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:49.161130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 62/120] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:49.162807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00744cf9-5596-4479-9e4f-bb90e39458cf None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:49.179228 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56caa178-2abf-4b96-81a7-9b76ef19750b None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:49.222223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae15ad-9f80-49d5-9e1f-08638ebeadcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:49.223831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae15ad-9f80-49d5-9e1f-08638ebeadcf None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:49.224329 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae15ad-9f80-49d5-9e1f-08638ebeadcf None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:49.225041 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae15ad-9f80-49d5-9e1f-08638ebeadcf None admin] PATH_INFO: `/v3/users/c428456e9e294402b87552a9b190d23b` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:49.226759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae15ad-9f80-49d5-9e1f-08638ebeadcf None admin] RBAC: Authorizing `identity:get_user(user_id=c428456e9e294402b87552a9b190d23b)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:49.229424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae15ad-9f80-49d5-9e1f-08638ebeadcf None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:49.232361 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 59/121] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:49 2022] GET /identity/v3/users/c428456e9e294402b87552a9b190d23b => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:49.234129 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f32afd-8376-4f4a-8b41-7a7c2827e379 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:49.235080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f32afd-8376-4f4a-8b41-7a7c2827e379 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:49.235925 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f32afd-8376-4f4a-8b41-7a7c2827e379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:49.257083 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-20f32afd-8376-4f4a-8b41-7a7c2827e379 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:49.258421 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-20f32afd-8376-4f4a-8b41-7a7c2827e379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:49.278460 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:49.288982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:49.297270 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00744cf9-5596-4479-9e4f-bb90e39458cf None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:49.338829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 60/122] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:49.338829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f32afd-8376-4f4a-8b41-7a7c2827e379 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:49.352840 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95974f-c921-4dbc-9ae6-19d6f6303868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:49.355546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95974f-c921-4dbc-9ae6-19d6f6303868 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:49.355546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95974f-c921-4dbc-9ae6-19d6f6303868 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:49.355546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95974f-c921-4dbc-9ae6-19d6f6303868 None admin] PATH_INFO: `/v3/users/c428456e9e294402b87552a9b190d23b` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:49.358062 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95974f-c921-4dbc-9ae6-19d6f6303868 None admin] RBAC: Authorizing `identity:get_user(user_id=c428456e9e294402b87552a9b190d23b)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:49.359463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95974f-c921-4dbc-9ae6-19d6f6303868 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:49.362830 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 63/123] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:49 2022] GET /identity/v3/users/c428456e9e294402b87552a9b190d23b => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:49.363542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95974f-c921-4dbc-9ae6-19d6f6303868 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:49.483825 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95974f-c921-4dbc-9ae6-19d6f6303868 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:49.485334 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f32afd-8376-4f4a-8b41-7a7c2827e379 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:49.520205 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa1b8a-4c8d-4f9b-885b-203d3b8e70bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:49.520920 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa1b8a-4c8d-4f9b-885b-203d3b8e70bd None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:49.521209 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa1b8a-4c8d-4f9b-885b-203d3b8e70bd None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:49.521484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa1b8a-4c8d-4f9b-885b-203d3b8e70bd None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:49.522717 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa1b8a-4c8d-4f9b-885b-203d3b8e70bd None admin] RBAC: Authorizing `identity:get_project(project_id=d6b0a8a1377b4435987dffefaad3e6d7)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:49.524245 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa1b8a-4c8d-4f9b-885b-203d3b8e70bd None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:49.526881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 64/124] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:49 2022] GET /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:49.527640 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa1b8a-4c8d-4f9b-885b-203d3b8e70bd None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:49.535436 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7828d94-46da-4f9b-a70f-637880f78bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:49.536394 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7828d94-46da-4f9b-a70f-637880f78bed None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:49.537399 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7828d94-46da-4f9b-a70f-637880f78bed None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:49.537856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7828d94-46da-4f9b-a70f-637880f78bed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:49.551064 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7828d94-46da-4f9b-a70f-637880f78bed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:49.555574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:49.557354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-c7828d94-46da-4f9b-a70f-637880f78bed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:49.557354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:49.557354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:49.557354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:49.557354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:49.557354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:49.557354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:49.557354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:49.557354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:49.557354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:49.557354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:49.557354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:49.557354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:49.557354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:49.557354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:49.557354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:49.558171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:49.558171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:49.558171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:49.558171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:49.558171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:49.558171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:49.558171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:49.558171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:49.558171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:49.558171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:49.558171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:49.558171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:49.558171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:49.558171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:49.558171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:49.558171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:49.558929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:49.558929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:49.558929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:49.558929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:49.558929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:49.558929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:49.558929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:49.558929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:49.558929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:49.558929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:49.558929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:49.558929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:40:49.561184 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 61/125] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:40:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:49.562211 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7828d94-46da-4f9b-a70f-637880f78bed None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:49.595039 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:49.652934 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa1b8a-4c8d-4f9b-885b-203d3b8e70bd None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:49.695163 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7828d94-46da-4f9b-a70f-637880f78bed None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:49.696775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00396c0-ffb6-457a-a2de-99e08369fd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:49.698584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00396c0-ffb6-457a-a2de-99e08369fd78 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:49.698927 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00396c0-ffb6-457a-a2de-99e08369fd78 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:49.699213 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00396c0-ffb6-457a-a2de-99e08369fd78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:49.713406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00396c0-ffb6-457a-a2de-99e08369fd78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:49.720068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-f00396c0-ffb6-457a-a2de-99e08369fd78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:40:49.720068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:49.720068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:49.720068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:49.720068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:49.720068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:49.720068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:49.720068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:49.720068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:49.720068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:49.720068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:49.720068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:49.720068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:49.720068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:49.720068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:49.720068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:49.720903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:49.720903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:49.720903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:49.720903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:49.720903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:49.720903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:49.720903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:49.720903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:49.720903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:49.720903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:49.720903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:49.720903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:49.720903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:49.720903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:49.720903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:49.720903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:49.721668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:49.721668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:49.721668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:49.721668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:49.721668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:49.721668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:49.721668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:49.721668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:49.721668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:49.721668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:49.721668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:40:49.721668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:40:49.726834 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 65/126] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:49.728820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00396c0-ffb6-457a-a2de-99e08369fd78 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:49.741715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1deef1-5475-481f-a9c8-e596b4bf2e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:49.742376 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1deef1-5475-481f-a9c8-e596b4bf2e03 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:49.742684 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1deef1-5475-481f-a9c8-e596b4bf2e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:49.743365 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1deef1-5475-481f-a9c8-e596b4bf2e03 None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:49.744841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1deef1-5475-481f-a9c8-e596b4bf2e03 None admin] RBAC: Authorizing `identity:get_project(project_id=d6b0a8a1377b4435987dffefaad3e6d7)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:49.747045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1deef1-5475-481f-a9c8-e596b4bf2e03 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:49.750828 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 62/127] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:49 2022] GET /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:49.751792 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1deef1-5475-481f-a9c8-e596b4bf2e03 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:49.825376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:49.841494 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00396c0-ffb6-457a-a2de-99e08369fd78 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:49.875736 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:49.876647 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d3b27-79f8-489c-b898-74697a5ace56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:49.877434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d3b27-79f8-489c-b898-74697a5ace56 None admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:49.877831 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d3b27-79f8-489c-b898-74697a5ace56 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:49.878218 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d3b27-79f8-489c-b898-74697a5ace56 None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7/users/c428456e9e294402b87552a9b190d23b/roles/e39a3afcb14442a08e9a24b8a56d17cf` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:49.880750 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d3b27-79f8-489c-b898-74697a5ace56 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6b0a8a1377b4435987dffefaad3e6d7, user_id=c428456e9e294402b87552a9b190d23b, role_id=e39a3afcb14442a08e9a24b8a56d17cf)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:49.882393 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d3b27-79f8-489c-b898-74697a5ace56 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:49.883128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1deef1-5475-481f-a9c8-e596b4bf2e03 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:49.920015 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5855d09-8d11-4fc8-8611-1140c544f2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:49.920636 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5855d09-8d11-4fc8-8611-1140c544f2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:49.920922 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5855d09-8d11-4fc8-8611-1140c544f2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:49.921200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5855d09-8d11-4fc8-8611-1140c544f2f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:49.921915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5855d09-8d11-4fc8-8611-1140c544f2f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:49.922223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5855d09-8d11-4fc8-8611-1140c544f2f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:49.923629 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5855d09-8d11-4fc8-8611-1140c544f2f8 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:49.936585 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 63/128] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:49.936585 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5855d09-8d11-4fc8-8611-1140c544f2f8 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:49.948893 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 66/129] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:40:49 2022] PUT /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7/users/c428456e9e294402b87552a9b190d23b/roles/e39a3afcb14442a08e9a24b8a56d17cf => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:40:49.950176 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d3b27-79f8-489c-b898-74697a5ace56 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:50.051334 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5855d09-8d11-4fc8-8611-1140c544f2f8 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:50.091747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee70e1f-a5cd-4d88-bb48-44006d164d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:50.092393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee70e1f-a5cd-4d88-bb48-44006d164d1f None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:50.092681 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee70e1f-a5cd-4d88-bb48-44006d164d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:50.092960 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee70e1f-a5cd-4d88-bb48-44006d164d1f None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:50.093701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee70e1f-a5cd-4d88-bb48-44006d164d1f None admin] RBAC: Adding query filter params (name=member) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:50.094009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee70e1f-a5cd-4d88-bb48-44006d164d1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:50.095843 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee70e1f-a5cd-4d88-bb48-44006d164d1f None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:50.105749 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 64/130] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:40:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:50.106610 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee70e1f-a5cd-4d88-bb48-44006d164d1f None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:50.129421 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:50.189804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d3b27-79f8-489c-b898-74697a5ace56 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:50.232644 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee70e1f-a5cd-4d88-bb48-44006d164d1f None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:50.240675 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3c3dc-10f8-4286-bbe4-94db667c781c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:50.241361 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3c3dc-10f8-4286-bbe4-94db667c781c None admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:50.241651 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3c3dc-10f8-4286-bbe4-94db667c781c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:50.241935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3c3dc-10f8-4286-bbe4-94db667c781c None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7/users/c428456e9e294402b87552a9b190d23b/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:50.245605 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3c3dc-10f8-4286-bbe4-94db667c781c None admin] RBAC: Authorizing `identity:create_grant(project_id=d6b0a8a1377b4435987dffefaad3e6d7, user_id=c428456e9e294402b87552a9b190d23b, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:50.247286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3c3dc-10f8-4286-bbe4-94db667c781c None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:50.275156 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057c89e-c80d-4aae-8352-8b353145c312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:50.275823 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057c89e-c80d-4aae-8352-8b353145c312 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:50.276119 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057c89e-c80d-4aae-8352-8b353145c312 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:50.276449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057c89e-c80d-4aae-8352-8b353145c312 None admin] PATH_INFO: `/v3/users/9b2212edbdbd4786821e28173abce27f` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:50.277651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057c89e-c80d-4aae-8352-8b353145c312 None admin] RBAC: Authorizing `identity:get_user(user_id=9b2212edbdbd4786821e28173abce27f)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:50.279174 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057c89e-c80d-4aae-8352-8b353145c312 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:50.280800 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 65/131] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:50 2022] GET /identity/v3/users/9b2212edbdbd4786821e28173abce27f => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:50.281573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057c89e-c80d-4aae-8352-8b353145c312 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:50.387589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:50.398308 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 67/132] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:40:49 2022] PUT /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7/users/c428456e9e294402b87552a9b190d23b/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:40:50.399205 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3c3dc-10f8-4286-bbe4-94db667c781c None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:50.408914 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057c89e-c80d-4aae-8352-8b353145c312 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:50.415571 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:50.462476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec4dd8-499d-4215-909b-cd41ec512735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:50.463282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec4dd8-499d-4215-909b-cd41ec512735 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:50.463575 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec4dd8-499d-4215-909b-cd41ec512735 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:50.463856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec4dd8-499d-4215-909b-cd41ec512735 None admin] PATH_INFO: `/v3/users/c428456e9e294402b87552a9b190d23b` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:50.465203 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec4dd8-499d-4215-909b-cd41ec512735 None admin] RBAC: Authorizing `identity:get_user(user_id=c428456e9e294402b87552a9b190d23b)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:50.466771 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec4dd8-499d-4215-909b-cd41ec512735 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:50.468502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 66/133] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:50 2022] GET /identity/v3/users/c428456e9e294402b87552a9b190d23b => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:50.474281 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec4dd8-499d-4215-909b-cd41ec512735 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:50.612259 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3c3dc-10f8-4286-bbe4-94db667c781c None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:50.664497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec4dd8-499d-4215-909b-cd41ec512735 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:50.681248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f6d7b-12db-492b-a896-974f4af07fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:50.682146 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f6d7b-12db-492b-a896-974f4af07fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:50.682582 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f6d7b-12db-492b-a896-974f4af07fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:50.683034 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f6d7b-12db-492b-a896-974f4af07fc8 None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:50.684414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f6d7b-12db-492b-a896-974f4af07fc8 None admin] RBAC: Authorizing `identity:get_project(project_id=d6b0a8a1377b4435987dffefaad3e6d7)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:50.686035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f6d7b-12db-492b-a896-974f4af07fc8 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:50.688249 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 68/134] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:50 2022] GET /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7 => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:50.689629 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998a170-2709-4ae2-8831-c421035fe4ad None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:50.690120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998a170-2709-4ae2-8831-c421035fe4ad None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:50.690633 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998a170-2709-4ae2-8831-c421035fe4ad None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:50.698924 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 69/135] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:50 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:50.700554 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b30d9-69bb-4de0-b38d-d71e562c7638 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:50.700851 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b30d9-69bb-4de0-b38d-d71e562c7638 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:50.701140 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b30d9-69bb-4de0-b38d-d71e562c7638 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:50.702591 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 70/136] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:50.705997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b30d9-69bb-4de0-b38d-d71e562c7638 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:50.713880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed638f39-e959-4b95-b2c2-187fa6b76003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:50.714548 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed638f39-e959-4b95-b2c2-187fa6b76003 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:50.714876 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed638f39-e959-4b95-b2c2-187fa6b76003 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:50.715165 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed638f39-e959-4b95-b2c2-187fa6b76003 None admin] PATH_INFO: `/v3/projects/4d2811145321472a88df80d4243051cc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:50.716366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed638f39-e959-4b95-b2c2-187fa6b76003 None admin] RBAC: Authorizing `identity:get_project(project_id=4d2811145321472a88df80d4243051cc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:50.717826 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed638f39-e959-4b95-b2c2-187fa6b76003 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:50.719700 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 67/137] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:50 2022] GET /identity/v3/projects/4d2811145321472a88df80d4243051cc => generated 312 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:40:50.720857 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf794ed-608b-44f3-9b69-31e4c648099d None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:50.721154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf794ed-608b-44f3-9b69-31e4c648099d None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:50.721443 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf794ed-608b-44f3-9b69-31e4c648099d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:50.741201 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-ccf794ed-608b-44f3-9b69-31e4c648099d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:50.742419 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ccf794ed-608b-44f3-9b69-31e4c648099d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:50.762112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:50.794703 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:50.828069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b30d9-69bb-4de0-b38d-d71e562c7638 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:50.829919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 68/138] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:50.831737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978b647-8de3-4cb1-a76d-232eba5ff2c3 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:50.832168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978b647-8de3-4cb1-a76d-232eba5ff2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:50.832576 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978b647-8de3-4cb1-a76d-232eba5ff2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:50.853844 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-5978b647-8de3-4cb1-a76d-232eba5ff2c3 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:50.855574 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-5978b647-8de3-4cb1-a76d-232eba5ff2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:50.886025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a263f9-3517-49ca-b814-a2f3dd38781c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:50.886917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a263f9-3517-49ca-b814-a2f3dd38781c None admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:50.887311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a263f9-3517-49ca-b814-a2f3dd38781c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:50.887696 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a263f9-3517-49ca-b814-a2f3dd38781c None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7/users/9b2212edbdbd4786821e28173abce27f/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:50.889899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a263f9-3517-49ca-b814-a2f3dd38781c None admin] RBAC: Authorizing `identity:create_grant(project_id=d6b0a8a1377b4435987dffefaad3e6d7, user_id=9b2212edbdbd4786821e28173abce27f, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:50.891553 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a263f9-3517-49ca-b814-a2f3dd38781c None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:50.934204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 69/139] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:50.935708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978b647-8de3-4cb1-a76d-232eba5ff2c3 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:50.960386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 71/140] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:40:50 2022] PUT /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7/users/9b2212edbdbd4786821e28173abce27f/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:40:50.961535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a263f9-3517-49ca-b814-a2f3dd38781c None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:51.072759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:51.093835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978b647-8de3-4cb1-a76d-232eba5ff2c3 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:51.095217 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a263f9-3517-49ca-b814-a2f3dd38781c None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:51.147189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a27b3-1ae6-46c8-8724-1520ef91239b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:51.147907 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a27b3-1ae6-46c8-8724-1520ef91239b None admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:51.148191 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a27b3-1ae6-46c8-8724-1520ef91239b None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:51.148465 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a27b3-1ae6-46c8-8724-1520ef91239b None admin] PATH_INFO: `/v3/projects/4d2811145321472a88df80d4243051cc/users/c428456e9e294402b87552a9b190d23b/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:51.159105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a27b3-1ae6-46c8-8724-1520ef91239b None admin] RBAC: Authorizing `identity:create_grant(project_id=4d2811145321472a88df80d4243051cc, user_id=c428456e9e294402b87552a9b190d23b, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:51.160634 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a27b3-1ae6-46c8-8724-1520ef91239b None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:51.175553 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:51.181401 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544bdbb2-056f-4fae-bb5c-600c7ce6af85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:51.182196 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544bdbb2-056f-4fae-bb5c-600c7ce6af85 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:51.182532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544bdbb2-056f-4fae-bb5c-600c7ce6af85 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:51.182852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544bdbb2-056f-4fae-bb5c-600c7ce6af85 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:51.194632 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544bdbb2-056f-4fae-bb5c-600c7ce6af85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:51.200058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-544bdbb2-056f-4fae-bb5c-600c7ce6af85 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:40:51.200058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:51.200058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:51.200058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:51.200058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:51.200058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:51.200058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:51.200058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:51.200058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:51.200058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:51.200058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:51.200058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:51.200058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:51.200058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:51.200058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:51.200058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:51.200917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:51.200917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:51.200917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:51.200917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:51.200917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:51.200917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:51.200917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:51.200917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:51.200917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:51.200917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:51.200917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:51.200917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:51.200917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:51.200917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:51.200917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:51.200917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:51.201663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:51.201663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:51.201663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:51.201663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:51.201663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:51.201663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:51.201663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:51.201663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:51.201663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:51.201663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:51.201663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:40:51.201663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:40:51.201663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 72/141] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:51.202777 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544bdbb2-056f-4fae-bb5c-600c7ce6af85 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:51.247317 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 70/142] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:40:50 2022] PUT /identity/v3/projects/4d2811145321472a88df80d4243051cc/users/c428456e9e294402b87552a9b190d23b/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:40:51.254942 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a27b3-1ae6-46c8-8724-1520ef91239b None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:51.459835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a27b3-1ae6-46c8-8724-1520ef91239b None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:51.461244 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544bdbb2-056f-4fae-bb5c-600c7ce6af85 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:51.536668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b7b24-a40b-423f-bf72-e3393245f466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:51.537307 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b7b24-a40b-423f-bf72-e3393245f466 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:51.537595 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b7b24-a40b-423f-bf72-e3393245f466 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:51.537875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b7b24-a40b-423f-bf72-e3393245f466 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:51.538602 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b7b24-a40b-423f-bf72-e3393245f466 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:51.538941 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b7b24-a40b-423f-bf72-e3393245f466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:51.540365 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b7b24-a40b-423f-bf72-e3393245f466 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:51.542624 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154418b5-f1bb-466e-b2db-ae1f1ce2630a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:51.545254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154418b5-f1bb-466e-b2db-ae1f1ce2630a None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:51.545548 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154418b5-f1bb-466e-b2db-ae1f1ce2630a None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:51.545830 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154418b5-f1bb-466e-b2db-ae1f1ce2630a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:51.548717 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154418b5-f1bb-466e-b2db-ae1f1ce2630a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:51.550168 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154418b5-f1bb-466e-b2db-ae1f1ce2630a None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:51.555794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 71/143] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:40:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:51.556039 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 73/144] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:40:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:51.563352 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b7b24-a40b-423f-bf72-e3393245f466 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:51.564606 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154418b5-f1bb-466e-b2db-ae1f1ce2630a None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:51.574765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:51.676909 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:51.736620 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154418b5-f1bb-466e-b2db-ae1f1ce2630a None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:51.786930 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b7b24-a40b-423f-bf72-e3393245f466 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:51.789274 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6955235-c387-477c-909d-c14422f0788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:51.798754 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6955235-c387-477c-909d-c14422f0788c None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:51.798754 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6955235-c387-477c-909d-c14422f0788c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:51.798754 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6955235-c387-477c-909d-c14422f0788c None admin] PATH_INFO: `/v3/users/b8e1bab3be2c40f7a2dc3f7152c72fca` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:51.801026 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6955235-c387-477c-909d-c14422f0788c None admin] RBAC: Authorizing `identity:get_user(user_id=b8e1bab3be2c40f7a2dc3f7152c72fca)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:51.802520 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6955235-c387-477c-909d-c14422f0788c None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:51.804568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 74/145] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:51 2022] GET /identity/v3/users/b8e1bab3be2c40f7a2dc3f7152c72fca => generated 289 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:51.824117 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6955235-c387-477c-909d-c14422f0788c None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:51.855150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1542e79-58b2-4341-b176-43e845e08738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:51.856171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1542e79-58b2-4341-b176-43e845e08738 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:51.856719 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1542e79-58b2-4341-b176-43e845e08738 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:51.857197 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1542e79-58b2-4341-b176-43e845e08738 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:51.858104 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1542e79-58b2-4341-b176-43e845e08738 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:51.859784 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1542e79-58b2-4341-b176-43e845e08738 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:51.996037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 72/146] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 3 12:40:51 2022] POST /identity/v3/users => generated 283 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:40:52.015253 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6955235-c387-477c-909d-c14422f0788c None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:52.054294 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:52.065081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69d00f-2ccb-4c8c-95e8-28be91e957b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:52.065756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69d00f-2ccb-4c8c-95e8-28be91e957b2 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:52.066045 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69d00f-2ccb-4c8c-95e8-28be91e957b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:52.066330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69d00f-2ccb-4c8c-95e8-28be91e957b2 None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:52.067593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69d00f-2ccb-4c8c-95e8-28be91e957b2 None admin] RBAC: Authorizing `identity:get_project(project_id=d6b0a8a1377b4435987dffefaad3e6d7)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:52.069078 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69d00f-2ccb-4c8c-95e8-28be91e957b2 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:52.070805 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 75/147] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:51 2022] GET /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:52.076730 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1542e79-58b2-4341-b176-43e845e08738 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:52.175140 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:52.233460 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1542e79-58b2-4341-b176-43e845e08738 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:52.282688 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742c80e-302b-4c69-bc68-3d4a1c246ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:52.283347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742c80e-302b-4c69-bc68-3d4a1c246ccc None admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:52.283635 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742c80e-302b-4c69-bc68-3d4a1c246ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:52.283916 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742c80e-302b-4c69-bc68-3d4a1c246ccc None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7/users/b8e1bab3be2c40f7a2dc3f7152c72fca/roles/a68c1386e9434ef9b5aff7d46f61c2b4` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:52.292671 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742c80e-302b-4c69-bc68-3d4a1c246ccc None admin] RBAC: Authorizing `identity:create_grant(project_id=d6b0a8a1377b4435987dffefaad3e6d7, user_id=b8e1bab3be2c40f7a2dc3f7152c72fca, role_id=a68c1386e9434ef9b5aff7d46f61c2b4)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:52.294162 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742c80e-302b-4c69-bc68-3d4a1c246ccc None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:52.400378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 73/148] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:40:52 2022] PUT /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7/users/b8e1bab3be2c40f7a2dc3f7152c72fca/roles/a68c1386e9434ef9b5aff7d46f61c2b4 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:40:52.534625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264aa3b2-0cca-4c5c-826f-13fce2b03a96 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:52.534986 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264aa3b2-0cca-4c5c-826f-13fce2b03a96 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:52.535159 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264aa3b2-0cca-4c5c-826f-13fce2b03a96 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:52.536858 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 76/149] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:52.543384 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559fad8-466e-4f67-babf-4df22faeb56a None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:52.543678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559fad8-466e-4f67-babf-4df22faeb56a None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:52.543961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559fad8-466e-4f67-babf-4df22faeb56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:52.568702 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-e559fad8-466e-4f67-babf-4df22faeb56a None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:52.569940 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e559fad8-466e-4f67-babf-4df22faeb56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:52.661226 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 74/150] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:52.690244 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264aa3b2-0cca-4c5c-826f-13fce2b03a96 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:52.816070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264aa3b2-0cca-4c5c-826f-13fce2b03a96 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:52.857084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3e66a-8a00-4109-b28d-fbc4453ca195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:52.857746 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3e66a-8a00-4109-b28d-fbc4453ca195 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:52.858032 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3e66a-8a00-4109-b28d-fbc4453ca195 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:52.858316 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3e66a-8a00-4109-b28d-fbc4453ca195 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:52.868898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3e66a-8a00-4109-b28d-fbc4453ca195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:52.873935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-b6a3e66a-8a00-4109-b28d-fbc4453ca195 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:40:52.873935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:52.873935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:52.873935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:52.873935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:52.873935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:52.873935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:52.873935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:52.873935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:52.873935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:52.873935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:52.873935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:52.873935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:52.873935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:52.873935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:52.873935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:52.874791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:52.874791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:52.874791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:52.874791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:52.874791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:52.874791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:52.874791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:52.874791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:52.874791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:52.874791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:52.874791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:52.874791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:52.874791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:52.874791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:52.874791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:52.874791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:52.875545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:52.875545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:52.875545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:52.875545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:52.875545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:52.875545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:52.875545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:52.875545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:52.875545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:52.875545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:52.875545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:40:52.875545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:40:52.879523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 77/151] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:40:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:52.887855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559fad8-466e-4f67-babf-4df22faeb56a None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:52.973739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:53.031656 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559fad8-466e-4f67-babf-4df22faeb56a None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:53.071567 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959e4b0-bcad-46f4-9570-7ccd8e8db638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:53.072143 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959e4b0-bcad-46f4-9570-7ccd8e8db638 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:53.072522 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959e4b0-bcad-46f4-9570-7ccd8e8db638 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:53.072808 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959e4b0-bcad-46f4-9570-7ccd8e8db638 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:53.073691 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959e4b0-bcad-46f4-9570-7ccd8e8db638 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:53.074000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959e4b0-bcad-46f4-9570-7ccd8e8db638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:53.075750 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959e4b0-bcad-46f4-9570-7ccd8e8db638 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:53.089632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 75/152] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:40:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:53.095674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3e66a-8a00-4109-b28d-fbc4453ca195 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:53.167951 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:53.220944 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3e66a-8a00-4109-b28d-fbc4453ca195 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:53.224092 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a410e4a-6fff-4dac-abaf-59a89900e4bb None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:53.224395 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a410e4a-6fff-4dac-abaf-59a89900e4bb None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:53.224677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a410e4a-6fff-4dac-abaf-59a89900e4bb None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:53.226221 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 76/153] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:53.232346 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f5d89-dd9c-418b-ad5c-ab91bfbb3ca5 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:53.232742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f5d89-dd9c-418b-ad5c-ab91bfbb3ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:53.233033 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f5d89-dd9c-418b-ad5c-ab91bfbb3ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:53.265852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c81c3-6f05-4bc0-8987-8ce730b396b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:53.266517 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c81c3-6f05-4bc0-8987-8ce730b396b7 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:53.266839 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c81c3-6f05-4bc0-8987-8ce730b396b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:53.267128 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c81c3-6f05-4bc0-8987-8ce730b396b7 None admin] PATH_INFO: `/v3/users/c428456e9e294402b87552a9b190d23b` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:53.268335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c81c3-6f05-4bc0-8987-8ce730b396b7 None admin] RBAC: Authorizing `identity:get_user(user_id=c428456e9e294402b87552a9b190d23b)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:53.269807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c81c3-6f05-4bc0-8987-8ce730b396b7 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:53.270275 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-0d3f5d89-dd9c-418b-ad5c-ab91bfbb3ca5 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:53.271578 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-0d3f5d89-dd9c-418b-ad5c-ab91bfbb3ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:53.271814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 78/154] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:53 2022] GET /identity/v3/users/c428456e9e294402b87552a9b190d23b => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:53.278467 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c81c3-6f05-4bc0-8987-8ce730b396b7 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:53.392338 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 77/155] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:53.407777 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c81c3-6f05-4bc0-8987-8ce730b396b7 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:53.432905 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:53.435375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f5d89-dd9c-418b-ad5c-ab91bfbb3ca5 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:53.450784 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301675f-18ae-4103-8b86-88db8d11e575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:53.450784 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301675f-18ae-4103-8b86-88db8d11e575 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:53.450784 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301675f-18ae-4103-8b86-88db8d11e575 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:53.450784 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301675f-18ae-4103-8b86-88db8d11e575 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:53.522408 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:53.543025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301675f-18ae-4103-8b86-88db8d11e575 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:53.544536 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301675f-18ae-4103-8b86-88db8d11e575 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:53.649330 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f5d89-dd9c-418b-ad5c-ab91bfbb3ca5 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:53.715965 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 79/156] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:40:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 12:40:53.717853 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b2344-6ac6-4c56-8a2c-3cef2ba1d57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:53.718837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b2344-6ac6-4c56-8a2c-3cef2ba1d57b None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:53.719335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b2344-6ac6-4c56-8a2c-3cef2ba1d57b None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:53.719820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b2344-6ac6-4c56-8a2c-3cef2ba1d57b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:53.721352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301675f-18ae-4103-8b86-88db8d11e575 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:53.741785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b2344-6ac6-4c56-8a2c-3cef2ba1d57b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:53.747366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-9d9b2344-6ac6-4c56-8a2c-3cef2ba1d57b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:40:53.747366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:53.747366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:53.747366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:53.747366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:53.747366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:53.747366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:53.747366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:53.747366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:53.747366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:53.747366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:53.747366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:53.747366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:53.747366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:53.747366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:53.747366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:53.748195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:53.748195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:53.748195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:53.748195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:53.748195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:53.748195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:53.748195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:53.748195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:53.748195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:53.748195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:53.748195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:53.748195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:53.748195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:53.748195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:53.748195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:53.748195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:53.748994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:53.748994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:53.748994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:53.748994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:53.748994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:53.748994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:53.748994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:53.748994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:53.748994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:53.748994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:53.748994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:40:53.748994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:40:53.752112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 78/157] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:53.758109 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b2344-6ac6-4c56-8a2c-3cef2ba1d57b None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:53.771228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:53.867638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301675f-18ae-4103-8b86-88db8d11e575 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:53.914941 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b2344-6ac6-4c56-8a2c-3cef2ba1d57b None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:53.922764 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:53.923032 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c645a-9af0-462b-b970-0f5a485aa51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:53.923853 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c645a-9af0-462b-b970-0f5a485aa51d None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:53.924992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c645a-9af0-462b-b970-0f5a485aa51d None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:53.925277 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c645a-9af0-462b-b970-0f5a485aa51d None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:53.927065 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c645a-9af0-462b-b970-0f5a485aa51d None admin] RBAC: Authorizing `identity:get_project(project_id=d6b0a8a1377b4435987dffefaad3e6d7)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:53.928690 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c645a-9af0-462b-b970-0f5a485aa51d None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:53.935305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 80/158] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:53 2022] GET /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:53.942524 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c645a-9af0-462b-b970-0f5a485aa51d None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:53.976377 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70c779-4c14-4498-9132-001463f09bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:53.977014 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70c779-4c14-4498-9132-001463f09bfd None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:53.977298 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70c779-4c14-4498-9132-001463f09bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:53.977572 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70c779-4c14-4498-9132-001463f09bfd None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:53.978338 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70c779-4c14-4498-9132-001463f09bfd None admin] RBAC: Adding query filter params (name=member) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:53.978639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70c779-4c14-4498-9132-001463f09bfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:53.980055 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70c779-4c14-4498-9132-001463f09bfd None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:53.997976 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 79/159] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:40:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:54.003507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70c779-4c14-4498-9132-001463f09bfd None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:54.069434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:54.082315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c645a-9af0-462b-b970-0f5a485aa51d None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:54.140530 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29081f9-0b78-46b9-8df6-b9e59bcc62e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:54.141854 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29081f9-0b78-46b9-8df6-b9e59bcc62e9 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:54.142281 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29081f9-0b78-46b9-8df6-b9e59bcc62e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:54.142694 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29081f9-0b78-46b9-8df6-b9e59bcc62e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:54.143661 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29081f9-0b78-46b9-8df6-b9e59bcc62e9 None admin] RBAC: Adding query filter params (role.id=e39a3afcb14442a08e9a24b8a56d17cf, scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7, user.id=c428456e9e294402b87552a9b190d23b) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:54.144138 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29081f9-0b78-46b9-8df6-b9e59bcc62e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:54.146022 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29081f9-0b78-46b9-8df6-b9e59bcc62e9 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:54.160388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70c779-4c14-4498-9132-001463f09bfd None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:54.163663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 81/160] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:40:53 2022] GET /identity/v3/role_assignments?user.id=c428456e9e294402b87552a9b190d23b&scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7&role.id=e39a3afcb14442a08e9a24b8a56d17cf => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:40:54.197955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579deb6-b2bd-4dd3-8093-a87c2479fca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:54.198535 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579deb6-b2bd-4dd3-8093-a87c2479fca6 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:54.198844 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579deb6-b2bd-4dd3-8093-a87c2479fca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:54.199122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579deb6-b2bd-4dd3-8093-a87c2479fca6 None admin] PATH_INFO: `/v3/users/c428456e9e294402b87552a9b190d23b` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:54.200304 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579deb6-b2bd-4dd3-8093-a87c2479fca6 None admin] RBAC: Authorizing `identity:get_user(user_id=c428456e9e294402b87552a9b190d23b)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:54.201741 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579deb6-b2bd-4dd3-8093-a87c2479fca6 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:54.203396 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 80/161] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:54 2022] GET /identity/v3/users/c428456e9e294402b87552a9b190d23b => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:40:54.209055 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29081f9-0b78-46b9-8df6-b9e59bcc62e9 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:54.272621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a60eb-5802-419d-9b14-22980a46c0c5 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:54.272943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a60eb-5802-419d-9b14-22980a46c0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:54.273173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a60eb-5802-419d-9b14-22980a46c0c5 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:54.274615 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 81/162] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:40:54.280034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078dee1-0df0-451b-998c-f1d77cb7f671 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:54.280325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078dee1-0df0-451b-998c-f1d77cb7f671 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:54.280603 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078dee1-0df0-451b-998c-f1d77cb7f671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:54.318833 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-b078dee1-0df0-451b-998c-f1d77cb7f671 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:54.320134 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b078dee1-0df0-451b-998c-f1d77cb7f671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:54.403125 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:54.422789 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29081f9-0b78-46b9-8df6-b9e59bcc62e9 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:54.484255 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 82/163] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:40:54.492060 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09a0c1-07fe-438d-a742-0042ddaf9aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:54.492688 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09a0c1-07fe-438d-a742-0042ddaf9aed None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:54.492971 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09a0c1-07fe-438d-a742-0042ddaf9aed None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:54.493291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09a0c1-07fe-438d-a742-0042ddaf9aed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:54.526804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078dee1-0df0-451b-998c-f1d77cb7f671 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:54.539115 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:54.623329 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09a0c1-07fe-438d-a742-0042ddaf9aed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:54.624841 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09a0c1-07fe-438d-a742-0042ddaf9aed None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:54.701856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078dee1-0df0-451b-998c-f1d77cb7f671 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:54.752059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 82/164] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:40:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:40:54.758244 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09a0c1-07fe-438d-a742-0042ddaf9aed None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:54.762321 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25b5fc-0f62-4a64-9118-9cf7392fb238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:54.763298 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25b5fc-0f62-4a64-9118-9cf7392fb238 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:54.763809 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25b5fc-0f62-4a64-9118-9cf7392fb238 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:54.764278 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25b5fc-0f62-4a64-9118-9cf7392fb238 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:54.781485 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25b5fc-0f62-4a64-9118-9cf7392fb238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:54.787239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-1f25b5fc-0f62-4a64-9118-9cf7392fb238 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:54.787239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:54.787239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:54.787239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:54.787239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:54.787239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:54.787239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:54.787239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:54.787239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:54.787239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:54.787239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:54.787239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:54.787239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:54.787239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:54.787239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:54.787239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:54.788168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:54.788168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:54.788168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:54.788168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:54.788168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:54.788168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:54.788168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:54.788168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:54.788168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:54.788168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:54.788168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:54.788168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:54.788168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:54.788168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:54.788168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:54.788168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:54.788928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:54.788928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:54.788928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:54.788928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:54.788928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:54.788928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:54.788928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:54.788928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:54.788928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:54.788928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:54.788928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:54.788928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:40:54.793038 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 83/165] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:40:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:40:54.799745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25b5fc-0f62-4a64-9118-9cf7392fb238 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:54.823678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:54.844382 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:54.889062 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09a0c1-07fe-438d-a742-0042ddaf9aed None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:54.934992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54309aa2-18f5-4c1d-be1d-c6c94c5e92ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:54.935652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54309aa2-18f5-4c1d-be1d-c6c94c5e92ed None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:54.935936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54309aa2-18f5-4c1d-be1d-c6c94c5e92ed None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:54.936209 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54309aa2-18f5-4c1d-be1d-c6c94c5e92ed None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:54.937540 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54309aa2-18f5-4c1d-be1d-c6c94c5e92ed None admin] RBAC: Authorizing `identity:get_project(project_id=d6b0a8a1377b4435987dffefaad3e6d7)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:54.939041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54309aa2-18f5-4c1d-be1d-c6c94c5e92ed None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:54.940754 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 83/166] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:54 2022] GET /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:54.948113 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54309aa2-18f5-4c1d-be1d-c6c94c5e92ed None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:55.021836 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25b5fc-0f62-4a64-9118-9cf7392fb238 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:55.096797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077e2ca-5401-46b7-91bd-96b3bd09c771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:55.097543 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077e2ca-5401-46b7-91bd-96b3bd09c771 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:55.097835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077e2ca-5401-46b7-91bd-96b3bd09c771 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:55.098115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077e2ca-5401-46b7-91bd-96b3bd09c771 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:55.098873 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077e2ca-5401-46b7-91bd-96b3bd09c771 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:55.099185 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077e2ca-5401-46b7-91bd-96b3bd09c771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:55.100585 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077e2ca-5401-46b7-91bd-96b3bd09c771 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:55.114545 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 84/167] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:55.115887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f990d-07ce-49b8-907d-ed6b00debca9 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:55.116184 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f990d-07ce-49b8-907d-ed6b00debca9 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:55.116466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f990d-07ce-49b8-907d-ed6b00debca9 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:55.117679 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 85/168] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:55.123790 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f990d-07ce-49b8-907d-ed6b00debca9 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:55.217569 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54309aa2-18f5-4c1d-be1d-c6c94c5e92ed None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:55.327837 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:55.328047 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:55.328459 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b3956-4482-45c0-b85c-b90468a06bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:55.328459 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b3956-4482-45c0-b85c-b90468a06bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:55.328459 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b3956-4482-45c0-b85c-b90468a06bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:55.328459 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b3956-4482-45c0-b85c-b90468a06bd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:55.328806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b3956-4482-45c0-b85c-b90468a06bd1 None admin] RBAC: Adding query filter params (role.id=26c9fe6916a4412d96492e41ff62cca6, scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7, user.id=c428456e9e294402b87552a9b190d23b) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:55.328806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b3956-4482-45c0-b85c-b90468a06bd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:55.328806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b3956-4482-45c0-b85c-b90468a06bd1 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:55.343879 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f990d-07ce-49b8-907d-ed6b00debca9 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:55.344945 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 84/169] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:40:54 2022] GET /identity/v3/role_assignments?user.id=c428456e9e294402b87552a9b190d23b&scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7&role.id=26c9fe6916a4412d96492e41ff62cca6 => generated 608 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:55.346201 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f87d8c-d729-45a2-910b-d969e5723765 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:55.346813 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f87d8c-d729-45a2-910b-d969e5723765 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:55.346813 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f87d8c-d729-45a2-910b-d969e5723765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:55.387886 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-39f87d8c-d729-45a2-910b-d969e5723765 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:55.389136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-39f87d8c-d729-45a2-910b-d969e5723765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:55.410146 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14119f1-fc32-416d-9b60-5fdd6e48af23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:55.410900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14119f1-fc32-416d-9b60-5fdd6e48af23 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:55.411240 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14119f1-fc32-416d-9b60-5fdd6e48af23 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:55.411524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14119f1-fc32-416d-9b60-5fdd6e48af23 None admin] PATH_INFO: `/v3/users/9b2212edbdbd4786821e28173abce27f` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:55.413314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14119f1-fc32-416d-9b60-5fdd6e48af23 None admin] RBAC: Authorizing `identity:get_user(user_id=9b2212edbdbd4786821e28173abce27f)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:55.415972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14119f1-fc32-416d-9b60-5fdd6e48af23 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:55.418011 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 86/170] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:55 2022] GET /identity/v3/users/9b2212edbdbd4786821e28173abce27f => generated 247 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:40:55.424631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14119f1-fc32-416d-9b60-5fdd6e48af23 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:55.537531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14119f1-fc32-416d-9b60-5fdd6e48af23 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:55.576207 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 85/171] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:55.583672 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ed6a0-71c2-423c-a4b7-875f58d7e5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:55.584236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ed6a0-71c2-423c-a4b7-875f58d7e5cc None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:55.584754 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ed6a0-71c2-423c-a4b7-875f58d7e5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:55.585036 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ed6a0-71c2-423c-a4b7-875f58d7e5cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:55.611756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f87d8c-d729-45a2-910b-d969e5723765 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:55.629371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:55.707810 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ed6a0-71c2-423c-a4b7-875f58d7e5cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:55.709886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ed6a0-71c2-423c-a4b7-875f58d7e5cc None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:55.843896 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f87d8c-d729-45a2-910b-d969e5723765 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:55.878554 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:55.910468 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 87/172] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:40:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:40:55.911900 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d6c7a-7d35-4575-8ce9-eb70ab5429f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:55.912572 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d6c7a-7d35-4575-8ce9-eb70ab5429f2 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:55.912918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d6c7a-7d35-4575-8ce9-eb70ab5429f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:55.913201 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d6c7a-7d35-4575-8ce9-eb70ab5429f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:55.919648 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ed6a0-71c2-423c-a4b7-875f58d7e5cc None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:55.936062 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d6c7a-7d35-4575-8ce9-eb70ab5429f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:55.941228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-b85d6c7a-7d35-4575-8ce9-eb70ab5429f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:40:55.941228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:55.941228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:55.941228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:55.941228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:55.941228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:55.941228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:55.941228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:55.941228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:55.941228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:55.941228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:55.941228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:55.941228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:55.941228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:55.941228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:55.941228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:55.942223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:55.942223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:55.942223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:55.942223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:55.942223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:55.942223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:55.942223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:55.942223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:55.942223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:55.942223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:55.942223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:55.942223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:55.942223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:55.942223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:55.942223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:55.942223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:55.943059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:55.943059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:55.943059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:55.943059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:55.943059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:55.943059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:55.943059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:55.943059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:55.943059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:55.943059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:55.943059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:40:55.943059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:40:55.943059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 86/173] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:55.946793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef5f5a-7ea8-493b-9074-8e0d1644ce72 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:55.947064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef5f5a-7ea8-493b-9074-8e0d1644ce72 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:55.947346 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef5f5a-7ea8-493b-9074-8e0d1644ce72 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:55.948681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 87/174] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:55.954810 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124a4b2-eaee-4fc0-b40e-47426a6c86f5 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:55.955165 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124a4b2-eaee-4fc0-b40e-47426a6c86f5 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:55.955382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124a4b2-eaee-4fc0-b40e-47426a6c86f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:55.975880 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-e124a4b2-eaee-4fc0-b40e-47426a6c86f5 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:55.977105 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e124a4b2-eaee-4fc0-b40e-47426a6c86f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:56.047028 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:56.060208 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 88/175] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:56.061029 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124a4b2-eaee-4fc0-b40e-47426a6c86f5 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:56.162442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ed6a0-71c2-423c-a4b7-875f58d7e5cc None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:56.219583 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c848338-ef22-4852-8595-c25d14c19368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:56.220238 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c848338-ef22-4852-8595-c25d14c19368 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:56.220515 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c848338-ef22-4852-8595-c25d14c19368 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:56.220786 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c848338-ef22-4852-8595-c25d14c19368 None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:56.223841 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124a4b2-eaee-4fc0-b40e-47426a6c86f5 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:56.225466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c848338-ef22-4852-8595-c25d14c19368 None admin] RBAC: Authorizing `identity:get_project(project_id=d6b0a8a1377b4435987dffefaad3e6d7)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:56.226934 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c848338-ef22-4852-8595-c25d14c19368 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:56.228646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 88/176] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:55 2022] GET /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7 => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:56.230225 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c848338-ef22-4852-8595-c25d14c19368 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:56.239869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:56.283833 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae379de4-375b-4339-8ed0-125552f5f51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:56.284459 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae379de4-375b-4339-8ed0-125552f5f51e None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:56.284740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae379de4-375b-4339-8ed0-125552f5f51e None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:56.285029 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae379de4-375b-4339-8ed0-125552f5f51e None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:56.286362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae379de4-375b-4339-8ed0-125552f5f51e None admin] RBAC: Adding query filter params (name=member) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:56.286669 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae379de4-375b-4339-8ed0-125552f5f51e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:56.288081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae379de4-375b-4339-8ed0-125552f5f51e None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:56.299354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 89/177] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:40:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:56.300010 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae379de4-375b-4339-8ed0-125552f5f51e None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:56.410379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c848338-ef22-4852-8595-c25d14c19368 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:56.435076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:56.435390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae379de4-375b-4339-8ed0-125552f5f51e None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:56.449954 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd698f-9954-4535-b463-6fe80cf13207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:56.450678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd698f-9954-4535-b463-6fe80cf13207 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:56.450936 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd698f-9954-4535-b463-6fe80cf13207 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:56.451218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd698f-9954-4535-b463-6fe80cf13207 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:56.461823 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd698f-9954-4535-b463-6fe80cf13207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:56.467077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-debd698f-9954-4535-b463-6fe80cf13207 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:56.467077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:56.467077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:56.467077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:56.467077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:56.467077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:56.467077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:56.467077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:56.467077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:56.467077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:56.467077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:56.467077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:56.467077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:56.467077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:56.467077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:56.467077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:56.468114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:56.468114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:56.468114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:56.468114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:56.468114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:56.468114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:56.468114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:56.468114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:56.468114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:56.468114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:56.468114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:56.468114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:56.468114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:56.468114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:56.468114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:56.468114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:56.468900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:56.468900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:56.468900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:56.468900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:56.468900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:56.468900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:56.468900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:56.468900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:56.468900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:56.468900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:56.468900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:56.468900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:40:56.468900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 89/178] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:40:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:56.469539 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd698f-9954-4535-b463-6fe80cf13207 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:56.477788 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4b6a7-eae7-4b15-91bd-a368e721af04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:56.478825 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4b6a7-eae7-4b15-91bd-a368e721af04 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:56.479307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4b6a7-eae7-4b15-91bd-a368e721af04 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:56.479778 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4b6a7-eae7-4b15-91bd-a368e721af04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:56.480784 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4b6a7-eae7-4b15-91bd-a368e721af04 None admin] RBAC: Adding query filter params (role.id=a6d209169b77456f9f1cc3ff53646cfc, scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7, user.id=9b2212edbdbd4786821e28173abce27f) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:56.481302 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4b6a7-eae7-4b15-91bd-a368e721af04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:56.483250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4b6a7-eae7-4b15-91bd-a368e721af04 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:56.489699 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 90/179] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:40:56 2022] GET /identity/v3/role_assignments?user.id=9b2212edbdbd4786821e28173abce27f&scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7&role.id=a6d209169b77456f9f1cc3ff53646cfc => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:56.496341 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97d0fc-d8ac-482b-86ce-dfe8cd2452ba None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:56.496945 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97d0fc-d8ac-482b-86ce-dfe8cd2452ba None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:56.497417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97d0fc-d8ac-482b-86ce-dfe8cd2452ba None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:56.503150 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 91/180] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:56.504330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97d0fc-d8ac-482b-86ce-dfe8cd2452ba None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:56.570573 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:56.579616 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd698f-9954-4535-b463-6fe80cf13207 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:56.617537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eead57-dff4-40ff-b9b6-c90d80778a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:56.618762 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eead57-dff4-40ff-b9b6-c90d80778a69 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:56.619075 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eead57-dff4-40ff-b9b6-c90d80778a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:56.619356 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eead57-dff4-40ff-b9b6-c90d80778a69 None admin] PATH_INFO: `/v3/users/c428456e9e294402b87552a9b190d23b` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:56.620565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eead57-dff4-40ff-b9b6-c90d80778a69 None admin] RBAC: Authorizing `identity:get_user(user_id=c428456e9e294402b87552a9b190d23b)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:56.628302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eead57-dff4-40ff-b9b6-c90d80778a69 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:56.628302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 90/181] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:56 2022] GET /identity/v3/users/c428456e9e294402b87552a9b190d23b => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:56.628302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7bea6-4cf7-451b-a462-054d3fbdea82 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:56.628302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7bea6-4cf7-451b-a462-054d3fbdea82 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:56.628302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7bea6-4cf7-451b-a462-054d3fbdea82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:56.647359 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-0dc7bea6-4cf7-451b-a462-054d3fbdea82 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:56.647359 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-0dc7bea6-4cf7-451b-a462-054d3fbdea82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:56.683883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97d0fc-d8ac-482b-86ce-dfe8cd2452ba None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:56.724554 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f69f9d-b6e4-4893-a55d-317e4c665597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:56.726218 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f69f9d-b6e4-4893-a55d-317e4c665597 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:56.726745 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f69f9d-b6e4-4893-a55d-317e4c665597 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:56.729509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f69f9d-b6e4-4893-a55d-317e4c665597 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:56.732147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f69f9d-b6e4-4893-a55d-317e4c665597 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:56.732651 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f69f9d-b6e4-4893-a55d-317e4c665597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:56.732772 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:56.734967 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f69f9d-b6e4-4893-a55d-317e4c665597 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:56.754342 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 92/182] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:56.756983 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f69f9d-b6e4-4893-a55d-317e4c665597 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:56.787953 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 91/183] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:56.789116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7bea6-4cf7-451b-a462-054d3fbdea82 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:56.880852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:56.887028 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f69f9d-b6e4-4893-a55d-317e4c665597 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:56.912769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7bea6-4cf7-451b-a462-054d3fbdea82 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:56.933100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcab59-e252-4611-a0e7-11389137e1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:56.934029 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcab59-e252-4611-a0e7-11389137e1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:56.934335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcab59-e252-4611-a0e7-11389137e1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:56.934617 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcab59-e252-4611-a0e7-11389137e1b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:56.959518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbf75c-41de-4313-a1d4-b68f0c702a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:56.960176 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbf75c-41de-4313-a1d4-b68f0c702a22 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:56.960461 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbf75c-41de-4313-a1d4-b68f0c702a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:56.961297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbf75c-41de-4313-a1d4-b68f0c702a22 None admin] PATH_INFO: `/v3/users/26e47e146f0f4358a3c05f9f13c44a62` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:56.977293 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbf75c-41de-4313-a1d4-b68f0c702a22 None admin] RBAC: Authorizing `identity:get_user(user_id=26e47e146f0f4358a3c05f9f13c44a62)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:56.979360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbf75c-41de-4313-a1d4-b68f0c702a22 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:56.981351 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 92/184] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:56 2022] GET /identity/v3/users/26e47e146f0f4358a3c05f9f13c44a62 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:56.983203 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbf75c-41de-4313-a1d4-b68f0c702a22 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:57.011805 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcab59-e252-4611-a0e7-11389137e1b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:57.013304 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcab59-e252-4611-a0e7-11389137e1b1 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:57.024188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:57.090816 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbf75c-41de-4313-a1d4-b68f0c702a22 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:57.106550 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:57.112797 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 93/185] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:40:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:40:57.114018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084b2c0-0f2a-4d71-afbc-c2878db865a9 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:57.114303 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084b2c0-0f2a-4d71-afbc-c2878db865a9 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:57.114577 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084b2c0-0f2a-4d71-afbc-c2878db865a9 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:57.118607 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 94/186] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:57.118607 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084b2c0-0f2a-4d71-afbc-c2878db865a9 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:57.127196 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43154571-7476-4b50-a6ef-90cf30a51a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:57.127851 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43154571-7476-4b50-a6ef-90cf30a51a78 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:57.128132 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43154571-7476-4b50-a6ef-90cf30a51a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:57.128407 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43154571-7476-4b50-a6ef-90cf30a51a78 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:57.138919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43154571-7476-4b50-a6ef-90cf30a51a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:57.143964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-43154571-7476-4b50-a6ef-90cf30a51a78 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:40:57.143964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:57.143964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:57.143964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:57.143964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:57.143964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:57.143964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:57.143964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:57.143964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:57.143964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:57.143964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:57.143964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:57.143964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:57.143964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:57.143964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:57.143964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:57.144998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:57.144998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:57.144998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:57.144998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:57.144998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:57.144998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:57.144998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:57.144998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:57.144998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:57.144998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:57.144998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:57.144998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:57.144998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:57.144998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:57.144998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:57.144998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:57.146037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:57.146037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:57.146037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:57.146037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:57.146037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:57.146037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:57.146037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:57.146037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:57.146037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:57.146037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:57.146037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:40:57.146037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:40:57.146037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 93/187] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:57.146874 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ee327-62a9-4d4e-9087-3f8b3a010357 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:57.146874 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ee327-62a9-4d4e-9087-3f8b3a010357 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:57.147029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ee327-62a9-4d4e-9087-3f8b3a010357 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:57.148325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 94/188] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:40:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:57.148928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ee327-62a9-4d4e-9087-3f8b3a010357 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:57.226651 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084b2c0-0f2a-4d71-afbc-c2878db865a9 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:57.244860 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:57.251349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ee327-62a9-4d4e-9087-3f8b3a010357 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:57.259609 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a1104-af46-4a74-93dd-209fc3beb21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:57.260237 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a1104-af46-4a74-93dd-209fc3beb21b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:57.260519 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a1104-af46-4a74-93dd-209fc3beb21b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:57.260797 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a1104-af46-4a74-93dd-209fc3beb21b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:57.284005 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a307ad-5161-47b8-9bf6-d81efe74c8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:57.284699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a307ad-5161-47b8-9bf6-d81efe74c8bf None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:57.284981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a307ad-5161-47b8-9bf6-d81efe74c8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:57.285251 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a307ad-5161-47b8-9bf6-d81efe74c8bf None admin] PATH_INFO: `/v3/projects/4d2811145321472a88df80d4243051cc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:57.286401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a307ad-5161-47b8-9bf6-d81efe74c8bf None admin] RBAC: Authorizing `identity:get_project(project_id=4d2811145321472a88df80d4243051cc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:57.287892 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a307ad-5161-47b8-9bf6-d81efe74c8bf None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:57.289720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 95/189] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:57 2022] GET /identity/v3/projects/4d2811145321472a88df80d4243051cc => generated 312 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:57.291302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf386c1-64c1-4110-9c53-0d69bb7d8aa7 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:57.291851 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf386c1-64c1-4110-9c53-0d69bb7d8aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:57.292122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf386c1-64c1-4110-9c53-0d69bb7d8aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:57.310546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-fdf386c1-64c1-4110-9c53-0d69bb7d8aa7 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:57.311779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-fdf386c1-64c1-4110-9c53-0d69bb7d8aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:57.326470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:57.332945 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a1104-af46-4a74-93dd-209fc3beb21b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:57.334415 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a1104-af46-4a74-93dd-209fc3beb21b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:57.377980 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 96/190] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:57.378872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf386c1-64c1-4110-9c53-0d69bb7d8aa7 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:57.463431 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 95/191] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:40:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:40:57.464933 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c7f0a-a6d6-4673-baef-7f15730310d3 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:57.465221 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c7f0a-a6d6-4673-baef-7f15730310d3 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:57.465499 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c7f0a-a6d6-4673-baef-7f15730310d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:57.477220 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:57.483176 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-480c7f0a-a6d6-4673-baef-7f15730310d3 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:57.483999 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf386c1-64c1-4110-9c53-0d69bb7d8aa7 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:57.485713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-480c7f0a-a6d6-4673-baef-7f15730310d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:57.518481 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3515b-4468-48ff-a377-2245c9d9394e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:57.519132 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3515b-4468-48ff-a377-2245c9d9394e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:57.519418 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3515b-4468-48ff-a377-2245c9d9394e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:57.519703 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3515b-4468-48ff-a377-2245c9d9394e None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:57.520418 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3515b-4468-48ff-a377-2245c9d9394e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:57.520728 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3515b-4468-48ff-a377-2245c9d9394e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:57.522098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3515b-4468-48ff-a377-2245c9d9394e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:57.530850 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 97/192] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:40:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:57.530850 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3515b-4468-48ff-a377-2245c9d9394e None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:57.553494 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 96/193] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:40:57.554406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c7f0a-a6d6-4673-baef-7f15730310d3 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:57.581137 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:57.632730 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3515b-4468-48ff-a377-2245c9d9394e None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:57.652832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c7f0a-a6d6-4673-baef-7f15730310d3 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:57.665919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb354673-0ae0-4ece-abd2-49f3eb737100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:57.666816 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb354673-0ae0-4ece-abd2-49f3eb737100 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:57.667107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb354673-0ae0-4ece-abd2-49f3eb737100 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:57.667424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb354673-0ae0-4ece-abd2-49f3eb737100 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:57.668214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb354673-0ae0-4ece-abd2-49f3eb737100 None admin] RBAC: Adding query filter params (role.id=26c9fe6916a4412d96492e41ff62cca6, scope.project.id=4d2811145321472a88df80d4243051cc, user.id=c428456e9e294402b87552a9b190d23b) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:57.668526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb354673-0ae0-4ece-abd2-49f3eb737100 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:57.669971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb354673-0ae0-4ece-abd2-49f3eb737100 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:57.675679 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 98/194] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:40:57 2022] GET /identity/v3/role_assignments?user.id=c428456e9e294402b87552a9b190d23b&scope.project.id=4d2811145321472a88df80d4243051cc&role.id=26c9fe6916a4412d96492e41ff62cca6 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:57.679672 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb354673-0ae0-4ece-abd2-49f3eb737100 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:57.687991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45602f1a-db07-4ab7-a258-8aa1924e0d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:57.688661 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45602f1a-db07-4ab7-a258-8aa1924e0d44 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:57.688950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45602f1a-db07-4ab7-a258-8aa1924e0d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:57.689228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45602f1a-db07-4ab7-a258-8aa1924e0d44 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:57.702243 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45602f1a-db07-4ab7-a258-8aa1924e0d44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:57.707523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-45602f1a-db07-4ab7-a258-8aa1924e0d44 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:40:57.707523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:57.707523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:57.707523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:57.707523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:57.707523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:57.707523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:57.707523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:57.707523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:57.707523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:57.707523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:57.707523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:57.707523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:57.707523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:57.707523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:57.707523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:57.708500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:57.708500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:57.708500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:57.708500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:57.708500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:57.708500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:57.708500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:57.708500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:57.708500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:57.708500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:57.708500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:57.708500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:57.708500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:57.708500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:57.708500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:57.708500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:57.709266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:57.709266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:57.709266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:57.709266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:57.709266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:57.709266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:57.709266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:57.709266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:57.709266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:57.709266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:57.709266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:40:57.709266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:40:57.709872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:57.709940 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 97/195] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:40:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:57.709940 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45602f1a-db07-4ab7-a258-8aa1924e0d44 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:57.801686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb354673-0ae0-4ece-abd2-49f3eb737100 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:57.806895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:57.824792 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45602f1a-db07-4ab7-a258-8aa1924e0d44 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:57.842906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1c4cd-3911-4da6-bd13-fefeeb88ea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:57.843566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1c4cd-3911-4da6-bd13-fefeeb88ea4d None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:57.843852 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1c4cd-3911-4da6-bd13-fefeeb88ea4d None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:57.844129 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1c4cd-3911-4da6-bd13-fefeeb88ea4d None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:57.845325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1c4cd-3911-4da6-bd13-fefeeb88ea4d None admin] RBAC: Authorizing `identity:get_project(project_id=eec5a65c35a046b4b2021380c24c36ab)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:57.846838 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1c4cd-3911-4da6-bd13-fefeeb88ea4d None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:57.853577 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 99/196] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:57 2022] GET /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:57.853577 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1c4cd-3911-4da6-bd13-fefeeb88ea4d None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:57.862632 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea0511-c003-40ee-8fd1-f381726fd218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:57.863312 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea0511-c003-40ee-8fd1-f381726fd218 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:57.863601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea0511-c003-40ee-8fd1-f381726fd218 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:57.863883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea0511-c003-40ee-8fd1-f381726fd218 None admin] PATH_INFO: `/v3/users/b8e1bab3be2c40f7a2dc3f7152c72fca` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:57.865090 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea0511-c003-40ee-8fd1-f381726fd218 None admin] RBAC: Authorizing `identity:get_user(user_id=b8e1bab3be2c40f7a2dc3f7152c72fca)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:57.866571 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea0511-c003-40ee-8fd1-f381726fd218 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:57.868801 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 98/197] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:57 2022] GET /identity/v3/users/b8e1bab3be2c40f7a2dc3f7152c72fca => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:57.874993 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea0511-c003-40ee-8fd1-f381726fd218 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:57.947485 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:57.959263 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1c4cd-3911-4da6-bd13-fefeeb88ea4d None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:57.979633 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea0511-c003-40ee-8fd1-f381726fd218 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:57.992253 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78335ec-4b4e-405c-b564-71999bd00280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:57.993682 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78335ec-4b4e-405c-b564-71999bd00280 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:57.994228 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78335ec-4b4e-405c-b564-71999bd00280 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:57.994903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78335ec-4b4e-405c-b564-71999bd00280 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:57.996067 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78335ec-4b4e-405c-b564-71999bd00280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:57.997522 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78335ec-4b4e-405c-b564-71999bd00280 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:57.999157 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 100/198] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:40:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:57.999919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78335ec-4b4e-405c-b564-71999bd00280 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:58.014909 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc7046-f54c-4a3b-b32a-3f57618d35da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:58.015541 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc7046-f54c-4a3b-b32a-3f57618d35da None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:58.015824 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc7046-f54c-4a3b-b32a-3f57618d35da None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:58.016213 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc7046-f54c-4a3b-b32a-3f57618d35da None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:58.016823 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc7046-f54c-4a3b-b32a-3f57618d35da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:58.017135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc7046-f54c-4a3b-b32a-3f57618d35da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:58.018561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc7046-f54c-4a3b-b32a-3f57618d35da None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:58.026644 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 99/199] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:40:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:58.027453 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc7046-f54c-4a3b-b32a-3f57618d35da None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:58.047866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:58.098580 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78335ec-4b4e-405c-b564-71999bd00280 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:58.129963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc7046-f54c-4a3b-b32a-3f57618d35da None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:58.132246 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a17c7-84eb-4bde-92d1-a08c82e2a18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:58.132867 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a17c7-84eb-4bde-92d1-a08c82e2a18a None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:58.133151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a17c7-84eb-4bde-92d1-a08c82e2a18a None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:58.133430 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a17c7-84eb-4bde-92d1-a08c82e2a18a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:58.134250 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a17c7-84eb-4bde-92d1-a08c82e2a18a None admin] RBAC: Adding query filter params (role.id=a6d209169b77456f9f1cc3ff53646cfc, scope.project.id=eec5a65c35a046b4b2021380c24c36ab, user.id=26e47e146f0f4358a3c05f9f13c44a62) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:58.134567 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a17c7-84eb-4bde-92d1-a08c82e2a18a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:58.136037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a17c7-84eb-4bde-92d1-a08c82e2a18a None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:58.141614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 101/200] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:40:57 2022] GET /identity/v3/role_assignments?user.id=26e47e146f0f4358a3c05f9f13c44a62&scope.project.id=eec5a65c35a046b4b2021380c24c36ab&role.id=a6d209169b77456f9f1cc3ff53646cfc => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:58.142225 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a17c7-84eb-4bde-92d1-a08c82e2a18a None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:58.170332 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc57b7f-36cd-4d80-aebd-8a9515322234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:58.171093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc57b7f-36cd-4d80-aebd-8a9515322234 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:58.171448 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc57b7f-36cd-4d80-aebd-8a9515322234 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:58.171792 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc57b7f-36cd-4d80-aebd-8a9515322234 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:58.172881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:58.256112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc57b7f-36cd-4d80-aebd-8a9515322234 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:58.258661 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc57b7f-36cd-4d80-aebd-8a9515322234 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:58.260276 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a17c7-84eb-4bde-92d1-a08c82e2a18a None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:58.281044 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:58.301796 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f830733-05f0-4245-9847-6ab3d0824f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:58.302436 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f830733-05f0-4245-9847-6ab3d0824f54 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:58.302718 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f830733-05f0-4245-9847-6ab3d0824f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:58.303026 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f830733-05f0-4245-9847-6ab3d0824f54 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:58.303730 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f830733-05f0-4245-9847-6ab3d0824f54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:58.305279 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f830733-05f0-4245-9847-6ab3d0824f54 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:58.367958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 100/201] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:40:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:40:58.369503 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc57b7f-36cd-4d80-aebd-8a9515322234 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:58.375929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 102/202] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 3 12:40:58 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:40:58.376981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f830733-05f0-4245-9847-6ab3d0824f54 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:58.499908 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:58.509555 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc57b7f-36cd-4d80-aebd-8a9515322234 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:58.511665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f830733-05f0-4245-9847-6ab3d0824f54 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:58.528437 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:58.550516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934ba78-3642-4560-beaf-921a2fea1748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:58.551016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50543b-f32b-4a11-8270-9eea643d0930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:58.551201 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934ba78-3642-4560-beaf-921a2fea1748 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:58.551484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934ba78-3642-4560-beaf-921a2fea1748 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:58.551672 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50543b-f32b-4a11-8270-9eea643d0930 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:58.551759 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934ba78-3642-4560-beaf-921a2fea1748 None admin] PATH_INFO: `/v3/users/26e47e146f0f4358a3c05f9f13c44a62` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:58.551962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50543b-f32b-4a11-8270-9eea643d0930 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:58.552310 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50543b-f32b-4a11-8270-9eea643d0930 None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:58.553028 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934ba78-3642-4560-beaf-921a2fea1748 None admin] RBAC: Authorizing `identity:get_user(user_id=26e47e146f0f4358a3c05f9f13c44a62)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:58.553596 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50543b-f32b-4a11-8270-9eea643d0930 None admin] RBAC: Authorizing `identity:get_project(project_id=d6b0a8a1377b4435987dffefaad3e6d7)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:58.554486 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934ba78-3642-4560-beaf-921a2fea1748 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:58.555150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50543b-f32b-4a11-8270-9eea643d0930 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:58.556428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 101/203] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:58 2022] GET /identity/v3/users/26e47e146f0f4358a3c05f9f13c44a62 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:58.557006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 103/204] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:58 2022] GET /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:58.561814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934ba78-3642-4560-beaf-921a2fea1748 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:58.563488 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50543b-f32b-4a11-8270-9eea643d0930 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:58.685310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934ba78-3642-4560-beaf-921a2fea1748 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:58.694316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50543b-f32b-4a11-8270-9eea643d0930 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:58.725231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9bd2b-729f-458d-8565-faf62a7b9079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:58.726105 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9bd2b-729f-458d-8565-faf62a7b9079 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:58.726393 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9bd2b-729f-458d-8565-faf62a7b9079 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:58.726676 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9bd2b-729f-458d-8565-faf62a7b9079 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:58.736293 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac19e1-6d9c-4b53-a16c-afef7921c7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:58.737117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac19e1-6d9c-4b53-a16c-afef7921c7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:58.737990 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac19e1-6d9c-4b53-a16c-afef7921c7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:58.738438 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac19e1-6d9c-4b53-a16c-afef7921c7e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:58.739815 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac19e1-6d9c-4b53-a16c-afef7921c7e5 None admin] RBAC: Adding query filter params (role.id=a68c1386e9434ef9b5aff7d46f61c2b4, scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7, user.id=b8e1bab3be2c40f7a2dc3f7152c72fca) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:58.740285 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac19e1-6d9c-4b53-a16c-afef7921c7e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:58.742244 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac19e1-6d9c-4b53-a16c-afef7921c7e5 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:58.750855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 104/205] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:40:58 2022] GET /identity/v3/role_assignments?user.id=b8e1bab3be2c40f7a2dc3f7152c72fca&scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7&role.id=a68c1386e9434ef9b5aff7d46f61c2b4 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:58.796335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:58.814141 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9bd2b-729f-458d-8565-faf62a7b9079 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:58.815811 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9bd2b-729f-458d-8565-faf62a7b9079 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:58.937041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 102/206] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:40:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 12:40:58.942583 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac19e1-6d9c-4b53-a16c-afef7921c7e5 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:58.955745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:59.054289 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac19e1-6d9c-4b53-a16c-afef7921c7e5 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:59.094664 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfea8a1-079f-4633-99b0-b7e642fcf32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:59.095357 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfea8a1-079f-4633-99b0-b7e642fcf32c None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:59.095697 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfea8a1-079f-4633-99b0-b7e642fcf32c None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:59.095984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfea8a1-079f-4633-99b0-b7e642fcf32c None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:59.098677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfea8a1-079f-4633-99b0-b7e642fcf32c None admin] RBAC: Authorizing `identity:get_project(project_id=eec5a65c35a046b4b2021380c24c36ab)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:59.100220 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfea8a1-079f-4633-99b0-b7e642fcf32c None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:59.102136 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 105/207] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:58 2022] GET /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:59.108123 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9bd2b-729f-458d-8565-faf62a7b9079 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:59.204922 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:59.223376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9bd2b-729f-458d-8565-faf62a7b9079 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:59.261743 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29901e-3ae4-418b-9ee0-cfb8c9aac53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:59.262413 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29901e-3ae4-418b-9ee0-cfb8c9aac53b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:59.262649 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29901e-3ae4-418b-9ee0-cfb8c9aac53b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:59.263061 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29901e-3ae4-418b-9ee0-cfb8c9aac53b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:59.263772 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29901e-3ae4-418b-9ee0-cfb8c9aac53b None admin] RBAC: Adding query filter params (role.id=e39a3afcb14442a08e9a24b8a56d17cf, scope.project.id=eec5a65c35a046b4b2021380c24c36ab, user.id=26e47e146f0f4358a3c05f9f13c44a62) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:59.264080 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29901e-3ae4-418b-9ee0-cfb8c9aac53b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:59.265535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29901e-3ae4-418b-9ee0-cfb8c9aac53b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:59.277579 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 103/208] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:40:59 2022] GET /identity/v3/role_assignments?user.id=26e47e146f0f4358a3c05f9f13c44a62&scope.project.id=eec5a65c35a046b4b2021380c24c36ab&role.id=e39a3afcb14442a08e9a24b8a56d17cf => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:00.258303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26665d-1b0b-44b9-9368-787548b736b2 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:00.258860 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26665d-1b0b-44b9-9368-787548b736b2 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:00.258932 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26665d-1b0b-44b9-9368-787548b736b2 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:00.260297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 106/209] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:00.265680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeb2d2-b599-456a-83a6-fb508de7a9f9 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:00.266090 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeb2d2-b599-456a-83a6-fb508de7a9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:00.266255 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeb2d2-b599-456a-83a6-fb508de7a9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:00.285108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-b9aeb2d2-b599-456a-83a6-fb508de7a9f9 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:00.286314 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b9aeb2d2-b599-456a-83a6-fb508de7a9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:00.357367 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 104/210] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:00.380467 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26665d-1b0b-44b9-9368-787548b736b2 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:00.468883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:00.493962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26665d-1b0b-44b9-9368-787548b736b2 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:00.531824 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2027b6-ade6-49d4-a0a9-7fcb17ed82a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:00.532819 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2027b6-ade6-49d4-a0a9-7fcb17ed82a5 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:00.533295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2027b6-ade6-49d4-a0a9-7fcb17ed82a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:00.533785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2027b6-ade6-49d4-a0a9-7fcb17ed82a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:00.544905 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2027b6-ade6-49d4-a0a9-7fcb17ed82a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:00.550017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-4c2027b6-ade6-49d4-a0a9-7fcb17ed82a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:41:00.550017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:00.550017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:00.550017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:00.550017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:00.550017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:00.550017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:00.550017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:00.550017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:00.550017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:00.550017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:00.550017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:00.550017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:00.550017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:00.550017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:00.550017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:00.550880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:00.550880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:00.550880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:00.550880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:00.550880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:00.550880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:00.550880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:00.550880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:00.550880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:00.550880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:00.550880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:00.550880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:00.550880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:00.550880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:00.550880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:00.550880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:00.551631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:00.551631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:00.551631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:00.551631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:00.551631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:00.551631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:00.551631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:00.551631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:00.551631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:00.551631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:00.551631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:41:00.551631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:00.553889 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 107/211] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:41:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:00.559731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aeb2d2-b599-456a-83a6-fb508de7a9f9 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:00.659127 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:00.668380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aeb2d2-b599-456a-83a6-fb508de7a9f9 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:00.678022 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10b92a-3fa1-415e-ab6f-87a1b9c80734 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:00.678311 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10b92a-3fa1-415e-ab6f-87a1b9c80734 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:00.678595 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10b92a-3fa1-415e-ab6f-87a1b9c80734 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:00.680122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 108/212] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:41:00.685416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11e1a5-21a6-4b09-b53b-9256655e3794 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:00.685708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11e1a5-21a6-4b09-b53b-9256655e3794 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:00.685988 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11e1a5-21a6-4b09-b53b-9256655e3794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:00.706396 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-3e11e1a5-21a6-4b09-b53b-9256655e3794 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:00.707641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-3e11e1a5-21a6-4b09-b53b-9256655e3794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:00.709689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5515de-3ca7-4eda-a5e2-59707499371c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:00.710473 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5515de-3ca7-4eda-a5e2-59707499371c None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:00.710950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5515de-3ca7-4eda-a5e2-59707499371c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:00.711386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5515de-3ca7-4eda-a5e2-59707499371c None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:00.712289 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5515de-3ca7-4eda-a5e2-59707499371c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:00.712737 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5515de-3ca7-4eda-a5e2-59707499371c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:00.714274 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5515de-3ca7-4eda-a5e2-59707499371c None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:00.723072 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 105/213] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:00.728536 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5515de-3ca7-4eda-a5e2-59707499371c None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:00.784376 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 109/214] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:41:00.809251 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11e1a5-21a6-4b09-b53b-9256655e3794 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:00.849495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5515de-3ca7-4eda-a5e2-59707499371c None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:00.885516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b15c3-acdc-40ec-8fcb-c3fc9207f22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:00.886615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b15c3-acdc-40ec-8fcb-c3fc9207f22b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:00.887141 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b15c3-acdc-40ec-8fcb-c3fc9207f22b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:00.887612 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b15c3-acdc-40ec-8fcb-c3fc9207f22b None admin] PATH_INFO: `/v3/users/26e47e146f0f4358a3c05f9f13c44a62` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:00.889012 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b15c3-acdc-40ec-8fcb-c3fc9207f22b None admin] RBAC: Authorizing `identity:get_user(user_id=26e47e146f0f4358a3c05f9f13c44a62)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:00.890661 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b15c3-acdc-40ec-8fcb-c3fc9207f22b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:00.892504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 106/215] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:41:00 2022] GET /identity/v3/users/26e47e146f0f4358a3c05f9f13c44a62 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:00.897688 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:00.899479 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b15c3-acdc-40ec-8fcb-c3fc9207f22b None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:00.910619 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:00.937027 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11e1a5-21a6-4b09-b53b-9256655e3794 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:00.977111 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585f720-218b-44fb-b9b9-6ee7b5c9f1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:00.977718 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585f720-218b-44fb-b9b9-6ee7b5c9f1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:00.978007 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585f720-218b-44fb-b9b9-6ee7b5c9f1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:00.978294 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585f720-218b-44fb-b9b9-6ee7b5c9f1d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:00.988777 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585f720-218b-44fb-b9b9-6ee7b5c9f1d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:00.994755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-a585f720-218b-44fb-b9b9-6ee7b5c9f1d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:00.994755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:00.994755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:00.994755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:00.994755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:00.994755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:00.994755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:00.994755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:00.994755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:00.994755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:00.994755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:00.994755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:00.994755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:00.994755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:00.994755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:00.994755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:00.995628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:00.995628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:00.995628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:00.995628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:00.995628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:00.995628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:00.995628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:00.995628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:00.995628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:00.995628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:00.995628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:00.995628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:00.995628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:00.995628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:00.995628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:00.995628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:00.997872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:00.997872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:00.997872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:00.997872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:00.997872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:00.997872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:00.997872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:00.997872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:00.997872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:00.997872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:00.997872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:00.997872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:00.997872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 110/216] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:00.997872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956dfdd-8171-4192-87a9-415b70275a54 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:00.998561 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956dfdd-8171-4192-87a9-415b70275a54 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:00.998561 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956dfdd-8171-4192-87a9-415b70275a54 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:00.999240 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 111/217] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:01.003291 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956dfdd-8171-4192-87a9-415b70275a54 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:01.022252 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b15c3-acdc-40ec-8fcb-c3fc9207f22b None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:01.057684 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63662a-802d-4fb3-bddc-1822abc5a40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:01.058330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63662a-802d-4fb3-bddc-1822abc5a40d None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:01.058617 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63662a-802d-4fb3-bddc-1822abc5a40d None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:01.058941 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63662a-802d-4fb3-bddc-1822abc5a40d None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:01.060114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63662a-802d-4fb3-bddc-1822abc5a40d None admin] RBAC: Authorizing `identity:get_project(project_id=eec5a65c35a046b4b2021380c24c36ab)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:01.061589 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63662a-802d-4fb3-bddc-1822abc5a40d None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:01.063449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 107/218] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:00 2022] GET /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:01.064500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaf097-74d8-4111-960b-7cbb5df44732 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:01.064794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaf097-74d8-4111-960b-7cbb5df44732 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:01.065073 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaf097-74d8-4111-960b-7cbb5df44732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:01.082490 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-4ceaf097-74d8-4111-960b-7cbb5df44732 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:01.083714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-4ceaf097-74d8-4111-960b-7cbb5df44732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:01.125749 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956dfdd-8171-4192-87a9-415b70275a54 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:01.152135 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:01.162913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78dd93-e066-4e3c-bae9-59a372d5237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:01.170334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 108/219] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:01.170459 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78dd93-e066-4e3c-bae9-59a372d5237e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:01.170459 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78dd93-e066-4e3c-bae9-59a372d5237e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:01.170459 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78dd93-e066-4e3c-bae9-59a372d5237e None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:01.170714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceaf097-74d8-4111-960b-7cbb5df44732 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:01.170832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78dd93-e066-4e3c-bae9-59a372d5237e None admin] RBAC: Adding query filter params (name=member) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:01.170832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78dd93-e066-4e3c-bae9-59a372d5237e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:01.170832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78dd93-e066-4e3c-bae9-59a372d5237e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:01.177932 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 112/220] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:41:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:01.183324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:01.183873 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78dd93-e066-4e3c-bae9-59a372d5237e None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:01.286122 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceaf097-74d8-4111-960b-7cbb5df44732 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:01.299107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78dd93-e066-4e3c-bae9-59a372d5237e None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:01.320269 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277b550-6db4-4c71-b5eb-2207e2eccf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:01.321436 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277b550-6db4-4c71-b5eb-2207e2eccf4d None admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:01.321711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277b550-6db4-4c71-b5eb-2207e2eccf4d None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:01.321985 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277b550-6db4-4c71-b5eb-2207e2eccf4d None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab/users/26e47e146f0f4358a3c05f9f13c44a62/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:01.323968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277b550-6db4-4c71-b5eb-2207e2eccf4d None admin] RBAC: Authorizing `identity:create_grant(project_id=eec5a65c35a046b4b2021380c24c36ab, user_id=26e47e146f0f4358a3c05f9f13c44a62, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:01.325413 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277b550-6db4-4c71-b5eb-2207e2eccf4d None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:01.335202 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf42f93-5eae-4dc7-b258-92f04b846166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:01.335849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf42f93-5eae-4dc7-b258-92f04b846166 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:01.336132 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf42f93-5eae-4dc7-b258-92f04b846166 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:01.339087 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf42f93-5eae-4dc7-b258-92f04b846166 None admin] PATH_INFO: `/v3/users/49752d76f1d7461c888eee35a2fbc1e2` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:01.350219 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf42f93-5eae-4dc7-b258-92f04b846166 None admin] RBAC: Authorizing `identity:get_user(user_id=49752d76f1d7461c888eee35a2fbc1e2)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:01.351833 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf42f93-5eae-4dc7-b258-92f04b846166 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:01.353478 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 113/221] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:41:01 2022] GET /identity/v3/users/49752d76f1d7461c888eee35a2fbc1e2 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:01.354227 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf42f93-5eae-4dc7-b258-92f04b846166 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:01.393664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 109/222] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:41:01 2022] PUT /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab/users/26e47e146f0f4358a3c05f9f13c44a62/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:41:01.395007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61842bed-30a1-410e-b83a-da88c68fbe85 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:01.395301 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61842bed-30a1-410e-b83a-da88c68fbe85 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:01.395585 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61842bed-30a1-410e-b83a-da88c68fbe85 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:01.396869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 110/223] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:01.400876 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61842bed-30a1-410e-b83a-da88c68fbe85 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:01.403633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:01.464685 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf42f93-5eae-4dc7-b258-92f04b846166 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:01.484934 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:01.504810 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf00bfc-62a3-4109-83fa-ee6f1296c002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:01.505537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf00bfc-62a3-4109-83fa-ee6f1296c002 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:01.506053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf00bfc-62a3-4109-83fa-ee6f1296c002 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:01.506345 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf00bfc-62a3-4109-83fa-ee6f1296c002 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:01.510506 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf00bfc-62a3-4109-83fa-ee6f1296c002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:01.512360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf00bfc-62a3-4109-83fa-ee6f1296c002 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:01.514143 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 114/224] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:01.515646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d879d5-a72f-48da-ab60-dd64bc6ab434 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:01.515947 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d879d5-a72f-48da-ab60-dd64bc6ab434 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:01.516218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d879d5-a72f-48da-ab60-dd64bc6ab434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:01.529332 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61842bed-30a1-410e-b83a-da88c68fbe85 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:01.535161 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-97d879d5-a72f-48da-ab60-dd64bc6ab434 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:01.545030 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-97d879d5-a72f-48da-ab60-dd64bc6ab434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:01.571859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3561d-b959-427d-9795-2267dfdcdef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:01.572496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3561d-b959-427d-9795-2267dfdcdef2 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:01.572785 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3561d-b959-427d-9795-2267dfdcdef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:01.573069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3561d-b959-427d-9795-2267dfdcdef2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:01.614416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 115/225] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:01.623857 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d879d5-a72f-48da-ab60-dd64bc6ab434 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:01.642305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3561d-b959-427d-9795-2267dfdcdef2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:01.643812 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3561d-b959-427d-9795-2267dfdcdef2 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:01.674778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:01.712885 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:01.732739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d879d5-a72f-48da-ab60-dd64bc6ab434 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:01.757448 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 111/226] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:01.758220 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3561d-b959-427d-9795-2267dfdcdef2 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:01.773362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9b922-bc6b-4b47-8670-23ad3ab7486c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:01.774022 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9b922-bc6b-4b47-8670-23ad3ab7486c None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:01.774441 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9b922-bc6b-4b47-8670-23ad3ab7486c None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:01.774725 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9b922-bc6b-4b47-8670-23ad3ab7486c None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:01.775446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9b922-bc6b-4b47-8670-23ad3ab7486c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:01.776903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9b922-bc6b-4b47-8670-23ad3ab7486c None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:01.862041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3561d-b959-427d-9795-2267dfdcdef2 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:01.884451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 116/227] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 3 12:41:01 2022] POST /identity/v3/users => generated 297 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:41:01.885544 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9b922-bc6b-4b47-8670-23ad3ab7486c None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:01.911658 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dad71e-2376-4534-add6-b17bd84d2f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:01.912878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dad71e-2376-4534-add6-b17bd84d2f71 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:01.913178 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dad71e-2376-4534-add6-b17bd84d2f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:01.913464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dad71e-2376-4534-add6-b17bd84d2f71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:01.931497 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dad71e-2376-4534-add6-b17bd84d2f71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:01.937943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-e9dad71e-2376-4534-add6-b17bd84d2f71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:41:01.937943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:01.937943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:01.937943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:01.937943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:01.937943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:01.937943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:01.937943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:01.937943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:01.937943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:01.937943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:01.937943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:01.937943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:01.937943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:01.937943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:01.937943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:01.938968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:01.938968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:01.938968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:01.938968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:01.938968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:01.938968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:01.938968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:01.938968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:01.938968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:01.938968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:01.938968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:01.938968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:01.938968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:01.938968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:01.938968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:01.938968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:01.939762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:01.939762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:01.939762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:01.939762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:01.939762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:01.939762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:01.939762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:01.939762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:01.939762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:01.939762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:01.939762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:41:01.939762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:01.940351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 112/228] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:41:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:01.946238 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dad71e-2376-4534-add6-b17bd84d2f71 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:01.978778 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:02.026975 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:02.029436 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9b922-bc6b-4b47-8670-23ad3ab7486c None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:02.073740 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff583d8-6cf4-4901-ace8-7ade2123b3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:02.074417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dad71e-2376-4534-add6-b17bd84d2f71 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:02.074552 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff583d8-6cf4-4901-ace8-7ade2123b3ad None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:02.074708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff583d8-6cf4-4901-ace8-7ade2123b3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:02.075054 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff583d8-6cf4-4901-ace8-7ade2123b3ad None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:02.076556 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff583d8-6cf4-4901-ace8-7ade2123b3ad None admin] RBAC: Authorizing `identity:get_project(project_id=eec5a65c35a046b4b2021380c24c36ab)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:02.078660 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff583d8-6cf4-4901-ace8-7ade2123b3ad None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:02.080850 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 117/229] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:01 2022] GET /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:02.088272 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff583d8-6cf4-4901-ace8-7ade2123b3ad None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:02.125132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c5480-3fa8-4525-ad58-88936144c760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:02.126473 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c5480-3fa8-4525-ad58-88936144c760 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:02.126816 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c5480-3fa8-4525-ad58-88936144c760 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:02.127407 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c5480-3fa8-4525-ad58-88936144c760 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:02.128157 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c5480-3fa8-4525-ad58-88936144c760 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:02.128486 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c5480-3fa8-4525-ad58-88936144c760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:02.130886 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c5480-3fa8-4525-ad58-88936144c760 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:02.142863 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 113/230] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:02.150594 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c5480-3fa8-4525-ad58-88936144c760 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:02.228006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff583d8-6cf4-4901-ace8-7ade2123b3ad None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:02.265329 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:02.279223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81391ac-3355-4ee4-8613-b0f946491820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:02.282152 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81391ac-3355-4ee4-8613-b0f946491820 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:02.282252 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c5480-3fa8-4525-ad58-88936144c760 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:02.282327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81391ac-3355-4ee4-8613-b0f946491820 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:02.282327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81391ac-3355-4ee4-8613-b0f946491820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:02.282327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81391ac-3355-4ee4-8613-b0f946491820 None admin] RBAC: Adding query filter params (role.id=26c9fe6916a4412d96492e41ff62cca6, scope.project.id=eec5a65c35a046b4b2021380c24c36ab, user.id=49752d76f1d7461c888eee35a2fbc1e2) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:02.282327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81391ac-3355-4ee4-8613-b0f946491820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:02.284623 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81391ac-3355-4ee4-8613-b0f946491820 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:02.292475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 118/231] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:41:02 2022] GET /identity/v3/role_assignments?user.id=49752d76f1d7461c888eee35a2fbc1e2&scope.project.id=eec5a65c35a046b4b2021380c24c36ab&role.id=26c9fe6916a4412d96492e41ff62cca6 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:02.323763 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18703dc4-07d9-44cd-85d4-b8e29d42affd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:02.325184 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18703dc4-07d9-44cd-85d4-b8e29d42affd None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:02.325686 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18703dc4-07d9-44cd-85d4-b8e29d42affd None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:02.326154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18703dc4-07d9-44cd-85d4-b8e29d42affd None admin] PATH_INFO: `/v3/users/26e47e146f0f4358a3c05f9f13c44a62` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:02.327763 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18703dc4-07d9-44cd-85d4-b8e29d42affd None admin] RBAC: Authorizing `identity:get_user(user_id=26e47e146f0f4358a3c05f9f13c44a62)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:02.329539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18703dc4-07d9-44cd-85d4-b8e29d42affd None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:02.331533 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 114/232] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:41:02 2022] GET /identity/v3/users/26e47e146f0f4358a3c05f9f13c44a62 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:02.337518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81391ac-3355-4ee4-8613-b0f946491820 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:02.386022 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:02.460207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81391ac-3355-4ee4-8613-b0f946491820 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:02.496640 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cd9b5-3f9a-430d-bbe1-4e72f07cf8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:02.497298 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cd9b5-3f9a-430d-bbe1-4e72f07cf8ad None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:02.497585 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cd9b5-3f9a-430d-bbe1-4e72f07cf8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:02.497866 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cd9b5-3f9a-430d-bbe1-4e72f07cf8ad None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:02.499084 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6cd9b5-3f9a-430d-bbe1-4e72f07cf8ad None admin] RBAC: Authorizing `identity:get_project(project_id=eec5a65c35a046b4b2021380c24c36ab)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:02.500528 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6cd9b5-3f9a-430d-bbe1-4e72f07cf8ad None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:02.502506 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 119/233] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:02 2022] GET /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:02.508069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18703dc4-07d9-44cd-85d4-b8e29d42affd None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:02.648909 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18703dc4-07d9-44cd-85d4-b8e29d42affd None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:02.693109 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d5d2d-79e0-4828-a5cd-ba8782f582e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:02.694024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d5d2d-79e0-4828-a5cd-ba8782f582e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:02.694466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d5d2d-79e0-4828-a5cd-ba8782f582e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:02.694918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d5d2d-79e0-4828-a5cd-ba8782f582e9 None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab/users/26e47e146f0f4358a3c05f9f13c44a62/roles/e39a3afcb14442a08e9a24b8a56d17cf` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:02.703263 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d5d2d-79e0-4828-a5cd-ba8782f582e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=eec5a65c35a046b4b2021380c24c36ab, user_id=26e47e146f0f4358a3c05f9f13c44a62, role_id=e39a3afcb14442a08e9a24b8a56d17cf)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:02.704868 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d5d2d-79e0-4828-a5cd-ba8782f582e9 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:02.822296 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 115/234] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:41:02 2022] PUT /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab/users/26e47e146f0f4358a3c05f9f13c44a62/roles/e39a3afcb14442a08e9a24b8a56d17cf => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:41:03.654976 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0483fe-abdf-4d4a-a879-1b662f2e188b None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:03.655508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0483fe-abdf-4d4a-a879-1b662f2e188b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:03.655508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0483fe-abdf-4d4a-a879-1b662f2e188b None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:03.657010 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 120/235] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:03.662141 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378e059-b4c1-4269-b34c-f1c81254699c None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:03.662586 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378e059-b4c1-4269-b34c-f1c81254699c None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:03.662808 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378e059-b4c1-4269-b34c-f1c81254699c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:03.681850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-8378e059-b4c1-4269-b34c-f1c81254699c None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:03.683065 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-8378e059-b4c1-4269-b34c-f1c81254699c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:03.695380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:03.755194 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 116/236] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:03.778233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0483fe-abdf-4d4a-a879-1b662f2e188b None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:03.900866 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:03.907408 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0483fe-abdf-4d4a-a879-1b662f2e188b None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:03.945042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982c864-715f-4d8e-9544-f7d09c7ad8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:03.945700 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982c864-715f-4d8e-9544-f7d09c7ad8fe None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:03.946020 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982c864-715f-4d8e-9544-f7d09c7ad8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:03.946301 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982c864-715f-4d8e-9544-f7d09c7ad8fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:03.960688 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982c864-715f-4d8e-9544-f7d09c7ad8fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:03.966335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-5982c864-715f-4d8e-9544-f7d09c7ad8fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:41:03.966335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:03.966335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:03.966335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:03.966335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:03.966335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:03.966335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:03.966335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:03.966335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:03.966335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:03.966335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:03.966335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:03.966335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:03.966335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:03.966335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:03.966335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:03.967241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:03.967241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:03.967241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:03.967241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:03.967241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:03.967241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:03.967241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:03.967241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:03.967241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:03.967241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:03.967241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:03.967241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:03.967241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:03.967241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:03.967241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:03.967241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:03.968001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:03.968001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:03.968001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:03.968001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:03.968001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:03.968001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:03.968001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:03.968001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:03.968001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:03.968001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:03.968001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:41:03.968001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:03.968001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 121/237] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:41:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:03.974588 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378e059-b4c1-4269-b34c-f1c81254699c None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:04.092877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378e059-b4c1-4269-b34c-f1c81254699c None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:04.138975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b8a10-9741-49f5-b020-55b864df612d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:04.139609 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b8a10-9741-49f5-b020-55b864df612d None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:04.139901 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b8a10-9741-49f5-b020-55b864df612d None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:04.140184 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b8a10-9741-49f5-b020-55b864df612d None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:04.143265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b8a10-9741-49f5-b020-55b864df612d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:04.143265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b8a10-9741-49f5-b020-55b864df612d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:04.143265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b8a10-9741-49f5-b020-55b864df612d None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:04.154863 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 117/238] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:04.160419 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982c864-715f-4d8e-9544-f7d09c7ad8fe None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:04.312738 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982c864-715f-4d8e-9544-f7d09c7ad8fe None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:04.363873 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe124a16-694d-4e14-8c2e-d2a46bf4ea52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:04.364871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe124a16-694d-4e14-8c2e-d2a46bf4ea52 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:04.365383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe124a16-694d-4e14-8c2e-d2a46bf4ea52 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:04.365856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe124a16-694d-4e14-8c2e-d2a46bf4ea52 None admin] PATH_INFO: `/v3/users/26e47e146f0f4358a3c05f9f13c44a62` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:04.367264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe124a16-694d-4e14-8c2e-d2a46bf4ea52 None admin] RBAC: Authorizing `identity:get_user(user_id=26e47e146f0f4358a3c05f9f13c44a62)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:04.368945 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe124a16-694d-4e14-8c2e-d2a46bf4ea52 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:04.371064 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 122/239] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:41:04 2022] GET /identity/v3/users/26e47e146f0f4358a3c05f9f13c44a62 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:04.376460 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b8a10-9741-49f5-b020-55b864df612d None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:04.406612 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:04.521103 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b8a10-9741-49f5-b020-55b864df612d None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:04.568793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319b451-d1d2-49cd-95b2-a6f4ff79560a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:04.569799 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319b451-d1d2-49cd-95b2-a6f4ff79560a None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:04.570297 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319b451-d1d2-49cd-95b2-a6f4ff79560a None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:04.571365 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319b451-d1d2-49cd-95b2-a6f4ff79560a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:04.667623 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d82e7-889e-4c02-adcc-c019ccac0e1c None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:04.668254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319b451-d1d2-49cd-95b2-a6f4ff79560a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:04.668999 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d82e7-889e-4c02-adcc-c019ccac0e1c None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:04.669519 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d82e7-889e-4c02-adcc-c019ccac0e1c None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:04.669779 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319b451-d1d2-49cd-95b2-a6f4ff79560a None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:04.671286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 123/240] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:41:04.676678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818567e7-eded-4617-8d21-773df6565124 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:04.677218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818567e7-eded-4617-8d21-773df6565124 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:04.677729 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818567e7-eded-4617-8d21-773df6565124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:04.681872 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:04.711201 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-818567e7-eded-4617-8d21-773df6565124 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:04.712439 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-818567e7-eded-4617-8d21-773df6565124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:04.759141 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:04.825517 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 118/241] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:04.827028 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2372d0-3b5e-42fb-b976-096d6b956c92 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:04.827468 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2372d0-3b5e-42fb-b976-096d6b956c92 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:04.827887 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2372d0-3b5e-42fb-b976-096d6b956c92 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:04.829339 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 119/242] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:04.831083 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 124/243] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:41:04.831676 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2372d0-3b5e-42fb-b976-096d6b956c92 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:04.837498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c777bd-b853-4bbf-99e9-96cb6535c581 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:04.837787 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c777bd-b853-4bbf-99e9-96cb6535c581 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:04.838062 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c777bd-b853-4bbf-99e9-96cb6535c581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:04.871617 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-f9c777bd-b853-4bbf-99e9-96cb6535c581 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:04.872956 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-f9c777bd-b853-4bbf-99e9-96cb6535c581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:04.946621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 125/244] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:04.952020 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c777bd-b853-4bbf-99e9-96cb6535c581 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:04.965511 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2372d0-3b5e-42fb-b976-096d6b956c92 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:04.975642 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:05.001257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875a15b-b9c4-402f-a419-932cd408b2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:05.001898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875a15b-b9c4-402f-a419-932cd408b2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:05.002181 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875a15b-b9c4-402f-a419-932cd408b2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:05.002459 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875a15b-b9c4-402f-a419-932cd408b2f0 None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:05.003647 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875a15b-b9c4-402f-a419-932cd408b2f0 None admin] RBAC: Authorizing `identity:get_project(project_id=eec5a65c35a046b4b2021380c24c36ab)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:05.005283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875a15b-b9c4-402f-a419-932cd408b2f0 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:05.011903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 120/245] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:04 2022] GET /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:05.011903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548f38e-dfe9-49b1-9aa2-99fbb215df4e None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:05.011903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548f38e-dfe9-49b1-9aa2-99fbb215df4e None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:05.011903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548f38e-dfe9-49b1-9aa2-99fbb215df4e None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:05.011903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 121/246] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:05.011903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548f38e-dfe9-49b1-9aa2-99fbb215df4e None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:05.049732 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:05.061993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c777bd-b853-4bbf-99e9-96cb6535c581 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:05.099653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94851911-7c23-4b59-9f97-caef0ef19d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:05.100226 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94851911-7c23-4b59-9f97-caef0ef19d08 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:05.100507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94851911-7c23-4b59-9f97-caef0ef19d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:05.100782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94851911-7c23-4b59-9f97-caef0ef19d08 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:05.112954 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94851911-7c23-4b59-9f97-caef0ef19d08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:05.120720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-94851911-7c23-4b59-9f97-caef0ef19d08 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:41:05.120720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:05.120720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:05.120720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:05.120720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:05.120720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:05.120720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:05.120720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:05.120720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:05.120720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:05.120720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:05.120720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:05.120720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:05.120720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:05.120720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:05.120720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:05.121661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:05.121661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:05.121661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:05.121661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:05.121661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:05.121661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:05.121661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:05.121661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:05.121661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:05.121661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:05.121661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:05.121661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:05.121661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:05.121661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:05.121661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:05.121661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:05.122498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:05.122498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:05.122498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:05.122498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:05.122498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:05.122498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:05.122498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:05.122498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:05.122498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:05.122498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:05.122498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:41:05.122498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:05.122498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 126/247] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:05.123169 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94851911-7c23-4b59-9f97-caef0ef19d08 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:05.128181 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548f38e-dfe9-49b1-9aa2-99fbb215df4e None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:05.168115 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d78a0d-c204-4473-9642-74ca34a95716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:05.168761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d78a0d-c204-4473-9642-74ca34a95716 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:05.169045 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d78a0d-c204-4473-9642-74ca34a95716 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:05.169316 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d78a0d-c204-4473-9642-74ca34a95716 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:05.170447 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d78a0d-c204-4473-9642-74ca34a95716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:05.171927 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d78a0d-c204-4473-9642-74ca34a95716 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:05.173513 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 122/248] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:05.179004 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fd2a1-b434-4be1-a93d-eea8ae4c10fd None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:05.179290 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fd2a1-b434-4be1-a93d-eea8ae4c10fd None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:05.179569 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fd2a1-b434-4be1-a93d-eea8ae4c10fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:05.197650 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-c39fd2a1-b434-4be1-a93d-eea8ae4c10fd None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:05.198852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-c39fd2a1-b434-4be1-a93d-eea8ae4c10fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:05.238463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94851911-7c23-4b59-9f97-caef0ef19d08 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:05.243875 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:05.270953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 123/249] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:05.283098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fd2a1-b434-4be1-a93d-eea8ae4c10fd None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:05.285995 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c905090-d7d8-4b87-add0-5d5f7ff835b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:05.286626 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c905090-d7d8-4b87-add0-5d5f7ff835b0 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:05.286946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c905090-d7d8-4b87-add0-5d5f7ff835b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:05.287223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c905090-d7d8-4b87-add0-5d5f7ff835b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:05.288028 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c905090-d7d8-4b87-add0-5d5f7ff835b0 None admin] RBAC: Adding query filter params (role.id=a6d209169b77456f9f1cc3ff53646cfc, scope.project.id=eec5a65c35a046b4b2021380c24c36ab, user.id=26e47e146f0f4358a3c05f9f13c44a62) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:05.288344 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c905090-d7d8-4b87-add0-5d5f7ff835b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:05.290763 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c905090-d7d8-4b87-add0-5d5f7ff835b0 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:05.297727 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 127/250] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:41:05 2022] GET /identity/v3/role_assignments?user.id=26e47e146f0f4358a3c05f9f13c44a62&scope.project.id=eec5a65c35a046b4b2021380c24c36ab&role.id=a6d209169b77456f9f1cc3ff53646cfc => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:05.298585 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c905090-d7d8-4b87-add0-5d5f7ff835b0 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:05.315108 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:05.404378 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fd2a1-b434-4be1-a93d-eea8ae4c10fd None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:05.415951 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c905090-d7d8-4b87-add0-5d5f7ff835b0 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:05.444365 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354bc042-4985-422a-a067-0a6851d75b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:05.445000 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bc042-4985-422a-a067-0a6851d75b45 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:05.445279 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bc042-4985-422a-a067-0a6851d75b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:05.445565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bc042-4985-422a-a067-0a6851d75b45 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:05.446335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354bc042-4985-422a-a067-0a6851d75b45 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:05.446645 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354bc042-4985-422a-a067-0a6851d75b45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:05.448128 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354bc042-4985-422a-a067-0a6851d75b45 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:05.454634 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d91c26-e9ce-4b3b-84e3-dc77d058ff12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:05.455329 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d91c26-e9ce-4b3b-84e3-dc77d058ff12 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:05.455617 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d91c26-e9ce-4b3b-84e3-dc77d058ff12 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:05.455836 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d91c26-e9ce-4b3b-84e3-dc77d058ff12 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:05.456525 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d91c26-e9ce-4b3b-84e3-dc77d058ff12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:05.457969 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d91c26-e9ce-4b3b-84e3-dc77d058ff12 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:05.458139 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 124/251] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:41:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:05.458985 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354bc042-4985-422a-a067-0a6851d75b45 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:05.497918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:05.534095 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 128/252] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 3 12:41:05 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:41:05.534665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1803ea5-1a24-4ec4-b6f4-981412e7a138 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:05.534988 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1803ea5-1a24-4ec4-b6f4-981412e7a138 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:05.535272 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1803ea5-1a24-4ec4-b6f4-981412e7a138 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:05.536682 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 129/253] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:05.542481 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1803ea5-1a24-4ec4-b6f4-981412e7a138 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:05.575795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354bc042-4985-422a-a067-0a6851d75b45 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:05.619443 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb5975-0e9e-4a0f-97ab-8395796f3f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:05.620112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb5975-0e9e-4a0f-97ab-8395796f3f37 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:05.620883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb5975-0e9e-4a0f-97ab-8395796f3f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:05.620883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb5975-0e9e-4a0f-97ab-8395796f3f37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:05.621741 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:05.633742 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb5975-0e9e-4a0f-97ab-8395796f3f37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:05.638660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-dafb5975-0e9e-4a0f-97ab-8395796f3f37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:05.638660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:05.638660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:05.638660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:05.638660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:05.638660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:05.638660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:05.638660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:05.638660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:05.638660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:05.638660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:05.638660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:05.638660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:05.638660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:05.638660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:05.638660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:05.639625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:05.639625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:05.639625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:05.639625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:05.639625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:05.639625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:05.639625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:05.639625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:05.639625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:05.639625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:05.639625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:05.639625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:05.639625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:05.639625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:05.639625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:05.639625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:05.640398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:05.640398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:05.640398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:05.640398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:05.640398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:05.640398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:05.640398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:05.640398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:05.640398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:05.640398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:05.640398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:05.640398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:05.640398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 125/254] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:05.641574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309cbdd-6b95-4536-a5d9-9f4276a1599c None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:05.641574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309cbdd-6b95-4536-a5d9-9f4276a1599c None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:05.641802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309cbdd-6b95-4536-a5d9-9f4276a1599c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:05.662207 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-7309cbdd-6b95-4536-a5d9-9f4276a1599c None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:05.663479 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-7309cbdd-6b95-4536-a5d9-9f4276a1599c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:05.669706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1803ea5-1a24-4ec4-b6f4-981412e7a138 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:05.713380 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656357a-95c8-48cc-ac84-b8e9cefa3ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:05.714035 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656357a-95c8-48cc-ac84-b8e9cefa3ffe None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:05.714352 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656357a-95c8-48cc-ac84-b8e9cefa3ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:05.714627 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656357a-95c8-48cc-ac84-b8e9cefa3ffe None admin] PATH_INFO: `/v3/users/06c72d4ec2ac4338873d5dd0ef3ab80b` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:05.732162 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656357a-95c8-48cc-ac84-b8e9cefa3ffe None admin] RBAC: Authorizing `identity:get_user(user_id=06c72d4ec2ac4338873d5dd0ef3ab80b)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:05.733665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656357a-95c8-48cc-ac84-b8e9cefa3ffe None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:05.735401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 130/255] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:41:05 2022] GET /identity/v3/users/06c72d4ec2ac4338873d5dd0ef3ab80b => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:05.736258 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656357a-95c8-48cc-ac84-b8e9cefa3ffe None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:05.755424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 126/256] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:05.756814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309cbdd-6b95-4536-a5d9-9f4276a1599c None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:05.785441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:05.871776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656357a-95c8-48cc-ac84-b8e9cefa3ffe None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:05.875248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309cbdd-6b95-4536-a5d9-9f4276a1599c None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:05.902554 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:05.917015 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea5441-0d64-4dca-9b2d-250866fc7a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:05.917015 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea5441-0d64-4dca-9b2d-250866fc7a96 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:05.917247 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea5441-0d64-4dca-9b2d-250866fc7a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:05.917528 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea5441-0d64-4dca-9b2d-250866fc7a96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:05.920286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14ace7-97a7-4c28-8399-6d4453bddc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:05.920902 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14ace7-97a7-4c28-8399-6d4453bddc52 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:05.921179 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14ace7-97a7-4c28-8399-6d4453bddc52 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:05.921558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14ace7-97a7-4c28-8399-6d4453bddc52 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:05.922163 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14ace7-97a7-4c28-8399-6d4453bddc52 None admin] RBAC: Adding query filter params (name=member) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:05.922465 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14ace7-97a7-4c28-8399-6d4453bddc52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:05.923911 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14ace7-97a7-4c28-8399-6d4453bddc52 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:05.933061 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 131/257] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:41:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:05.933838 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14ace7-97a7-4c28-8399-6d4453bddc52 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:06.008982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea5441-0d64-4dca-9b2d-250866fc7a96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:06.010927 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea5441-0d64-4dca-9b2d-250866fc7a96 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:06.042522 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14ace7-97a7-4c28-8399-6d4453bddc52 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:06.047012 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:06.078199 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94a74f-d033-4eef-9d57-9fb14960b54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:06.079198 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94a74f-d033-4eef-9d57-9fb14960b54c None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:06.079482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94a74f-d033-4eef-9d57-9fb14960b54c None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:06.079756 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94a74f-d033-4eef-9d57-9fb14960b54c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:06.092070 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94a74f-d033-4eef-9d57-9fb14960b54c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:06.097962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-ed94a74f-d033-4eef-9d57-9fb14960b54c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:41:06.097962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:06.097962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:06.097962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:06.097962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:06.097962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:06.097962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:06.097962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:06.097962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:06.097962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:06.097962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:06.097962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:06.097962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:06.097962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:06.097962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:06.097962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:06.098862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:06.098862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:06.098862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:06.098862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:06.098862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:06.098862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:06.098862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:06.098862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:06.098862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:06.098862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:06.098862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:06.098862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:06.098862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:06.098862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:06.098862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:06.098862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:06.099646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:06.099646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:06.099646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:06.099646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:06.099646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:06.099646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:06.099646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:06.099646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:06.099646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:06.099646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:06.099646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:41:06.099646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:06.099646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 132/258] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:41:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:06.099646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94a74f-d033-4eef-9d57-9fb14960b54c None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:06.151162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 127/259] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:06.152813 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea5441-0d64-4dca-9b2d-250866fc7a96 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:06.154472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:06.209785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94a74f-d033-4eef-9d57-9fb14960b54c None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:06.258716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a941d-22cc-49dd-a260-0ad7afa52a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:06.259605 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a941d-22cc-49dd-a260-0ad7afa52a00 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:06.259986 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a941d-22cc-49dd-a260-0ad7afa52a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:06.260409 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a941d-22cc-49dd-a260-0ad7afa52a00 None admin] PATH_INFO: `/v3/users/49752d76f1d7461c888eee35a2fbc1e2` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:06.261691 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a941d-22cc-49dd-a260-0ad7afa52a00 None admin] RBAC: Authorizing `identity:get_user(user_id=49752d76f1d7461c888eee35a2fbc1e2)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:06.263373 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a941d-22cc-49dd-a260-0ad7afa52a00 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:06.265394 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 133/260] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:41:06 2022] GET /identity/v3/users/49752d76f1d7461c888eee35a2fbc1e2 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:06.266480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a941d-22cc-49dd-a260-0ad7afa52a00 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:06.276295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea5441-0d64-4dca-9b2d-250866fc7a96 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:06.303608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:06.312820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3417c1a-6a66-402a-8220-8b13db80927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:06.313646 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3417c1a-6a66-402a-8220-8b13db80927a None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:06.314078 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3417c1a-6a66-402a-8220-8b13db80927a None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:06.323311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3417c1a-6a66-402a-8220-8b13db80927a None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:06.323311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3417c1a-6a66-402a-8220-8b13db80927a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:06.323311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3417c1a-6a66-402a-8220-8b13db80927a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:06.323311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3417c1a-6a66-402a-8220-8b13db80927a None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:06.327126 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 128/261] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:06.328150 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3417c1a-6a66-402a-8220-8b13db80927a None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:06.376831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a941d-22cc-49dd-a260-0ad7afa52a00 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:06.396299 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:06.417761 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb41c3-6b68-456c-b7dd-2b9e6f82db03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:06.418406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb41c3-6b68-456c-b7dd-2b9e6f82db03 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:06.418686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb41c3-6b68-456c-b7dd-2b9e6f82db03 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:06.418982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb41c3-6b68-456c-b7dd-2b9e6f82db03 None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:06.421202 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb41c3-6b68-456c-b7dd-2b9e6f82db03 None admin] RBAC: Authorizing `identity:get_project(project_id=eec5a65c35a046b4b2021380c24c36ab)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:06.422688 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb41c3-6b68-456c-b7dd-2b9e6f82db03 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:06.424527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 134/262] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:06 2022] GET /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:06.425114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb41c3-6b68-456c-b7dd-2b9e6f82db03 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:06.442684 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3417c1a-6a66-402a-8220-8b13db80927a None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:06.485654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b425a5-e99a-4ced-83b5-217ae0c64dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:06.486262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b425a5-e99a-4ced-83b5-217ae0c64dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:06.486540 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b425a5-e99a-4ced-83b5-217ae0c64dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:06.486851 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b425a5-e99a-4ced-83b5-217ae0c64dc4 None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:06.488042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b425a5-e99a-4ced-83b5-217ae0c64dc4 None admin] RBAC: Authorizing `identity:get_project(project_id=eec5a65c35a046b4b2021380c24c36ab)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:06.489746 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b425a5-e99a-4ced-83b5-217ae0c64dc4 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:06.491908 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 129/263] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:06 2022] GET /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:06.492565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b425a5-e99a-4ced-83b5-217ae0c64dc4 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:06.560803 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb41c3-6b68-456c-b7dd-2b9e6f82db03 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:06.565604 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:06.597751 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a3cd2-718d-4a84-a6e0-6703c261252e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:06.598416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a3cd2-718d-4a84-a6e0-6703c261252e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:06.598701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a3cd2-718d-4a84-a6e0-6703c261252e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:06.599034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a3cd2-718d-4a84-a6e0-6703c261252e None admin] PATH_INFO: `/v3/users/26e47e146f0f4358a3c05f9f13c44a62` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:06.601105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a3cd2-718d-4a84-a6e0-6703c261252e None admin] RBAC: Authorizing `identity:get_user(user_id=26e47e146f0f4358a3c05f9f13c44a62)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:06.602592 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a3cd2-718d-4a84-a6e0-6703c261252e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:06.604738 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 135/264] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:41:06 2022] GET /identity/v3/users/26e47e146f0f4358a3c05f9f13c44a62 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:06.605194 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a3cd2-718d-4a84-a6e0-6703c261252e None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:06.622942 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b425a5-e99a-4ced-83b5-217ae0c64dc4 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:06.663315 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:06.667420 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd28737-99bb-4b52-be96-c394c56b551b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:06.668870 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd28737-99bb-4b52-be96-c394c56b551b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:06.669364 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd28737-99bb-4b52-be96-c394c56b551b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:06.670005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd28737-99bb-4b52-be96-c394c56b551b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:06.671392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd28737-99bb-4b52-be96-c394c56b551b None admin] RBAC: Adding query filter params (role.id=a68c1386e9434ef9b5aff7d46f61c2b4, scope.project.id=eec5a65c35a046b4b2021380c24c36ab, user.id=06c72d4ec2ac4338873d5dd0ef3ab80b) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:06.674625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd28737-99bb-4b52-be96-c394c56b551b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:06.674625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd28737-99bb-4b52-be96-c394c56b551b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:06.684219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 130/265] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:41:06 2022] GET /identity/v3/role_assignments?user.id=06c72d4ec2ac4338873d5dd0ef3ab80b&scope.project.id=eec5a65c35a046b4b2021380c24c36ab&role.id=a68c1386e9434ef9b5aff7d46f61c2b4 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:06.685011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd28737-99bb-4b52-be96-c394c56b551b None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:06.771131 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a3cd2-718d-4a84-a6e0-6703c261252e None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:06.814516 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5d0df-a0f1-4d37-8a01-fd9574fb1ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:06.815244 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5d0df-a0f1-4d37-8a01-fd9574fb1ed9 None admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:06.815527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5d0df-a0f1-4d37-8a01-fd9574fb1ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:06.815802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5d0df-a0f1-4d37-8a01-fd9574fb1ed9 None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab/users/49752d76f1d7461c888eee35a2fbc1e2/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:06.823468 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5d0df-a0f1-4d37-8a01-fd9574fb1ed9 None admin] RBAC: Authorizing `identity:create_grant(project_id=eec5a65c35a046b4b2021380c24c36ab, user_id=49752d76f1d7461c888eee35a2fbc1e2, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:06.824956 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5d0df-a0f1-4d37-8a01-fd9574fb1ed9 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:06.865173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd28737-99bb-4b52-be96-c394c56b551b None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:06.888470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:06.898401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 136/266] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:41:06 2022] PUT /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab/users/49752d76f1d7461c888eee35a2fbc1e2/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:41:06.904861 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0a368-49d4-4530-a006-5a54ec36ec76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:06.906047 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0a368-49d4-4530-a006-5a54ec36ec76 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:06.906574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0a368-49d4-4530-a006-5a54ec36ec76 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:06.907153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0a368-49d4-4530-a006-5a54ec36ec76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:06.996113 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0a368-49d4-4530-a006-5a54ec36ec76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:06.998025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0a368-49d4-4530-a006-5a54ec36ec76 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:07.128218 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 131/267] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:07.133608 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5d0df-a0f1-4d37-8a01-fd9574fb1ed9 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:07.246531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5d0df-a0f1-4d37-8a01-fd9574fb1ed9 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:07.260353 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:07.281927 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd886c1-7a9e-4085-9487-aff08d27fef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:07.286573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd886c1-7a9e-4085-9487-aff08d27fef0 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:07.286573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd886c1-7a9e-4085-9487-aff08d27fef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:07.286573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd886c1-7a9e-4085-9487-aff08d27fef0 None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:07.286573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd886c1-7a9e-4085-9487-aff08d27fef0 None admin] RBAC: Authorizing `identity:get_project(project_id=eec5a65c35a046b4b2021380c24c36ab)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:07.286573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd886c1-7a9e-4085-9487-aff08d27fef0 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:07.288721 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 137/268] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:07 2022] GET /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:07.295640 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0a368-49d4-4530-a006-5a54ec36ec76 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:07.330963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:07.430500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0a368-49d4-4530-a006-5a54ec36ec76 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:07.474193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2039c7f-0824-4bcf-8377-f85e4382ff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:07.474842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2039c7f-0824-4bcf-8377-f85e4382ff3b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:07.475127 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2039c7f-0824-4bcf-8377-f85e4382ff3b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:07.475398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2039c7f-0824-4bcf-8377-f85e4382ff3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:07.476225 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2039c7f-0824-4bcf-8377-f85e4382ff3b None admin] RBAC: Adding query filter params (role.id=e39a3afcb14442a08e9a24b8a56d17cf, scope.project.id=eec5a65c35a046b4b2021380c24c36ab, user.id=26e47e146f0f4358a3c05f9f13c44a62) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:07.476507 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2039c7f-0824-4bcf-8377-f85e4382ff3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:07.478625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2039c7f-0824-4bcf-8377-f85e4382ff3b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:07.485222 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 132/269] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:41:07 2022] GET /identity/v3/role_assignments?user.id=26e47e146f0f4358a3c05f9f13c44a62&scope.project.id=eec5a65c35a046b4b2021380c24c36ab&role.id=e39a3afcb14442a08e9a24b8a56d17cf => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:07.948287 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed17ea-fb91-45d8-8804-69f50aa6d1ba None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:07.949336 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed17ea-fb91-45d8-8804-69f50aa6d1ba None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:07.949827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed17ea-fb91-45d8-8804-69f50aa6d1ba None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:07.951680 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 138/270] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:07.957523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeccdcf-40ce-48fb-a3f2-0b2e09848b71 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:07.958430 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeccdcf-40ce-48fb-a3f2-0b2e09848b71 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:07.958946 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeccdcf-40ce-48fb-a3f2-0b2e09848b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:07.981960 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-1eeccdcf-40ce-48fb-a3f2-0b2e09848b71 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:07.983537 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-1eeccdcf-40ce-48fb-a3f2-0b2e09848b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:08.059816 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 133/271] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:08.083447 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed17ea-fb91-45d8-8804-69f50aa6d1ba None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:08.094162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00a211-f444-4f95-b756-27336722e5ac None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:08.094459 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00a211-f444-4f95-b756-27336722e5ac None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:08.094757 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00a211-f444-4f95-b756-27336722e5ac None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:08.096454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 134/272] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:08.101543 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ec378-412c-497d-a701-c0f58cd1586e None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:08.101874 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ec378-412c-497d-a701-c0f58cd1586e None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:08.102152 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ec378-412c-497d-a701-c0f58cd1586e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:08.120207 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-3e5ec378-412c-497d-a701-c0f58cd1586e None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:08.121397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3e5ec378-412c-497d-a701-c0f58cd1586e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:08.131080 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:08.226972 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 135/273] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:41:08.243149 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed17ea-fb91-45d8-8804-69f50aa6d1ba None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:08.263604 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ec378-412c-497d-a701-c0f58cd1586e None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:08.303075 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea60abb-be2e-43fd-b1f3-90b38fd650b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:08.304210 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea60abb-be2e-43fd-b1f3-90b38fd650b2 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:08.304719 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea60abb-be2e-43fd-b1f3-90b38fd650b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:08.305828 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea60abb-be2e-43fd-b1f3-90b38fd650b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:08.325868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea60abb-be2e-43fd-b1f3-90b38fd650b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:08.336614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-dea60abb-be2e-43fd-b1f3-90b38fd650b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:08.336614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:08.336614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:08.336614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:08.336614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:08.336614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:08.336614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:08.336614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:08.336614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:08.336614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:08.336614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:08.336614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:08.336614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:08.336614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:08.336614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:08.336614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:08.338604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:08.338604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:08.338604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:08.338604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:08.338604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:08.338604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:08.338604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:08.338604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:08.338604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:08.338604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:08.338604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:08.338604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:08.338604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:08.338604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:08.338604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:08.338604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:08.340509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:08.340509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:08.340509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:08.340509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:08.340509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:08.340509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:08.340509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:08.340509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:08.340509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:08.340509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:08.340509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:08.340509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:08.344217 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 139/274] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:08.353695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea60abb-be2e-43fd-b1f3-90b38fd650b2 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:08.428647 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:08.436927 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ec378-412c-497d-a701-c0f58cd1586e None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:08.493400 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca208e-588e-4562-9f1e-e079d61dcd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:08.494461 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca208e-588e-4562-9f1e-e079d61dcd52 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:08.494895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca208e-588e-4562-9f1e-e079d61dcd52 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:08.495374 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca208e-588e-4562-9f1e-e079d61dcd52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:08.497309 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca208e-588e-4562-9f1e-e079d61dcd52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:08.499960 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca208e-588e-4562-9f1e-e079d61dcd52 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:08.511325 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 136/275] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:08.512747 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca208e-588e-4562-9f1e-e079d61dcd52 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:08.537040 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea60abb-be2e-43fd-b1f3-90b38fd650b2 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:08.553523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:08.599955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3a85c-43fb-46a6-9f5a-d38f3263607b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:08.601564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3a85c-43fb-46a6-9f5a-d38f3263607b None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:08.602865 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3a85c-43fb-46a6-9f5a-d38f3263607b None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:08.603682 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3a85c-43fb-46a6-9f5a-d38f3263607b None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:08.605209 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3a85c-43fb-46a6-9f5a-d38f3263607b None admin] RBAC: Adding query filter params (name=member) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:08.605987 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3a85c-43fb-46a6-9f5a-d38f3263607b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:08.608902 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3a85c-43fb-46a6-9f5a-d38f3263607b None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:08.633397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 140/276] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:41:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:08.635153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3a85c-43fb-46a6-9f5a-d38f3263607b None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:08.681247 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca208e-588e-4562-9f1e-e079d61dcd52 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:08.741281 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91877570-955c-41a6-8d8a-30588e209a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:08.741898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91877570-955c-41a6-8d8a-30588e209a73 None admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:08.742173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91877570-955c-41a6-8d8a-30588e209a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:08.743017 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91877570-955c-41a6-8d8a-30588e209a73 None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:08.743966 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91877570-955c-41a6-8d8a-30588e209a73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:08.745281 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91877570-955c-41a6-8d8a-30588e209a73 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:08.814725 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3a85c-43fb-46a6-9f5a-d38f3263607b None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:08.817459 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:08.872509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684a45c-9945-48a9-8367-d150f5d371d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:08.873604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684a45c-9945-48a9-8367-d150f5d371d6 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:08.874076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684a45c-9945-48a9-8367-d150f5d371d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:08.874534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684a45c-9945-48a9-8367-d150f5d371d6 None admin] PATH_INFO: `/v3/users/e50547688e124a7489259510e2c76886` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:08.898329 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 137/277] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 3 12:41:08 2022] POST /identity/v3/users => generated 293 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:41:08.899970 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684a45c-9945-48a9-8367-d150f5d371d6 None admin] RBAC: Authorizing `identity:get_user(user_id=e50547688e124a7489259510e2c76886)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:08.901793 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684a45c-9945-48a9-8367-d150f5d371d6 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:08.904108 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 141/278] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:41:08 2022] GET /identity/v3/users/e50547688e124a7489259510e2c76886 => generated 293 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:08.911238 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91877570-955c-41a6-8d8a-30588e209a73 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:08.989077 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:09.004526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc00e8-b5f7-4572-9551-6f8b26b8a432 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:09.004526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc00e8-b5f7-4572-9551-6f8b26b8a432 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:09.004526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc00e8-b5f7-4572-9551-6f8b26b8a432 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:09.004526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 142/279] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:41:09.007425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e4489-8151-4a2c-9d94-03ce70e2d713 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:09.008909 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e4489-8151-4a2c-9d94-03ce70e2d713 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:09.010010 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e4489-8151-4a2c-9d94-03ce70e2d713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:09.035208 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91877570-955c-41a6-8d8a-30588e209a73 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:09.036444 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-df3e4489-8151-4a2c-9d94-03ce70e2d713 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:09.040372 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-df3e4489-8151-4a2c-9d94-03ce70e2d713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:09.083589 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73eb084-268f-49fe-b795-92dfd9234f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:09.084236 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eb084-268f-49fe-b795-92dfd9234f22 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:09.084607 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eb084-268f-49fe-b795-92dfd9234f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:09.084885 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eb084-268f-49fe-b795-92dfd9234f22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:09.085696 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73eb084-268f-49fe-b795-92dfd9234f22 None admin] RBAC: Adding query filter params (role.id=26c9fe6916a4412d96492e41ff62cca6, user.id=e50547688e124a7489259510e2c76886, scope.system=all) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:09.086690 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73eb084-268f-49fe-b795-92dfd9234f22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:09.088264 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73eb084-268f-49fe-b795-92dfd9234f22 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:09.103116 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 138/280] 10.222.0.64 () {56 vars in 1308 bytes} [Wed Aug 3 12:41:08 2022] GET /identity/v3/role_assignments?user.id=e50547688e124a7489259510e2c76886&scope.system=all&role.id=26c9fe6916a4412d96492e41ff62cca6 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:09.132251 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 143/281] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:09.155745 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73eb084-268f-49fe-b795-92dfd9234f22 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:09.259589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f7c96-a538-4254-ae50-9ca053a3e7e9 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:09.259905 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f7c96-a538-4254-ae50-9ca053a3e7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:09.260069 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f7c96-a538-4254-ae50-9ca053a3e7e9 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:09.261782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 144/282] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:09.268149 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c4421-26f3-44e5-addd-371b06003789 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:09.268442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c4421-26f3-44e5-addd-371b06003789 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:09.268710 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c4421-26f3-44e5-addd-371b06003789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:09.277524 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73eb084-268f-49fe-b795-92dfd9234f22 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:09.292944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-cb9c4421-26f3-44e5-addd-371b06003789 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:09.294892 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-cb9c4421-26f3-44e5-addd-371b06003789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:09.314314 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:09.323313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c8670-18ab-451e-a523-6adf10d9ab25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:09.332817 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c8670-18ab-451e-a523-6adf10d9ab25 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:09.332817 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c8670-18ab-451e-a523-6adf10d9ab25 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:09.332817 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c8670-18ab-451e-a523-6adf10d9ab25 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:09.337555 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c8670-18ab-451e-a523-6adf10d9ab25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:09.342827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-742c8670-18ab-451e-a523-6adf10d9ab25 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:41:09.342827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:09.342827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:09.342827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:09.342827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:09.342827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:09.342827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:09.342827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:09.342827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:09.342827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:09.342827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:09.342827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:09.342827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:09.342827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:09.342827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:09.342827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:09.343683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:09.343683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:09.343683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:09.343683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:09.343683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:09.343683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:09.343683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:09.343683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:09.343683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:09.343683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:09.343683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:09.343683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:09.343683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:09.343683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:09.343683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:09.343683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:09.344469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:09.344469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:09.344469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:09.344469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:09.344469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:09.344469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:09.344469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:09.344469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:09.344469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:09.344469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:09.344469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:41:09.344469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:09.344469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 139/283] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:09.350389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c8670-18ab-451e-a523-6adf10d9ab25 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:09.384790 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 145/284] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:09.407782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c4421-26f3-44e5-addd-371b06003789 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:09.434710 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:09.469861 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c8670-18ab-451e-a523-6adf10d9ab25 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:09.526011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85638991-f13c-4083-aff8-c6dcf882c607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:09.526569 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85638991-f13c-4083-aff8-c6dcf882c607 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:09.526888 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85638991-f13c-4083-aff8-c6dcf882c607 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:09.527171 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85638991-f13c-4083-aff8-c6dcf882c607 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:09.527907 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85638991-f13c-4083-aff8-c6dcf882c607 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:09.528220 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85638991-f13c-4083-aff8-c6dcf882c607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:09.530691 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85638991-f13c-4083-aff8-c6dcf882c607 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:09.552292 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 140/285] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:41:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:09.557730 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85638991-f13c-4083-aff8-c6dcf882c607 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:09.595495 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c4421-26f3-44e5-addd-371b06003789 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:09.619161 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:09.663911 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85638991-f13c-4083-aff8-c6dcf882c607 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:09.667222 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7de88-4dad-4c64-9c8c-15cee961babd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:09.668106 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7de88-4dad-4c64-9c8c-15cee961babd None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:09.668529 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7de88-4dad-4c64-9c8c-15cee961babd None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:09.668939 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7de88-4dad-4c64-9c8c-15cee961babd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:09.699656 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7de88-4dad-4c64-9c8c-15cee961babd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:09.703956 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da819b-5d7c-4c38-85aa-65eaff7edc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:09.704601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da819b-5d7c-4c38-85aa-65eaff7edc31 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:09.704891 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da819b-5d7c-4c38-85aa-65eaff7edc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:09.705171 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da819b-5d7c-4c38-85aa-65eaff7edc31 None admin] PATH_INFO: `/v3/users/06c72d4ec2ac4338873d5dd0ef3ab80b` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:09.706373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da819b-5d7c-4c38-85aa-65eaff7edc31 None admin] RBAC: Authorizing `identity:get_user(user_id=06c72d4ec2ac4338873d5dd0ef3ab80b)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:09.707858 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da819b-5d7c-4c38-85aa-65eaff7edc31 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:09.709477 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 141/286] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:41:09 2022] GET /identity/v3/users/06c72d4ec2ac4338873d5dd0ef3ab80b => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:09.715898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-97c7de88-4dad-4c64-9c8c-15cee961babd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:09.715898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:09.715898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:09.715898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:09.715898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:09.715898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:09.715898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:09.715898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:09.715898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:09.715898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:09.715898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:09.715898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:09.715898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:09.715898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:09.715898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:09.715898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:09.716759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:09.716759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:09.716759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:09.716759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:09.716759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:09.716759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:09.716759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:09.716759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:09.716759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:09.716759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:09.716759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:09.716759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:09.716759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:09.716759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:09.716759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:09.716759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:09.717538 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:09.717538 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:09.717538 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:09.717538 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:09.717538 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:09.717538 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:09.717538 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:09.717538 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:09.717538 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:09.717538 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:09.717538 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:09.717538 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:09.717538 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 146/287] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:09.718180 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da819b-5d7c-4c38-85aa-65eaff7edc31 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:09.723346 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7de88-4dad-4c64-9c8c-15cee961babd None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:09.853283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da819b-5d7c-4c38-85aa-65eaff7edc31 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:09.872266 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:09.876918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:09.894654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12578f28-c5e3-400d-9934-32586924d5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:09.895345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12578f28-c5e3-400d-9934-32586924d5fd None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:09.895630 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12578f28-c5e3-400d-9934-32586924d5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:09.895912 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12578f28-c5e3-400d-9934-32586924d5fd None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:09.897294 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12578f28-c5e3-400d-9934-32586924d5fd None admin] RBAC: Authorizing `identity:get_project(project_id=eec5a65c35a046b4b2021380c24c36ab)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:09.898833 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12578f28-c5e3-400d-9934-32586924d5fd None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:09.900542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 142/288] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:09 2022] GET /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:09.910002 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12578f28-c5e3-400d-9934-32586924d5fd None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:09.920949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7de88-4dad-4c64-9c8c-15cee961babd None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:09.961345 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28623d1-88c8-4223-8d5d-19f9662f7db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:09.962197 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28623d1-88c8-4223-8d5d-19f9662f7db3 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:09.962482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28623d1-88c8-4223-8d5d-19f9662f7db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:09.962840 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28623d1-88c8-4223-8d5d-19f9662f7db3 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:09.963570 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28623d1-88c8-4223-8d5d-19f9662f7db3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:09.963880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28623d1-88c8-4223-8d5d-19f9662f7db3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:09.965480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28623d1-88c8-4223-8d5d-19f9662f7db3 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:09.975831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 147/289] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:41:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:09.981013 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28623d1-88c8-4223-8d5d-19f9662f7db3 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:10.090642 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12578f28-c5e3-400d-9934-32586924d5fd None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:10.127081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875e6e4-3288-49bd-8520-bc0124545b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:10.127678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875e6e4-3288-49bd-8520-bc0124545b7f None admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:10.128017 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875e6e4-3288-49bd-8520-bc0124545b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:10.128304 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875e6e4-3288-49bd-8520-bc0124545b7f None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab/users/06c72d4ec2ac4338873d5dd0ef3ab80b/roles/a68c1386e9434ef9b5aff7d46f61c2b4` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:10.130289 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875e6e4-3288-49bd-8520-bc0124545b7f None admin] RBAC: Authorizing `identity:create_grant(project_id=eec5a65c35a046b4b2021380c24c36ab, user_id=06c72d4ec2ac4338873d5dd0ef3ab80b, role_id=a68c1386e9434ef9b5aff7d46f61c2b4)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:10.131776 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875e6e4-3288-49bd-8520-bc0124545b7f None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:10.174672 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28623d1-88c8-4223-8d5d-19f9662f7db3 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:10.215803 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 143/290] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:41:09 2022] PUT /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab/users/06c72d4ec2ac4338873d5dd0ef3ab80b/roles/a68c1386e9434ef9b5aff7d46f61c2b4 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:41:10.221011 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e750f-2e6c-4512-8a1b-a4f0701f3e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:10.221690 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e750f-2e6c-4512-8a1b-a4f0701f3e2a None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:10.221982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e750f-2e6c-4512-8a1b-a4f0701f3e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:10.222265 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e750f-2e6c-4512-8a1b-a4f0701f3e2a None admin] PATH_INFO: `/v3/users/49752d76f1d7461c888eee35a2fbc1e2` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:10.225100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e750f-2e6c-4512-8a1b-a4f0701f3e2a None admin] RBAC: Authorizing `identity:get_user(user_id=49752d76f1d7461c888eee35a2fbc1e2)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:10.227235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e750f-2e6c-4512-8a1b-a4f0701f3e2a None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:10.229173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 148/291] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:41:09 2022] GET /identity/v3/users/49752d76f1d7461c888eee35a2fbc1e2 => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:10.234820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875e6e4-3288-49bd-8520-bc0124545b7f None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:10.301987 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:10.373738 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875e6e4-3288-49bd-8520-bc0124545b7f None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:10.422780 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8132b-ba81-4e41-993f-2dd846ed8b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:10.423423 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8132b-ba81-4e41-993f-2dd846ed8b30 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:10.423708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8132b-ba81-4e41-993f-2dd846ed8b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:10.424058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8132b-ba81-4e41-993f-2dd846ed8b30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:10.525765 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8132b-ba81-4e41-993f-2dd846ed8b30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:10.527297 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8132b-ba81-4e41-993f-2dd846ed8b30 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:10.585877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:10.646158 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 144/292] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:10.652606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e750f-2e6c-4512-8a1b-a4f0701f3e2a None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:10.666588 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:10.782445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e750f-2e6c-4512-8a1b-a4f0701f3e2a None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:10.825834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cb640-acfa-4861-8988-90905bd7bcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:10.826805 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cb640-acfa-4861-8988-90905bd7bcc1 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:10.827270 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cb640-acfa-4861-8988-90905bd7bcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:10.827722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cb640-acfa-4861-8988-90905bd7bcc1 None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:10.829110 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cb640-acfa-4861-8988-90905bd7bcc1 None admin] RBAC: Authorizing `identity:get_project(project_id=eec5a65c35a046b4b2021380c24c36ab)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:10.830745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cb640-acfa-4861-8988-90905bd7bcc1 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:10.833607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 149/293] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:10 2022] GET /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:10.842041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8132b-ba81-4e41-993f-2dd846ed8b30 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:10.987032 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8132b-ba81-4e41-993f-2dd846ed8b30 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:11.022778 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f0ff2-a24d-4509-9ef0-4b1022291ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:11.023516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f0ff2-a24d-4509-9ef0-4b1022291ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:11.023803 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f0ff2-a24d-4509-9ef0-4b1022291ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:11.024084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f0ff2-a24d-4509-9ef0-4b1022291ff6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:11.024939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f0ff2-a24d-4509-9ef0-4b1022291ff6 None admin] RBAC: Adding query filter params (role.id=26c9fe6916a4412d96492e41ff62cca6, scope.project.id=eec5a65c35a046b4b2021380c24c36ab, user.id=49752d76f1d7461c888eee35a2fbc1e2) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:11.025256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f0ff2-a24d-4509-9ef0-4b1022291ff6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:11.026791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f0ff2-a24d-4509-9ef0-4b1022291ff6 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:11.033263 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 145/294] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:41:10 2022] GET /identity/v3/role_assignments?user.id=49752d76f1d7461c888eee35a2fbc1e2&scope.project.id=eec5a65c35a046b4b2021380c24c36ab&role.id=26c9fe6916a4412d96492e41ff62cca6 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:11.382530 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce3e85-303d-4eb6-b52e-badb60aac021 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:11.383629 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce3e85-303d-4eb6-b52e-badb60aac021 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:11.383629 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce3e85-303d-4eb6-b52e-badb60aac021 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:11.385189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 150/295] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:11.390663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf7e34-bbad-43d6-8f5f-db5d5d21bf85 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:11.391172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf7e34-bbad-43d6-8f5f-db5d5d21bf85 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:11.402875 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf7e34-bbad-43d6-8f5f-db5d5d21bf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:11.409740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-a3bf7e34-bbad-43d6-8f5f-db5d5d21bf85 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:11.411026 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a3bf7e34-bbad-43d6-8f5f-db5d5d21bf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:11.424329 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:11.483834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6743d-f574-48e7-94cb-ee1c739d910f None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:11.484236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6743d-f574-48e7-94cb-ee1c739d910f None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:11.484408 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6743d-f574-48e7-94cb-ee1c739d910f None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:11.486011 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 151/296] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:41:11.490870 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 146/297] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:11.491405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efab93-036e-4ba5-8479-80bd5a26ea9b None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:11.491699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efab93-036e-4ba5-8479-80bd5a26ea9b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:11.492051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efab93-036e-4ba5-8479-80bd5a26ea9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:11.511549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-19efab93-036e-4ba5-8479-80bd5a26ea9b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:11.512752 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-19efab93-036e-4ba5-8479-80bd5a26ea9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:11.515987 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf7e34-bbad-43d6-8f5f-db5d5d21bf85 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:11.609498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 152/298] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:11.631428 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efab93-036e-4ba5-8479-80bd5a26ea9b None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:11.646573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:11.661865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf7e34-bbad-43d6-8f5f-db5d5d21bf85 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:11.700851 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f6625-fc99-4458-b21f-fbc00b5b9a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:11.701495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f6625-fc99-4458-b21f-fbc00b5b9a62 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:11.701778 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f6625-fc99-4458-b21f-fbc00b5b9a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:11.702051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f6625-fc99-4458-b21f-fbc00b5b9a62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:11.713195 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f6625-fc99-4458-b21f-fbc00b5b9a62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:11.718114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-708f6625-fc99-4458-b21f-fbc00b5b9a62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:11.718114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:11.718114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:11.718114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:11.718114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:11.718114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:11.718114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:11.718114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:11.718114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:11.718114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:11.718114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:11.718114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:11.718114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:11.718114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:11.718114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:11.718114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:11.719251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:11.719251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:11.719251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:11.719251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:11.719251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:11.719251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:11.719251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:11.719251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:11.719251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:11.719251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:11.719251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:11.719251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:11.719251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:11.719251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:11.719251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:11.719251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:11.720164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:11.720164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:11.720164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:11.720164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:11.720164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:11.720164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:11.720164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:11.720164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:11.720164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:11.720164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:11.720164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:11.720164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:11.720164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 147/299] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:11.720866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f768b-bf29-4d4c-bc17-a8017fa33947 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:11.720866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f768b-bf29-4d4c-bc17-a8017fa33947 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:11.720983 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f768b-bf29-4d4c-bc17-a8017fa33947 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:11.722283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 148/300] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:11.726766 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f768b-bf29-4d4c-bc17-a8017fa33947 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:11.730284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:11.745284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efab93-036e-4ba5-8479-80bd5a26ea9b None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:11.784795 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88fd60-01d9-438d-9603-4055287c4d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:11.785443 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88fd60-01d9-438d-9603-4055287c4d8d None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:11.785729 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88fd60-01d9-438d-9603-4055287c4d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:11.786010 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88fd60-01d9-438d-9603-4055287c4d8d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:11.797470 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88fd60-01d9-438d-9603-4055287c4d8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:11.802802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-8c88fd60-01d9-438d-9603-4055287c4d8d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:41:11.802802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:11.802802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:11.802802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:11.802802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:11.802802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:11.802802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:11.802802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:11.802802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:11.802802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:11.802802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:11.802802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:11.802802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:11.802802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:11.802802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:11.802802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:11.803693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:11.803693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:11.803693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:11.803693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:11.803693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:11.803693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:11.803693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:11.803693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:11.803693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:11.803693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:11.803693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:11.803693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:11.803693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:11.803693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:11.803693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:11.803693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:11.809498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:11.809498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:11.809498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:11.809498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:11.809498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:11.809498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:11.809498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:11.809498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:11.809498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:11.809498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:11.809498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:41:11.809498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:11.809498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 153/301] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:11.809498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84889592-2d48-41b7-b549-fbe2a1625f06 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:11.810254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84889592-2d48-41b7-b549-fbe2a1625f06 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:11.810254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84889592-2d48-41b7-b549-fbe2a1625f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:11.825624 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-84889592-2d48-41b7-b549-fbe2a1625f06 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:11.827223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-84889592-2d48-41b7-b549-fbe2a1625f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:11.842787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f768b-bf29-4d4c-bc17-a8017fa33947 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:11.878134 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1eee9d-3db9-45d2-ac93-cb5a013ffda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:11.878981 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1eee9d-3db9-45d2-ac93-cb5a013ffda2 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:11.879266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1eee9d-3db9-45d2-ac93-cb5a013ffda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:11.879547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1eee9d-3db9-45d2-ac93-cb5a013ffda2 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:11.880269 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1eee9d-3db9-45d2-ac93-cb5a013ffda2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:11.880584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1eee9d-3db9-45d2-ac93-cb5a013ffda2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:11.881994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1eee9d-3db9-45d2-ac93-cb5a013ffda2 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:11.890579 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 149/302] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:41:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:11.891409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1eee9d-3db9-45d2-ac93-cb5a013ffda2 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:11.898006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:11.903995 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 154/303] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:11.911859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84889592-2d48-41b7-b549-fbe2a1625f06 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:11.968801 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:12.009438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1eee9d-3db9-45d2-ac93-cb5a013ffda2 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:12.023888 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84889592-2d48-41b7-b549-fbe2a1625f06 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:12.045859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d6760-4caf-4134-a6d4-75cd2838673b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:12.046957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d6760-4caf-4134-a6d4-75cd2838673b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:12.046957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d6760-4caf-4134-a6d4-75cd2838673b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:12.047105 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d6760-4caf-4134-a6d4-75cd2838673b None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:12.047751 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d6760-4caf-4134-a6d4-75cd2838673b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:12.048060 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d6760-4caf-4134-a6d4-75cd2838673b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:12.049434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d6760-4caf-4134-a6d4-75cd2838673b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:12.059782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 150/304] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:41:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:12.060650 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d6760-4caf-4134-a6d4-75cd2838673b None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:12.068541 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583996d-a877-4735-a093-35d3a8765999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:12.069296 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583996d-a877-4735-a093-35d3a8765999 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:12.069690 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583996d-a877-4735-a093-35d3a8765999 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:12.070062 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583996d-a877-4735-a093-35d3a8765999 None admin] PATH_INFO: `/v3/users/e50547688e124a7489259510e2c76886` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:12.071891 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583996d-a877-4735-a093-35d3a8765999 None admin] RBAC: Authorizing `identity:get_user(user_id=e50547688e124a7489259510e2c76886)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:12.073326 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583996d-a877-4735-a093-35d3a8765999 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:12.074993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 155/305] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:41:11 2022] GET /identity/v3/users/e50547688e124a7489259510e2c76886 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:12.075737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583996d-a877-4735-a093-35d3a8765999 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:12.146482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:12.182133 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583996d-a877-4735-a093-35d3a8765999 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:12.182614 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d6760-4caf-4134-a6d4-75cd2838673b None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:12.212613 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:12.220697 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30772d7-3b12-4d78-ba2b-5e12e7374f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:12.220838 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2084a27-32e4-4cd9-bda4-1c2544236e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:12.221346 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30772d7-3b12-4d78-ba2b-5e12e7374f46 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:12.226147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2084a27-32e4-4cd9-bda4-1c2544236e0c None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:12.226244 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30772d7-3b12-4d78-ba2b-5e12e7374f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:12.226316 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2084a27-32e4-4cd9-bda4-1c2544236e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:12.226382 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30772d7-3b12-4d78-ba2b-5e12e7374f46 None admin] PATH_INFO: `/v3/users/407334bbff06485e8c8e430b62627a35` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:12.226513 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2084a27-32e4-4cd9-bda4-1c2544236e0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:12.226513 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2084a27-32e4-4cd9-bda4-1c2544236e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:12.226513 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2084a27-32e4-4cd9-bda4-1c2544236e0c None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:12.231111 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 151/306] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:12.232320 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2084a27-32e4-4cd9-bda4-1c2544236e0c None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:12.237031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30772d7-3b12-4d78-ba2b-5e12e7374f46 None admin] RBAC: Authorizing `identity:get_user(user_id=407334bbff06485e8c8e430b62627a35)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:12.238620 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30772d7-3b12-4d78-ba2b-5e12e7374f46 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:12.243031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 156/307] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:41:12 2022] GET /identity/v3/users/407334bbff06485e8c8e430b62627a35 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:12.244478 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30772d7-3b12-4d78-ba2b-5e12e7374f46 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:12.340210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2084a27-32e4-4cd9-bda4-1c2544236e0c None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:12.347137 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30772d7-3b12-4d78-ba2b-5e12e7374f46 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:12.371895 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:12.377676 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed92a75-7d37-4570-960f-fb821cf903c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:12.378546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed92a75-7d37-4570-960f-fb821cf903c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:12.379032 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed92a75-7d37-4570-960f-fb821cf903c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:12.379482 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed92a75-7d37-4570-960f-fb821cf903c5 None admin] PATH_INFO: `/v3/system/users/e50547688e124a7489259510e2c76886/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:12.381167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed92a75-7d37-4570-960f-fb821cf903c5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e50547688e124a7489259510e2c76886, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:12.382686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029ddc4-8a91-4454-89d2-696cccd5e03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:12.383238 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed92a75-7d37-4570-960f-fb821cf903c5 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:12.383340 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029ddc4-8a91-4454-89d2-696cccd5e03f None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:12.383589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029ddc4-8a91-4454-89d2-696cccd5e03f None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:12.386295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029ddc4-8a91-4454-89d2-696cccd5e03f None admin] PATH_INFO: `/v3/groups` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:12.386295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029ddc4-8a91-4454-89d2-696cccd5e03f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:12.386295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029ddc4-8a91-4454-89d2-696cccd5e03f None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:12.501412 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 152/308] 10.222.0.64 () {58 vars in 1334 bytes} [Wed Aug 3 12:41:12 2022] PUT /identity/v3/system/users/e50547688e124a7489259510e2c76886/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:41:12.502311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed92a75-7d37-4570-960f-fb821cf903c5 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:12.527985 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 157/309] 10.222.0.64 () {60 vars in 1134 bytes} [Wed Aug 3 12:41:12 2022] POST /identity/v3/groups => generated 229 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:41:12.597253 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:12.652989 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed92a75-7d37-4570-960f-fb821cf903c5 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:12.693478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e773ab4-ab00-468c-b9ea-42c64a16331e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:12.694421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e773ab4-ab00-468c-b9ea-42c64a16331e None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:12.694915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e773ab4-ab00-468c-b9ea-42c64a16331e None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:12.695433 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e773ab4-ab00-468c-b9ea-42c64a16331e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:12.696437 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e773ab4-ab00-468c-b9ea-42c64a16331e None admin] RBAC: Adding query filter params (role.id=a68c1386e9434ef9b5aff7d46f61c2b4, user.id=407334bbff06485e8c8e430b62627a35, scope.system=all) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:12.696989 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e773ab4-ab00-468c-b9ea-42c64a16331e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:12.698727 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e773ab4-ab00-468c-b9ea-42c64a16331e None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:12.706378 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 153/310] 10.222.0.64 () {56 vars in 1308 bytes} [Wed Aug 3 12:41:12 2022] GET /identity/v3/role_assignments?user.id=407334bbff06485e8c8e430b62627a35&scope.system=all&role.id=a68c1386e9434ef9b5aff7d46f61c2b4 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:12.885980 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8474d81-521f-4805-8f30-79ad1da41ade None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:12.886275 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8474d81-521f-4805-8f30-79ad1da41ade None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:12.886531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8474d81-521f-4805-8f30-79ad1da41ade None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:12.888138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 158/311] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:12.893629 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ba4ff-d25e-43f3-bd78-2e5b3b8899be None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:12.893926 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ba4ff-d25e-43f3-bd78-2e5b3b8899be None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:12.894214 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ba4ff-d25e-43f3-bd78-2e5b3b8899be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:12.913575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-0d1ba4ff-d25e-43f3-bd78-2e5b3b8899be None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:12.915355 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-0d1ba4ff-d25e-43f3-bd78-2e5b3b8899be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:12.987242 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 154/312] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:13.009984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8474d81-521f-4805-8f30-79ad1da41ade None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:13.119784 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8474d81-521f-4805-8f30-79ad1da41ade None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:13.161883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a75e6-a9e7-4159-85ac-52c198c2afdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:13.162554 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a75e6-a9e7-4159-85ac-52c198c2afdd None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:13.162872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a75e6-a9e7-4159-85ac-52c198c2afdd None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:13.163156 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a75e6-a9e7-4159-85ac-52c198c2afdd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:13.174848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a75e6-a9e7-4159-85ac-52c198c2afdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:13.180520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-605a75e6-a9e7-4159-85ac-52c198c2afdd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:41:13.180520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:13.180520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:13.180520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:13.180520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:13.180520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:13.180520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:13.180520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:13.180520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:13.180520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:13.180520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:13.180520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:13.180520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:13.180520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:13.180520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:13.180520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:13.182589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:13.182589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:13.182589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:13.182589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:13.182589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:13.182589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:13.182589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:13.182589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:13.182589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:13.182589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:13.182589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:13.182589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:13.182589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:13.182589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:13.182589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:13.182589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:13.184566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:13.184566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:13.184566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:13.184566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:13.184566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:13.184566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:13.184566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:13.184566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:13.184566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:13.184566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:13.184566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:41:13.184566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:13.184566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 159/313] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:13.191173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ba4ff-d25e-43f3-bd78-2e5b3b8899be None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:13.247744 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:13.293849 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ba4ff-d25e-43f3-bd78-2e5b3b8899be None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:13.329234 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc4e00-7208-476a-a331-7db16ed01bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:13.329862 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc4e00-7208-476a-a331-7db16ed01bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:13.330151 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc4e00-7208-476a-a331-7db16ed01bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:13.330433 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc4e00-7208-476a-a331-7db16ed01bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:13.331194 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc4e00-7208-476a-a331-7db16ed01bc2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:13.331505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc4e00-7208-476a-a331-7db16ed01bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:13.332892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc4e00-7208-476a-a331-7db16ed01bc2 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:13.341928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 155/314] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:41:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:13.347629 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a75e6-a9e7-4159-85ac-52c198c2afdd None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:13.396352 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:13.455202 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a75e6-a9e7-4159-85ac-52c198c2afdd None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:13.488495 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e36d1-6246-4abb-8fea-1c3980c07c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:13.489137 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e36d1-6246-4abb-8fea-1c3980c07c3e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:13.489418 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e36d1-6246-4abb-8fea-1c3980c07c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:13.489717 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e36d1-6246-4abb-8fea-1c3980c07c3e None admin] PATH_INFO: `/v3/users/06c72d4ec2ac4338873d5dd0ef3ab80b` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:13.491089 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e36d1-6246-4abb-8fea-1c3980c07c3e None admin] RBAC: Authorizing `identity:get_user(user_id=06c72d4ec2ac4338873d5dd0ef3ab80b)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:13.493088 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e36d1-6246-4abb-8fea-1c3980c07c3e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:13.495061 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 160/315] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:41:13 2022] GET /identity/v3/users/06c72d4ec2ac4338873d5dd0ef3ab80b => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:13.500629 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc4e00-7208-476a-a331-7db16ed01bc2 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:13.602108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc4e00-7208-476a-a331-7db16ed01bc2 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:13.618588 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:13.636646 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7cd16-1757-499d-bbaf-930c4388f930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:13.637328 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7cd16-1757-499d-bbaf-930c4388f930 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:13.637612 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7cd16-1757-499d-bbaf-930c4388f930 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:13.637941 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7cd16-1757-499d-bbaf-930c4388f930 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:13.714200 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7cd16-1757-499d-bbaf-930c4388f930 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:13.715643 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7cd16-1757-499d-bbaf-930c4388f930 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:13.821665 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 156/316] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:13.827108 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e36d1-6246-4abb-8fea-1c3980c07c3e None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:13.933184 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e36d1-6246-4abb-8fea-1c3980c07c3e None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:13.946004 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:13.966920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b370904-e756-404f-b6cc-a1b37415c2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:13.967498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b370904-e756-404f-b6cc-a1b37415c2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:13.967779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b370904-e756-404f-b6cc-a1b37415c2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:13.968105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b370904-e756-404f-b6cc-a1b37415c2e0 None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:13.969289 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b370904-e756-404f-b6cc-a1b37415c2e0 None admin] RBAC: Authorizing `identity:get_project(project_id=eec5a65c35a046b4b2021380c24c36ab)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:13.970791 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b370904-e756-404f-b6cc-a1b37415c2e0 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:13.972730 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 161/317] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:13 2022] GET /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:13.979142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7cd16-1757-499d-bbaf-930c4388f930 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:13.998515 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:14.089744 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7cd16-1757-499d-bbaf-930c4388f930 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:14.125236 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63460d1-8005-4eb8-b286-e10c507fb8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:14.125861 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63460d1-8005-4eb8-b286-e10c507fb8b5 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:14.126146 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63460d1-8005-4eb8-b286-e10c507fb8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:14.126423 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63460d1-8005-4eb8-b286-e10c507fb8b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:14.127245 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63460d1-8005-4eb8-b286-e10c507fb8b5 None admin] RBAC: Adding query filter params (role.id=a68c1386e9434ef9b5aff7d46f61c2b4, scope.project.id=eec5a65c35a046b4b2021380c24c36ab, user.id=06c72d4ec2ac4338873d5dd0ef3ab80b) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:14.127613 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63460d1-8005-4eb8-b286-e10c507fb8b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:14.129175 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63460d1-8005-4eb8-b286-e10c507fb8b5 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:14.135715 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 157/318] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:41:13 2022] GET /identity/v3/role_assignments?user.id=06c72d4ec2ac4338873d5dd0ef3ab80b&scope.project.id=eec5a65c35a046b4b2021380c24c36ab&role.id=a68c1386e9434ef9b5aff7d46f61c2b4 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:14.645004 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7595b-49b6-4247-8bdc-540cdfac3b2f None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:14.645513 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7595b-49b6-4247-8bdc-540cdfac3b2f None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:14.645585 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7595b-49b6-4247-8bdc-540cdfac3b2f None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:14.646971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 162/319] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:14.652652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f12dc2-c7ce-4227-b000-d64ff004417d None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:14.653032 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f12dc2-c7ce-4227-b000-d64ff004417d None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:14.653208 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f12dc2-c7ce-4227-b000-d64ff004417d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:14.663710 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ad728-9db6-4167-9d9f-264d8bda0bb8 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:14.664053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ad728-9db6-4167-9d9f-264d8bda0bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:14.664342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ad728-9db6-4167-9d9f-264d8bda0bb8 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:14.665678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 163/320] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:14.670902 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d0f8e-a89e-41b2-a154-001cf1450408 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:14.671198 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d0f8e-a89e-41b2-a154-001cf1450408 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:14.671482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d0f8e-a89e-41b2-a154-001cf1450408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:14.671982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-d2f12dc2-c7ce-4227-b000-d64ff004417d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:14.673179 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-d2f12dc2-c7ce-4227-b000-d64ff004417d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:14.689260 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-f90d0f8e-a89e-41b2-a154-001cf1450408 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:14.690441 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-f90d0f8e-a89e-41b2-a154-001cf1450408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:14.745442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 158/321] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:14.754658 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a706cf-1242-473a-a407-a06568f49798 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:14.754975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a706cf-1242-473a-a407-a06568f49798 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:14.755265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a706cf-1242-473a-a407-a06568f49798 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:14.756559 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 159/322] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:41:14.762777 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 164/323] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:41:14.762925 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823d1e7-9801-4fd4-a98f-c08ef5377656 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:14.762925 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823d1e7-9801-4fd4-a98f-c08ef5377656 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:14.762925 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823d1e7-9801-4fd4-a98f-c08ef5377656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:14.772415 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d0f8e-a89e-41b2-a154-001cf1450408 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:14.782815 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-1823d1e7-9801-4fd4-a98f-c08ef5377656 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:14.784392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-1823d1e7-9801-4fd4-a98f-c08ef5377656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:14.787675 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:14.851061 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 160/324] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:41:14.853137 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823d1e7-9801-4fd4-a98f-c08ef5377656 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:14.871783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d0f8e-a89e-41b2-a154-001cf1450408 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:14.885593 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:14.909154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d35b8-6e4c-4377-953e-d8d4b059b5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:14.909790 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d35b8-6e4c-4377-953e-d8d4b059b5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:14.910077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d35b8-6e4c-4377-953e-d8d4b059b5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:14.910353 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d35b8-6e4c-4377-953e-d8d4b059b5f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:14.921156 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d35b8-6e4c-4377-953e-d8d4b059b5f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:14.926090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-b12d35b8-6e4c-4377-953e-d8d4b059b5f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:14.926090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:14.926090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:14.926090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:14.926090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:14.926090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:14.926090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:14.926090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:14.926090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:14.926090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:14.926090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:14.926090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:14.926090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:14.926090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:14.926090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:14.926090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:14.926967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:14.926967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:14.926967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:14.926967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:14.926967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:14.926967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:14.926967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:14.926967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:14.926967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:14.926967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:14.926967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:14.926967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:14.926967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:14.926967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:14.926967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:14.926967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:14.928058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:14.928058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:14.928058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:14.928058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:14.928058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:14.928058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:14.928058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:14.928058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:14.928058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:14.928058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:14.928058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:14.928058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:14.928058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 165/325] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:14.928058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d35b8-6e4c-4377-953e-d8d4b059b5f5 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:14.952691 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823d1e7-9801-4fd4-a98f-c08ef5377656 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:14.985080 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4b724-6b10-45e1-8a4c-d644762eac17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:14.985712 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4b724-6b10-45e1-8a4c-d644762eac17 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:14.985990 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4b724-6b10-45e1-8a4c-d644762eac17 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:14.986261 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4b724-6b10-45e1-8a4c-d644762eac17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:14.987408 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4b724-6b10-45e1-8a4c-d644762eac17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:14.988876 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4b724-6b10-45e1-8a4c-d644762eac17 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:14.990448 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 161/326] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:14.991230 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4b724-6b10-45e1-8a4c-d644762eac17 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:15.005224 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:15.030087 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d35b8-6e4c-4377-953e-d8d4b059b5f5 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:15.063309 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a0be7-0785-4aa1-91ff-f9d09633ec59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:15.063948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a0be7-0785-4aa1-91ff-f9d09633ec59 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:15.064576 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a0be7-0785-4aa1-91ff-f9d09633ec59 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:15.064929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a0be7-0785-4aa1-91ff-f9d09633ec59 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:15.075251 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a0be7-0785-4aa1-91ff-f9d09633ec59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:15.080565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-f86a0be7-0785-4aa1-91ff-f9d09633ec59 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:41:15.080565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:15.080565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:15.080565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:15.080565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:15.080565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:15.080565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:15.080565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:15.080565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:15.080565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:15.080565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:15.080565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:15.080565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:15.080565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:15.080565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:15.080565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:15.081546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:15.081546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:15.081546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:15.081546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:15.081546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:15.081546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:15.081546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:15.081546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:15.081546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:15.081546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:15.081546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:15.081546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:15.081546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:15.081546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:15.081546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:15.081546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:15.082632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:15.082632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:15.082632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:15.082632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:15.082632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:15.082632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:15.082632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:15.082632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:15.082632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:15.082632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:15.082632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:41:15.082632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:15.082632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 166/327] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:15.082632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a0be7-0785-4aa1-91ff-f9d09633ec59 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:15.103728 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4b724-6b10-45e1-8a4c-d644762eac17 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:15.114886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:15.139171 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8656fa6-9969-4bba-b2b2-f9276ccc8ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:15.139789 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8656fa6-9969-4bba-b2b2-f9276ccc8ead None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:15.140073 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8656fa6-9969-4bba-b2b2-f9276ccc8ead None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:15.140350 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8656fa6-9969-4bba-b2b2-f9276ccc8ead None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:15.141169 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8656fa6-9969-4bba-b2b2-f9276ccc8ead None admin] RBAC: Adding query filter params (name=member) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:15.141493 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8656fa6-9969-4bba-b2b2-f9276ccc8ead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:15.142895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8656fa6-9969-4bba-b2b2-f9276ccc8ead None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:15.153430 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 162/328] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:41:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:15.153430 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8656fa6-9969-4bba-b2b2-f9276ccc8ead None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:15.191229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a0be7-0785-4aa1-91ff-f9d09633ec59 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:15.222674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:15.223969 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6d0f1-c528-4d67-977b-2abdd8057f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:15.224573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6d0f1-c528-4d67-977b-2abdd8057f56 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:15.224854 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6d0f1-c528-4d67-977b-2abdd8057f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:15.225126 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6d0f1-c528-4d67-977b-2abdd8057f56 None admin] PATH_INFO: `/v3/groups` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:15.225787 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6d0f1-c528-4d67-977b-2abdd8057f56 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:15.227291 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6d0f1-c528-4d67-977b-2abdd8057f56 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:15.253547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8656fa6-9969-4bba-b2b2-f9276ccc8ead None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:15.286112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ab580-9160-4955-b864-b281ec3703c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:15.286724 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ab580-9160-4955-b864-b281ec3703c7 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:15.287040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ab580-9160-4955-b864-b281ec3703c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:15.287323 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ab580-9160-4955-b864-b281ec3703c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:15.288042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ab580-9160-4955-b864-b281ec3703c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:15.288353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ab580-9160-4955-b864-b281ec3703c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:15.290218 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ab580-9160-4955-b864-b281ec3703c7 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:15.298398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 163/329] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:41:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:15.299209 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ab580-9160-4955-b864-b281ec3703c7 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:15.332805 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 167/330] 10.222.0.64 () {60 vars in 1134 bytes} [Wed Aug 3 12:41:15 2022] POST /identity/v3/groups => generated 226 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:41:15.332805 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6d0f1-c528-4d67-977b-2abdd8057f56 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:15.441374 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ab580-9160-4955-b864-b281ec3703c7 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:15.462627 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:15.478914 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6d0f1-c528-4d67-977b-2abdd8057f56 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:15.487739 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:15.494484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349ced4-353f-4caa-a008-8518f4d7fbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:15.496240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349ced4-353f-4caa-a008-8518f4d7fbc0 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:15.496529 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349ced4-353f-4caa-a008-8518f4d7fbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:15.496808 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349ced4-353f-4caa-a008-8518f4d7fbc0 None admin] PATH_INFO: `/v3/users/e50547688e124a7489259510e2c76886` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:15.498019 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349ced4-353f-4caa-a008-8518f4d7fbc0 None admin] RBAC: Authorizing `identity:get_user(user_id=e50547688e124a7489259510e2c76886)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:15.499571 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349ced4-353f-4caa-a008-8518f4d7fbc0 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:15.501358 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 164/331] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:41:15 2022] GET /identity/v3/users/e50547688e124a7489259510e2c76886 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:15.507342 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349ced4-353f-4caa-a008-8518f4d7fbc0 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:15.549487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6a045-b47b-4dfd-9e52-1d0986cc667f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:15.550647 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6a045-b47b-4dfd-9e52-1d0986cc667f None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:15.550968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6a045-b47b-4dfd-9e52-1d0986cc667f None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:15.551257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6a045-b47b-4dfd-9e52-1d0986cc667f None admin] PATH_INFO: `/v3/users/407334bbff06485e8c8e430b62627a35` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:15.552843 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6a045-b47b-4dfd-9e52-1d0986cc667f None admin] RBAC: Authorizing `identity:get_user(user_id=407334bbff06485e8c8e430b62627a35)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:15.555243 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6a045-b47b-4dfd-9e52-1d0986cc667f None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:15.557704 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 168/332] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:41:15 2022] GET /identity/v3/users/407334bbff06485e8c8e430b62627a35 => generated 293 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:15.564287 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6a045-b47b-4dfd-9e52-1d0986cc667f None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:15.632779 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349ced4-353f-4caa-a008-8518f4d7fbc0 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:15.675412 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5c7c8-ee3f-4803-a60a-6043207db02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:15.676032 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5c7c8-ee3f-4803-a60a-6043207db02a None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:15.676311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5c7c8-ee3f-4803-a60a-6043207db02a None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:15.676590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5c7c8-ee3f-4803-a60a-6043207db02a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:15.677759 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5c7c8-ee3f-4803-a60a-6043207db02a None admin] RBAC: Adding query filter params (role.id=26c9fe6916a4412d96492e41ff62cca6, user.id=e50547688e124a7489259510e2c76886, scope.system=all) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:15.677759 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5c7c8-ee3f-4803-a60a-6043207db02a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:15.679756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5c7c8-ee3f-4803-a60a-6043207db02a None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:15.696696 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6a045-b47b-4dfd-9e52-1d0986cc667f None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:15.697169 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 165/333] 10.222.0.64 () {56 vars in 1308 bytes} [Wed Aug 3 12:41:15 2022] GET /identity/v3/role_assignments?user.id=e50547688e124a7489259510e2c76886&scope.system=all&role.id=26c9fe6916a4412d96492e41ff62cca6 => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:15.742040 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93935dd2-8eed-4012-8eed-5a4d19a165e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:15.743082 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93935dd2-8eed-4012-8eed-5a4d19a165e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:15.743512 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93935dd2-8eed-4012-8eed-5a4d19a165e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:15.743959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93935dd2-8eed-4012-8eed-5a4d19a165e7 None admin] PATH_INFO: `/v3/system/users/407334bbff06485e8c8e430b62627a35/roles/a68c1386e9434ef9b5aff7d46f61c2b4` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:15.746267 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93935dd2-8eed-4012-8eed-5a4d19a165e7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=407334bbff06485e8c8e430b62627a35, role_id=a68c1386e9434ef9b5aff7d46f61c2b4)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:15.747919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93935dd2-8eed-4012-8eed-5a4d19a165e7 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:15.830212 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 169/334] 10.222.0.64 () {58 vars in 1334 bytes} [Wed Aug 3 12:41:15 2022] PUT /identity/v3/system/users/407334bbff06485e8c8e430b62627a35/roles/a68c1386e9434ef9b5aff7d46f61c2b4 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:41:17.929422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdefb0c-31ef-4577-ac8a-50e0615de831 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:17.929968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdefb0c-31ef-4577-ac8a-50e0615de831 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:17.930045 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdefb0c-31ef-4577-ac8a-50e0615de831 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:17.931773 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 166/335] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:17.936658 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0824c0a-a986-491c-9408-31345db6a36c None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:17.937096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0824c0a-a986-491c-9408-31345db6a36c None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:17.937287 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0824c0a-a986-491c-9408-31345db6a36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:17.961950 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-b0824c0a-a986-491c-9408-31345db6a36c None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:17.963213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b0824c0a-a986-491c-9408-31345db6a36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:17.982170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:17.990886 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59115fe4-944a-4d9c-9e2d-23f9590c480c None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:17.991178 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59115fe4-944a-4d9c-9e2d-23f9590c480c None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:17.991456 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59115fe4-944a-4d9c-9e2d-23f9590c480c None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:17.992938 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 167/336] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:18.000009 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325b67c-6e13-4193-a200-29aac90304fe None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:18.000306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325b67c-6e13-4193-a200-29aac90304fe None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:18.000562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325b67c-6e13-4193-a200-29aac90304fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:18.042877 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 170/337] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:18.044510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-4325b67c-6e13-4193-a200-29aac90304fe None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:18.045764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-4325b67c-6e13-4193-a200-29aac90304fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:18.063135 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0824c0a-a986-491c-9408-31345db6a36c None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:18.178814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:18.193091 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0824c0a-a986-491c-9408-31345db6a36c None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:18.200886 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 168/338] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:18.245256 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc112d-48a2-41e3-9ebe-7223dd3d6d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:18.246161 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc112d-48a2-41e3-9ebe-7223dd3d6d03 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:18.246593 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc112d-48a2-41e3-9ebe-7223dd3d6d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:18.247069 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc112d-48a2-41e3-9ebe-7223dd3d6d03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:18.258372 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc112d-48a2-41e3-9ebe-7223dd3d6d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:18.267882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-99cc112d-48a2-41e3-9ebe-7223dd3d6d03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:18.267882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:18.267882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:18.267882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:18.267882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:18.267882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:18.267882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:18.267882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:18.267882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:18.267882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:18.267882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:18.267882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:18.267882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:18.267882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:18.267882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:18.267882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:18.268982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:18.268982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:18.268982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:18.268982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:18.268982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:18.268982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:18.268982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:18.268982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:18.268982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:18.268982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:18.268982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:18.268982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:18.268982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:18.268982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:18.268982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:18.268982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:18.269957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:18.269957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:18.269957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:18.269957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:18.269957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:18.269957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:18.269957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:18.269957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:18.269957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:18.269957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:18.269957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:18.269957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:18.272293 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 171/339] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:18.278782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325b67c-6e13-4193-a200-29aac90304fe None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:18.290353 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc112d-48a2-41e3-9ebe-7223dd3d6d03 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:18.321169 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:18.452104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325b67c-6e13-4193-a200-29aac90304fe None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:18.517060 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d670f5-0c50-4a61-aaed-d3c522048467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:18.517699 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d670f5-0c50-4a61-aaed-d3c522048467 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:18.517989 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d670f5-0c50-4a61-aaed-d3c522048467 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:18.518273 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d670f5-0c50-4a61-aaed-d3c522048467 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:18.519049 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d670f5-0c50-4a61-aaed-d3c522048467 None admin] RBAC: Adding query filter params (name=member) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:18.519367 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d670f5-0c50-4a61-aaed-d3c522048467 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:18.520753 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d670f5-0c50-4a61-aaed-d3c522048467 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:18.530926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc112d-48a2-41e3-9ebe-7223dd3d6d03 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:18.538294 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 169/340] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:41:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:18.547765 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d670f5-0c50-4a61-aaed-d3c522048467 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:18.581707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6314e-e227-489a-9d35-84a08e822ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:18.582364 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6314e-e227-489a-9d35-84a08e822ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:18.582644 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6314e-e227-489a-9d35-84a08e822ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:18.583106 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6314e-e227-489a-9d35-84a08e822ad3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:18.613960 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6314e-e227-489a-9d35-84a08e822ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:18.620926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-c6a6314e-e227-489a-9d35-84a08e822ad3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:41:18.620926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:18.620926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:18.620926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:18.620926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:18.620926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:18.620926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:18.620926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:18.620926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:18.620926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:18.620926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:18.620926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:18.620926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:18.620926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:18.620926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:18.620926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:18.621849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:18.621849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:18.621849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:18.621849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:18.621849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:18.621849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:18.621849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:18.621849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:18.621849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:18.621849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:18.621849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:18.621849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:18.621849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:18.621849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:18.621849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:18.621849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:18.622645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:18.622645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:18.622645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:18.622645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:18.622645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:18.622645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:18.622645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:18.622645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:18.622645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:18.622645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:18.622645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:41:18.622645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:18.624115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 172/341] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:18.625335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977400f9-7f75-4aee-8b3b-4a76a85183c8 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:18.625621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977400f9-7f75-4aee-8b3b-4a76a85183c8 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:18.625900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977400f9-7f75-4aee-8b3b-4a76a85183c8 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:18.627351 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 173/342] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:18.627891 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977400f9-7f75-4aee-8b3b-4a76a85183c8 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:18.647101 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:18.746134 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d670f5-0c50-4a61-aaed-d3c522048467 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:18.748300 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:18.789525 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977400f9-7f75-4aee-8b3b-4a76a85183c8 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:18.797551 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60790e61-4b86-46e2-9da6-355c179dec36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:18.798632 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60790e61-4b86-46e2-9da6-355c179dec36 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:18.798947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60790e61-4b86-46e2-9da6-355c179dec36 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:18.799228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60790e61-4b86-46e2-9da6-355c179dec36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:18.834604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42a2f9-f71b-4530-9b78-695ac0a58114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:18.835410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42a2f9-f71b-4530-9b78-695ac0a58114 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:18.835709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42a2f9-f71b-4530-9b78-695ac0a58114 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:18.836001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42a2f9-f71b-4530-9b78-695ac0a58114 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:18.836741 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42a2f9-f71b-4530-9b78-695ac0a58114 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:18.837062 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42a2f9-f71b-4530-9b78-695ac0a58114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:18.838488 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42a2f9-f71b-4530-9b78-695ac0a58114 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:18.853028 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 174/343] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:41:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:18.854607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e945df-6991-45a5-b6e2-de0c642c9cd7 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:18.854916 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e945df-6991-45a5-b6e2-de0c642c9cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:18.855207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e945df-6991-45a5-b6e2-de0c642c9cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:18.877377 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-20e945df-6991-45a5-b6e2-de0c642c9cd7 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:18.878698 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-20e945df-6991-45a5-b6e2-de0c642c9cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:18.896667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60790e61-4b86-46e2-9da6-355c179dec36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:18.898198 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60790e61-4b86-46e2-9da6-355c179dec36 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:18.963846 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:18.984595 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 175/344] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:18.986570 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62bf58-9cb8-4db9-8f6c-93f93c515b63 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:18.987084 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62bf58-9cb8-4db9-8f6c-93f93c515b63 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:18.987545 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62bf58-9cb8-4db9-8f6c-93f93c515b63 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:18.989242 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 176/345] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:18.990160 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62bf58-9cb8-4db9-8f6c-93f93c515b63 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:19.027838 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 170/346] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:19.029673 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8667a5-baeb-4bc5-b6b7-661f2c368a20 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:19.030231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8667a5-baeb-4bc5-b6b7-661f2c368a20 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:19.031061 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8667a5-baeb-4bc5-b6b7-661f2c368a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:19.053458 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-8c8667a5-baeb-4bc5-b6b7-661f2c368a20 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:19.055519 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-8c8667a5-baeb-4bc5-b6b7-661f2c368a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:19.093575 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:19.143091 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62bf58-9cb8-4db9-8f6c-93f93c515b63 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:19.152154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 171/347] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:19.159457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8667a5-baeb-4bc5-b6b7-661f2c368a20 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:19.208320 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f80d41-9b7f-44ab-91b8-404c90a3a238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:19.208979 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f80d41-9b7f-44ab-91b8-404c90a3a238 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:19.209267 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f80d41-9b7f-44ab-91b8-404c90a3a238 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:19.209545 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f80d41-9b7f-44ab-91b8-404c90a3a238 None admin] PATH_INFO: `/v3/users/407334bbff06485e8c8e430b62627a35` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:19.210770 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f80d41-9b7f-44ab-91b8-404c90a3a238 None admin] RBAC: Authorizing `identity:get_user(user_id=407334bbff06485e8c8e430b62627a35)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:19.212310 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f80d41-9b7f-44ab-91b8-404c90a3a238 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:19.214219 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 177/348] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:41:18 2022] GET /identity/v3/users/407334bbff06485e8c8e430b62627a35 => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:19.215101 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f80d41-9b7f-44ab-91b8-404c90a3a238 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:19.268209 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:19.300957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8667a5-baeb-4bc5-b6b7-661f2c368a20 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:19.344827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f80d41-9b7f-44ab-91b8-404c90a3a238 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:19.348349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f804d62-c572-4b30-9633-28767a95bc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:19.349005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804d62-c572-4b30-9633-28767a95bc0f None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:19.349290 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804d62-c572-4b30-9633-28767a95bc0f None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:19.350308 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804d62-c572-4b30-9633-28767a95bc0f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:19.364714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f804d62-c572-4b30-9633-28767a95bc0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:19.371982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-4f804d62-c572-4b30-9633-28767a95bc0f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:41:19.371982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:19.371982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:19.371982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:19.371982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:19.371982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:19.371982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:19.371982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:19.371982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:19.371982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:19.371982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:19.371982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:19.371982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:19.371982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:19.371982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:19.371982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:19.372904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:19.372904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:19.372904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:19.372904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:19.372904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:19.372904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:19.372904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:19.372904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:19.372904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:19.372904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:19.372904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:19.372904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:19.372904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:19.372904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:19.372904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:19.372904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:19.373714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:19.373714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:19.373714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:19.373714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:19.373714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:19.373714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:19.373714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:19.373714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:19.373714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:19.373714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:19.373714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:41:19.373714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:19.373714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 172/349] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:41:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:19.375483 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123d329-96c2-49fa-bf8f-1cc6c367d7f0 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:19.375777 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123d329-96c2-49fa-bf8f-1cc6c367d7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:19.376060 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123d329-96c2-49fa-bf8f-1cc6c367d7f0 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:19.377494 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 173/350] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:19.382234 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123d329-96c2-49fa-bf8f-1cc6c367d7f0 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:19.396005 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:19.402182 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d6b8f-ff62-48b5-a3d5-ca6772f20493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:19.403042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d6b8f-ff62-48b5-a3d5-ca6772f20493 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:19.403498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d6b8f-ff62-48b5-a3d5-ca6772f20493 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:19.404718 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d6b8f-ff62-48b5-a3d5-ca6772f20493 None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:19.407673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d6b8f-ff62-48b5-a3d5-ca6772f20493 None admin] RBAC: Authorizing `identity:get_project(project_id=d6b0a8a1377b4435987dffefaad3e6d7)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:19.407795 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d6b8f-ff62-48b5-a3d5-ca6772f20493 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:19.409854 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 178/351] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:19 2022] GET /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:19.410551 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d6b8f-ff62-48b5-a3d5-ca6772f20493 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:19.524168 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123d329-96c2-49fa-bf8f-1cc6c367d7f0 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:19.552003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d6b8f-ff62-48b5-a3d5-ca6772f20493 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:19.572986 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3bf5b-8255-4b0c-98fc-e35ce483d7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:19.572986 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3bf5b-8255-4b0c-98fc-e35ce483d7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:19.572986 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3bf5b-8255-4b0c-98fc-e35ce483d7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:19.572986 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3bf5b-8255-4b0c-98fc-e35ce483d7e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:19.581938 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:19.588789 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3bf5b-8255-4b0c-98fc-e35ce483d7e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:19.592076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-38a3bf5b-8255-4b0c-98fc-e35ce483d7e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:19.592076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:19.592076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:19.592076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:19.592076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:19.592076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:19.592076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:19.592076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:19.592076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:19.592076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:19.592076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:19.592076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:19.592076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:19.592076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:19.592076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:19.592076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:19.598283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:19.598283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:19.598283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:19.598283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:19.598283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:19.598283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:19.598283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:19.598283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:19.598283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:19.598283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:19.598283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:19.598283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:19.598283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:19.598283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:19.598283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:19.598283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:19.599463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:19.599463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:19.599463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:19.599463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:19.599463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:19.599463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:19.599463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:19.599463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:19.599463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:19.599463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:19.599463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:19.599463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:19.599463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 174/352] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:19.599463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3bf5b-8255-4b0c-98fc-e35ce483d7e2 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:19.602542 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20414c0e-89ec-4a90-b478-690bb718ffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:19.603233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20414c0e-89ec-4a90-b478-690bb718ffe5 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:19.603521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20414c0e-89ec-4a90-b478-690bb718ffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:19.603961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20414c0e-89ec-4a90-b478-690bb718ffe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:19.604767 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20414c0e-89ec-4a90-b478-690bb718ffe5 None admin] RBAC: Adding query filter params (role.id=a68c1386e9434ef9b5aff7d46f61c2b4, user.id=407334bbff06485e8c8e430b62627a35, scope.system=all) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:19.605083 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20414c0e-89ec-4a90-b478-690bb718ffe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:19.606524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20414c0e-89ec-4a90-b478-690bb718ffe5 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:19.625059 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 179/353] 10.222.0.64 () {56 vars in 1308 bytes} [Wed Aug 3 12:41:19 2022] GET /identity/v3/role_assignments?user.id=407334bbff06485e8c8e430b62627a35&scope.system=all&role.id=a68c1386e9434ef9b5aff7d46f61c2b4 => generated 510 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:19.626287 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48262863-81a0-4ad8-bcf2-f9880230f881 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:19.626586 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48262863-81a0-4ad8-bcf2-f9880230f881 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:19.626899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48262863-81a0-4ad8-bcf2-f9880230f881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:19.646563 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-48262863-81a0-4ad8-bcf2-f9880230f881 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:19.648432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-48262863-81a0-4ad8-bcf2-f9880230f881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:19.720692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:19.744675 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 180/354] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:19.745054 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48262863-81a0-4ad8-bcf2-f9880230f881 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:19.767868 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3bf5b-8255-4b0c-98fc-e35ce483d7e2 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:19.810833 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7112e-0749-4138-9fa2-f459dec1c40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:19.811777 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7112e-0749-4138-9fa2-f459dec1c40c None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:19.812274 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7112e-0749-4138-9fa2-f459dec1c40c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:19.812747 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7112e-0749-4138-9fa2-f459dec1c40c None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:19.813671 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7112e-0749-4138-9fa2-f459dec1c40c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:19.814216 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7112e-0749-4138-9fa2-f459dec1c40c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:19.815966 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7112e-0749-4138-9fa2-f459dec1c40c None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:19.827422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 175/355] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:19.828674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7112e-0749-4138-9fa2-f459dec1c40c None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:19.900871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48262863-81a0-4ad8-bcf2-f9880230f881 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:19.907098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:19.938579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c30f56-9f86-489b-988f-bd1dcad75fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:19.939260 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c30f56-9f86-489b-988f-bd1dcad75fae None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:19.939552 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c30f56-9f86-489b-988f-bd1dcad75fae None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:19.939833 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c30f56-9f86-489b-988f-bd1dcad75fae None admin] PATH_INFO: `/v3/groups/3080b1f107a643b6b02ea7206339ecf5` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:19.947102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c30f56-9f86-489b-988f-bd1dcad75fae None admin] RBAC: Authorizing `identity:get_group(group_id=3080b1f107a643b6b02ea7206339ecf5)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:19.948893 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c30f56-9f86-489b-988f-bd1dcad75fae None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:19.950590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 181/356] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 3 12:41:19 2022] GET /identity/v3/groups/3080b1f107a643b6b02ea7206339ecf5 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:19.952909 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7112e-0749-4138-9fa2-f459dec1c40c None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:19.956316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c30f56-9f86-489b-988f-bd1dcad75fae None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:19.989797 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97160e2-a361-4315-99a9-4b2a8aa43b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:19.990465 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97160e2-a361-4315-99a9-4b2a8aa43b4b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:19.990792 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97160e2-a361-4315-99a9-4b2a8aa43b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:19.991058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97160e2-a361-4315-99a9-4b2a8aa43b4b None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:19.991878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97160e2-a361-4315-99a9-4b2a8aa43b4b None admin] RBAC: Adding query filter params (name=member) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:19.992189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97160e2-a361-4315-99a9-4b2a8aa43b4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:19.993584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97160e2-a361-4315-99a9-4b2a8aa43b4b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:20.002220 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 176/357] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:41:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:20.003118 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97160e2-a361-4315-99a9-4b2a8aa43b4b None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:20.017139 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:20.074703 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c30f56-9f86-489b-988f-bd1dcad75fae None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:20.116169 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0f110-2835-4d4e-9f4e-c479f8dc8684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:20.116866 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0f110-2835-4d4e-9f4e-c479f8dc8684 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:20.117151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0f110-2835-4d4e-9f4e-c479f8dc8684 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:20.118025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0f110-2835-4d4e-9f4e-c479f8dc8684 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:20.128087 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0f110-2835-4d4e-9f4e-c479f8dc8684 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:20.129971 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97160e2-a361-4315-99a9-4b2a8aa43b4b None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:20.135105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-94a0f110-2835-4d4e-9f4e-c479f8dc8684 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:41:20.135105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:20.135105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:20.135105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:20.135105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:20.135105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:20.135105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:20.135105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:20.135105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:20.135105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:20.135105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:20.135105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:20.135105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:20.135105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:20.135105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:20.135105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:20.136237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:20.136237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:20.136237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:20.136237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:20.136237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:20.136237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:20.136237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:20.136237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:20.136237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:20.136237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:20.136237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:20.136237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:20.136237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:20.136237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:20.136237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:20.136237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:20.137204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:20.137204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:20.137204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:20.137204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:20.137204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:20.137204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:20.137204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:20.137204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:20.137204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:20.137204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:20.137204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:41:20.137204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:20.138810 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 182/358] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:41:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:20.141504 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274e559-e469-47d9-89ea-8af39a58ccb8 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:20.141799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274e559-e469-47d9-89ea-8af39a58ccb8 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:20.142082 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274e559-e469-47d9-89ea-8af39a58ccb8 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:20.145695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 183/359] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:20.146331 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274e559-e469-47d9-89ea-8af39a58ccb8 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:20.163874 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:20.179623 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98b164-022b-4fd7-8fbe-858c53dbdd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:20.180311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98b164-022b-4fd7-8fbe-858c53dbdd4d None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:20.180568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98b164-022b-4fd7-8fbe-858c53dbdd4d None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:20.180854 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98b164-022b-4fd7-8fbe-858c53dbdd4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:20.266784 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a98b164-022b-4fd7-8fbe-858c53dbdd4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:20.268315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a98b164-022b-4fd7-8fbe-858c53dbdd4d None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:20.273177 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274e559-e469-47d9-89ea-8af39a58ccb8 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:20.286836 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:20.313272 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea12032-1300-4218-a0f9-4da158e68876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:20.313907 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea12032-1300-4218-a0f9-4da158e68876 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:20.314195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea12032-1300-4218-a0f9-4da158e68876 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:20.314478 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea12032-1300-4218-a0f9-4da158e68876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:20.315751 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea12032-1300-4218-a0f9-4da158e68876 None admin] RBAC: Adding query filter params (group.id=3080b1f107a643b6b02ea7206339ecf5, role.id=26c9fe6916a4412d96492e41ff62cca6, scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:20.315751 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea12032-1300-4218-a0f9-4da158e68876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:20.317077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea12032-1300-4218-a0f9-4da158e68876 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:20.323356 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 184/360] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 3 12:41:20 2022] GET /identity/v3/role_assignments?group.id=3080b1f107a643b6b02ea7206339ecf5&scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7&role.id=26c9fe6916a4412d96492e41ff62cca6 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:20.324459 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea12032-1300-4218-a0f9-4da158e68876 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:20.402654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 177/361] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:20.403501 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98b164-022b-4fd7-8fbe-858c53dbdd4d None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:20.445992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:20.476490 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea12032-1300-4218-a0f9-4da158e68876 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:20.528921 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783974fe-4032-4b4c-8041-4cc79068b598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:20.529559 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783974fe-4032-4b4c-8041-4cc79068b598 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:20.529847 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783974fe-4032-4b4c-8041-4cc79068b598 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:20.530132 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783974fe-4032-4b4c-8041-4cc79068b598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:20.557949 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98b164-022b-4fd7-8fbe-858c53dbdd4d None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:20.584147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:20.596710 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864053fc-9825-46d8-99a7-1df685b6ed67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:20.597334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864053fc-9825-46d8-99a7-1df685b6ed67 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:20.597878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864053fc-9825-46d8-99a7-1df685b6ed67 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:20.597878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864053fc-9825-46d8-99a7-1df685b6ed67 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:20.604440 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864053fc-9825-46d8-99a7-1df685b6ed67 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:20.604440 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864053fc-9825-46d8-99a7-1df685b6ed67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:20.604440 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864053fc-9825-46d8-99a7-1df685b6ed67 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:20.609525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 178/362] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:20.611233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783974fe-4032-4b4c-8041-4cc79068b598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:20.612382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe5d7a-cfc8-46e8-b22e-00b909a28186 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:20.612671 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe5d7a-cfc8-46e8-b22e-00b909a28186 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:20.612776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783974fe-4032-4b4c-8041-4cc79068b598 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:20.612948 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe5d7a-cfc8-46e8-b22e-00b909a28186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:20.636081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-7dfe5d7a-cfc8-46e8-b22e-00b909a28186 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:20.637583 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-7dfe5d7a-cfc8-46e8-b22e-00b909a28186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:20.729373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 179/363] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:20.730250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe5d7a-cfc8-46e8-b22e-00b909a28186 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:20.731434 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 185/364] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:20.732270 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783974fe-4032-4b4c-8041-4cc79068b598 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:20.751931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:20.837228 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:20.862336 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe5d7a-cfc8-46e8-b22e-00b909a28186 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:20.867870 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783974fe-4032-4b4c-8041-4cc79068b598 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:20.904681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1179702-f499-4fa1-9a26-0880b4063f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:20.905335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1179702-f499-4fa1-9a26-0880b4063f89 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:20.905621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1179702-f499-4fa1-9a26-0880b4063f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:20.905901 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1179702-f499-4fa1-9a26-0880b4063f89 None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:20.907135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1179702-f499-4fa1-9a26-0880b4063f89 None admin] RBAC: Authorizing `identity:get_project(project_id=d6b0a8a1377b4435987dffefaad3e6d7)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:20.909087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1179702-f499-4fa1-9a26-0880b4063f89 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:20.911300 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 180/365] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:20 2022] GET /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:20.912080 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1179702-f499-4fa1-9a26-0880b4063f89 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:20.920413 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488f065-880e-42ef-8194-2ffc78947eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:20.921059 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488f065-880e-42ef-8194-2ffc78947eeb None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:20.921349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488f065-880e-42ef-8194-2ffc78947eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:20.921635 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488f065-880e-42ef-8194-2ffc78947eeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:21.020414 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488f065-880e-42ef-8194-2ffc78947eeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:21.022625 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488f065-880e-42ef-8194-2ffc78947eeb None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:21.023312 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:21.048855 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1179702-f499-4fa1-9a26-0880b4063f89 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:21.090923 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8d05d-acb9-44e8-87b7-aea9f4c860b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:21.091885 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8d05d-acb9-44e8-87b7-aea9f4c860b6 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:21.092176 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8d05d-acb9-44e8-87b7-aea9f4c860b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:21.092458 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8d05d-acb9-44e8-87b7-aea9f4c860b6 None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:21.093657 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8d05d-acb9-44e8-87b7-aea9f4c860b6 None admin] RBAC: Authorizing `identity:get_project(project_id=eec5a65c35a046b4b2021380c24c36ab)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:21.098005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8d05d-acb9-44e8-87b7-aea9f4c860b6 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:21.098421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 181/366] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:20 2022] GET /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:21.099388 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8d05d-acb9-44e8-87b7-aea9f4c860b6 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:21.130621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:21.162113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 186/367] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:21.167998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488f065-880e-42ef-8194-2ffc78947eeb None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:21.252280 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8d05d-acb9-44e8-87b7-aea9f4c860b6 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:21.294225 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488f065-880e-42ef-8194-2ffc78947eeb None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:21.300576 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560e598-5dbc-4a4b-ba49-afaad053d899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:21.301229 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560e598-5dbc-4a4b-ba49-afaad053d899 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:21.301510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560e598-5dbc-4a4b-ba49-afaad053d899 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:21.302283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560e598-5dbc-4a4b-ba49-afaad053d899 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:21.323221 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560e598-5dbc-4a4b-ba49-afaad053d899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:21.329380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-5560e598-5dbc-4a4b-ba49-afaad053d899 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:41:21.329380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:21.329380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:21.329380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:21.329380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:21.329380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:21.329380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:21.329380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:21.329380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:21.329380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:21.329380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:21.329380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:21.329380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:21.329380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:21.329380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:21.329380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:21.330286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:21.330286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:21.330286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:21.330286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:21.330286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:21.330286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:21.330286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:21.330286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:21.330286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:21.330286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:21.330286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:21.330286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:21.330286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:21.330286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:21.330286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:21.330286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:21.331112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:21.331112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:21.331112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:21.331112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:21.331112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:21.331112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:21.331112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:21.331112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:21.331112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:21.331112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:21.331112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:41:21.331112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:21.331112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 182/368] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:41:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:21.331760 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560e598-5dbc-4a4b-ba49-afaad053d899 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:21.342813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd472af6-0ace-4d3d-b77f-609beb4c961a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:21.343826 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd472af6-0ace-4d3d-b77f-609beb4c961a None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:21.344332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd472af6-0ace-4d3d-b77f-609beb4c961a None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:21.344812 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd472af6-0ace-4d3d-b77f-609beb4c961a None admin] PATH_INFO: `/v3/groups/3080b1f107a643b6b02ea7206339ecf5` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:21.346199 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd472af6-0ace-4d3d-b77f-609beb4c961a None admin] RBAC: Authorizing `identity:get_group(group_id=3080b1f107a643b6b02ea7206339ecf5)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:21.347782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd472af6-0ace-4d3d-b77f-609beb4c961a None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:21.348140 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:21.354584 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 187/369] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 3 12:41:21 2022] GET /identity/v3/groups/3080b1f107a643b6b02ea7206339ecf5 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:21.354584 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd472af6-0ace-4d3d-b77f-609beb4c961a None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:21.404676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:21.473966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd472af6-0ace-4d3d-b77f-609beb4c961a None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:21.478110 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560e598-5dbc-4a4b-ba49-afaad053d899 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:21.511860 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215c931-f2c3-4db5-b39c-04d27a1ff0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:21.512601 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215c931-f2c3-4db5-b39c-04d27a1ff0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:21.512955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215c931-f2c3-4db5-b39c-04d27a1ff0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:21.513304 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215c931-f2c3-4db5-b39c-04d27a1ff0f2 None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:21.514523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215c931-f2c3-4db5-b39c-04d27a1ff0f2 None admin] RBAC: Authorizing `identity:get_project(project_id=eec5a65c35a046b4b2021380c24c36ab)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:21.514661 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c8598-9075-4c00-8c22-13fe1aa0e49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:21.515341 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c8598-9075-4c00-8c22-13fe1aa0e49f None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:21.515625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c8598-9075-4c00-8c22-13fe1aa0e49f None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:21.515904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c8598-9075-4c00-8c22-13fe1aa0e49f None admin] PATH_INFO: `/v3/groups/3080b1f107a643b6b02ea7206339ecf5` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:21.516068 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215c931-f2c3-4db5-b39c-04d27a1ff0f2 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:21.517065 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c8598-9075-4c00-8c22-13fe1aa0e49f None admin] RBAC: Authorizing `identity:get_group(group_id=3080b1f107a643b6b02ea7206339ecf5)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:21.522464 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 188/370] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:21 2022] GET /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:21.522464 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215c931-f2c3-4db5-b39c-04d27a1ff0f2 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:21.522662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c8598-9075-4c00-8c22-13fe1aa0e49f None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:21.522662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 183/371] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 3 12:41:21 2022] GET /identity/v3/groups/3080b1f107a643b6b02ea7206339ecf5 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:21.522662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c8598-9075-4c00-8c22-13fe1aa0e49f None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:21.611826 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:21.629176 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215c931-f2c3-4db5-b39c-04d27a1ff0f2 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:21.631326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c8598-9075-4c00-8c22-13fe1aa0e49f None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:21.643259 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:21.665067 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383b24c-2b52-416b-aacc-9b00c54f78e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:21.665670 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383b24c-2b52-416b-aacc-9b00c54f78e7 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:21.666217 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383b24c-2b52-416b-aacc-9b00c54f78e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:21.666555 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383b24c-2b52-416b-aacc-9b00c54f78e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:21.666774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb0c72-1e21-460c-a39a-f3ed16f0abf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:21.667337 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383b24c-2b52-416b-aacc-9b00c54f78e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:21.667437 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0c72-1e21-460c-a39a-f3ed16f0abf7 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:21.667639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383b24c-2b52-416b-aacc-9b00c54f78e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:21.667753 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0c72-1e21-460c-a39a-f3ed16f0abf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:21.667924 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0c72-1e21-460c-a39a-f3ed16f0abf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:21.668712 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb0c72-1e21-460c-a39a-f3ed16f0abf7 None admin] RBAC: Adding query filter params (group.id=3080b1f107a643b6b02ea7206339ecf5, role.id=e39a3afcb14442a08e9a24b8a56d17cf, scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:21.668986 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383b24c-2b52-416b-aacc-9b00c54f78e7 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:21.669076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb0c72-1e21-460c-a39a-f3ed16f0abf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:21.670447 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb0c72-1e21-460c-a39a-f3ed16f0abf7 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:21.687380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 184/372] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 3 12:41:21 2022] GET /identity/v3/role_assignments?group.id=3080b1f107a643b6b02ea7206339ecf5&scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7&role.id=e39a3afcb14442a08e9a24b8a56d17cf => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:21.687380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb0c72-1e21-460c-a39a-f3ed16f0abf7 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:21.687628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 189/373] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:21.687628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383b24c-2b52-416b-aacc-9b00c54f78e7 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:21.806335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383b24c-2b52-416b-aacc-9b00c54f78e7 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:21.824820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb0c72-1e21-460c-a39a-f3ed16f0abf7 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:21.845972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01c3a8-5ce0-4cc7-a6cb-531fcc9c0320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:21.846602 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01c3a8-5ce0-4cc7-a6cb-531fcc9c0320 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:21.846919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01c3a8-5ce0-4cc7-a6cb-531fcc9c0320 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:21.847205 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01c3a8-5ce0-4cc7-a6cb-531fcc9c0320 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:21.848003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01c3a8-5ce0-4cc7-a6cb-531fcc9c0320 None admin] RBAC: Adding query filter params (group.id=3080b1f107a643b6b02ea7206339ecf5, role.id=26c9fe6916a4412d96492e41ff62cca6, scope.project.id=eec5a65c35a046b4b2021380c24c36ab) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:21.848320 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01c3a8-5ce0-4cc7-a6cb-531fcc9c0320 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:21.849755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01c3a8-5ce0-4cc7-a6cb-531fcc9c0320 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:21.857601 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 190/374] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 3 12:41:21 2022] GET /identity/v3/role_assignments?group.id=3080b1f107a643b6b02ea7206339ecf5&scope.project.id=eec5a65c35a046b4b2021380c24c36ab&role.id=26c9fe6916a4412d96492e41ff62cca6 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:21.858434 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01c3a8-5ce0-4cc7-a6cb-531fcc9c0320 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:21.871169 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866a4cc-ff64-4954-a2bd-b970f6b6509a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:21.872287 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866a4cc-ff64-4954-a2bd-b970f6b6509a None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:21.872639 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866a4cc-ff64-4954-a2bd-b970f6b6509a None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:21.873237 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866a4cc-ff64-4954-a2bd-b970f6b6509a None admin] PATH_INFO: `/v3/groups/3080b1f107a643b6b02ea7206339ecf5` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:21.874877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866a4cc-ff64-4954-a2bd-b970f6b6509a None admin] RBAC: Authorizing `identity:get_group(group_id=3080b1f107a643b6b02ea7206339ecf5)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:21.877271 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866a4cc-ff64-4954-a2bd-b970f6b6509a None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:21.880057 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 185/375] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 3 12:41:21 2022] GET /identity/v3/groups/3080b1f107a643b6b02ea7206339ecf5 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:21.886081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866a4cc-ff64-4954-a2bd-b970f6b6509a None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:21.903985 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:21.904208 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:21.971096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01c3a8-5ce0-4cc7-a6cb-531fcc9c0320 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:22.011923 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07898db1-ea57-47a7-9d3a-23978d532a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:22.012901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07898db1-ea57-47a7-9d3a-23978d532a83 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:22.013380 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07898db1-ea57-47a7-9d3a-23978d532a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:22.013836 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07898db1-ea57-47a7-9d3a-23978d532a83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:22.081054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866a4cc-ff64-4954-a2bd-b970f6b6509a None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:22.094254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07898db1-ea57-47a7-9d3a-23978d532a83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:22.096409 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07898db1-ea57-47a7-9d3a-23978d532a83 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:22.139455 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:22.159385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18314c-bc09-406e-b7dc-0f8e1a583624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:22.160267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18314c-bc09-406e-b7dc-0f8e1a583624 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:22.160731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18314c-bc09-406e-b7dc-0f8e1a583624 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:22.161196 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18314c-bc09-406e-b7dc-0f8e1a583624 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:22.162170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18314c-bc09-406e-b7dc-0f8e1a583624 None admin] RBAC: Adding query filter params (group.id=3080b1f107a643b6b02ea7206339ecf5, role.id=e39a3afcb14442a08e9a24b8a56d17cf, scope.project.id=eec5a65c35a046b4b2021380c24c36ab) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:22.162659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18314c-bc09-406e-b7dc-0f8e1a583624 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:22.164429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18314c-bc09-406e-b7dc-0f8e1a583624 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:22.172421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 186/376] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 3 12:41:21 2022] GET /identity/v3/role_assignments?group.id=3080b1f107a643b6b02ea7206339ecf5&scope.project.id=eec5a65c35a046b4b2021380c24c36ab&role.id=e39a3afcb14442a08e9a24b8a56d17cf => generated 260 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:22.214199 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 191/377] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:22.219997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18314c-bc09-406e-b7dc-0f8e1a583624 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:22.337505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:22.364981 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18314c-bc09-406e-b7dc-0f8e1a583624 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:22.402356 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eca602-2467-4e94-8d32-5c7c0025b171 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:22.402637 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eca602-2467-4e94-8d32-5c7c0025b171 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:22.402888 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eca602-2467-4e94-8d32-5c7c0025b171 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:22.402988 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1680bb-86f4-449f-bfe0-6d85fd09bfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:22.403653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1680bb-86f4-449f-bfe0-6d85fd09bfa9 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:22.403938 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1680bb-86f4-449f-bfe0-6d85fd09bfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:22.404411 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1680bb-86f4-449f-bfe0-6d85fd09bfa9 None admin] PATH_INFO: `/v3/projects/5d023a6b024c4cbd9df738e8fd9e9a97` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:22.404513 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 192/378] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:22.405409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1680bb-86f4-449f-bfe0-6d85fd09bfa9 None admin] RBAC: Authorizing `identity:get_project(project_id=5d023a6b024c4cbd9df738e8fd9e9a97)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:22.406895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1680bb-86f4-449f-bfe0-6d85fd09bfa9 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:22.408857 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 187/379] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:22 2022] GET /identity/v3/projects/5d023a6b024c4cbd9df738e8fd9e9a97 => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:22.410423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de027a6-a97a-461b-91f5-3435fd055942 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:22.410713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de027a6-a97a-461b-91f5-3435fd055942 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:22.411041 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de027a6-a97a-461b-91f5-3435fd055942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:22.413955 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1680bb-86f4-449f-bfe0-6d85fd09bfa9 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:22.459735 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-7de027a6-a97a-461b-91f5-3435fd055942 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:22.461095 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-7de027a6-a97a-461b-91f5-3435fd055942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:22.520653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1680bb-86f4-449f-bfe0-6d85fd09bfa9 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:22.573738 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129ce52-64d6-4724-86de-bb75d31ee23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:22.574394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129ce52-64d6-4724-86de-bb75d31ee23d None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:22.574681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129ce52-64d6-4724-86de-bb75d31ee23d None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:22.574986 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129ce52-64d6-4724-86de-bb75d31ee23d None admin] PATH_INFO: `/v3/groups/4d521372a26c4915903697752743da32` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:22.586273 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129ce52-64d6-4724-86de-bb75d31ee23d None admin] RBAC: Authorizing `identity:get_group(group_id=4d521372a26c4915903697752743da32)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:22.587762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129ce52-64d6-4724-86de-bb75d31ee23d None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:22.592758 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 188/380] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 3 12:41:22 2022] GET /identity/v3/groups/4d521372a26c4915903697752743da32 => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:22.595658 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129ce52-64d6-4724-86de-bb75d31ee23d None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:22.611115 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:22.621337 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 193/381] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:22.648674 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de027a6-a97a-461b-91f5-3435fd055942 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:22.736429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129ce52-64d6-4724-86de-bb75d31ee23d None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:22.775839 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02cd95-17ee-4134-b870-b84231bf13a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:22.776462 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02cd95-17ee-4134-b870-b84231bf13a8 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:22.776752 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02cd95-17ee-4134-b870-b84231bf13a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:22.777031 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02cd95-17ee-4134-b870-b84231bf13a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:22.777850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02cd95-17ee-4134-b870-b84231bf13a8 None admin] RBAC: Adding query filter params (group.id=4d521372a26c4915903697752743da32, role.id=a6d209169b77456f9f1cc3ff53646cfc, scope.project.id=5d023a6b024c4cbd9df738e8fd9e9a97) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:22.778299 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02cd95-17ee-4134-b870-b84231bf13a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:22.781784 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02cd95-17ee-4134-b870-b84231bf13a8 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:22.786068 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:22.786386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 189/382] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 3 12:41:22 2022] GET /identity/v3/role_assignments?group.id=4d521372a26c4915903697752743da32&scope.project.id=5d023a6b024c4cbd9df738e8fd9e9a97&role.id=a6d209169b77456f9f1cc3ff53646cfc => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:22.857139 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de027a6-a97a-461b-91f5-3435fd055942 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:22.912900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba18f90-7048-440a-87a8-0654308418dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:22.914063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18f90-7048-440a-87a8-0654308418dd None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:22.914496 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18f90-7048-440a-87a8-0654308418dd None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:22.914989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18f90-7048-440a-87a8-0654308418dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:22.938054 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba18f90-7048-440a-87a8-0654308418dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:22.943500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-9ba18f90-7048-440a-87a8-0654308418dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:22.943500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:22.943500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:22.943500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:22.943500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:22.943500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:22.943500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:22.943500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:22.943500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:22.943500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:22.943500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:22.943500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:22.943500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:22.943500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:22.943500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:22.943500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:22.945145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:22.945145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:22.945145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:22.945145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:22.945145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:22.945145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:22.945145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:22.945145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:22.945145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:22.945145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:22.945145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:22.945145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:22.945145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:22.945145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:22.945145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:22.945145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:22.946128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:22.946128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:22.946128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:22.946128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:22.946128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:22.946128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:22.946128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:22.946128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:22.946128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:22.946128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:22.946128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:22.946128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:22.948577 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 194/383] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:22.954522 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02cd95-17ee-4134-b870-b84231bf13a8 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:23.067212 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:23.098518 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02cd95-17ee-4134-b870-b84231bf13a8 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:23.153829 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50defca0-49af-4aae-b529-15e8f4c6711a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:23.154846 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50defca0-49af-4aae-b529-15e8f4c6711a None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:23.155843 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50defca0-49af-4aae-b529-15e8f4c6711a None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:23.155843 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50defca0-49af-4aae-b529-15e8f4c6711a None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:23.158765 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50defca0-49af-4aae-b529-15e8f4c6711a None admin] RBAC: Adding query filter params (name=member) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:23.158765 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50defca0-49af-4aae-b529-15e8f4c6711a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:23.158765 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50defca0-49af-4aae-b529-15e8f4c6711a None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:23.177120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 190/384] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:41:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:23.183255 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba18f90-7048-440a-87a8-0654308418dd None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:23.289114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba18f90-7048-440a-87a8-0654308418dd None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:23.325938 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:23.333790 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2a09b-408e-4d26-abec-e17d1477ba87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:23.334495 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2a09b-408e-4d26-abec-e17d1477ba87 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:23.334808 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2a09b-408e-4d26-abec-e17d1477ba87 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:23.340446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2a09b-408e-4d26-abec-e17d1477ba87 None admin] PATH_INFO: `/v3/groups/3080b1f107a643b6b02ea7206339ecf5` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:23.340446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2a09b-408e-4d26-abec-e17d1477ba87 None admin] RBAC: Authorizing `identity:get_group(group_id=3080b1f107a643b6b02ea7206339ecf5)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:23.340446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2a09b-408e-4d26-abec-e17d1477ba87 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:23.340446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 195/385] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 3 12:41:23 2022] GET /identity/v3/groups/3080b1f107a643b6b02ea7206339ecf5 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:23.345073 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50defca0-49af-4aae-b529-15e8f4c6711a None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:23.475094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50defca0-49af-4aae-b529-15e8f4c6711a None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:23.516396 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d01eb-1498-4a9d-bca6-ccd14994d485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:23.517042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d01eb-1498-4a9d-bca6-ccd14994d485 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:23.517331 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d01eb-1498-4a9d-bca6-ccd14994d485 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:23.517612 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d01eb-1498-4a9d-bca6-ccd14994d485 None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:23.518821 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d01eb-1498-4a9d-bca6-ccd14994d485 None admin] RBAC: Authorizing `identity:get_project(project_id=d6b0a8a1377b4435987dffefaad3e6d7)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:23.520278 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d01eb-1498-4a9d-bca6-ccd14994d485 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:23.522256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 191/386] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:23 2022] GET /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:23.527785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2a09b-408e-4d26-abec-e17d1477ba87 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:23.669587 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2a09b-408e-4d26-abec-e17d1477ba87 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:23.713215 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d518681-858e-4f52-941d-41e7e06533a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:23.713911 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d518681-858e-4f52-941d-41e7e06533a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:23.714201 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d518681-858e-4f52-941d-41e7e06533a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:23.714482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d518681-858e-4f52-941d-41e7e06533a3 None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7/groups/3080b1f107a643b6b02ea7206339ecf5/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:23.716535 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d518681-858e-4f52-941d-41e7e06533a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6b0a8a1377b4435987dffefaad3e6d7, group_id=3080b1f107a643b6b02ea7206339ecf5, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:23.718036 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d518681-858e-4f52-941d-41e7e06533a3 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:23.828772 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 196/387] 10.222.0.64 () {58 vars in 1442 bytes} [Wed Aug 3 12:41:23 2022] PUT /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7/groups/3080b1f107a643b6b02ea7206339ecf5/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:41:24.207960 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533cd46-595c-455a-bb4d-1f775c3fbc84 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:24.208453 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533cd46-595c-455a-bb4d-1f775c3fbc84 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:24.208549 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533cd46-595c-455a-bb4d-1f775c3fbc84 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:24.210123 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 192/388] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:24.215802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38392f-a2c3-4301-8c9c-df13a442b181 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:24.216762 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38392f-a2c3-4301-8c9c-df13a442b181 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:24.217247 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38392f-a2c3-4301-8c9c-df13a442b181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:24.237695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-5c38392f-a2c3-4301-8c9c-df13a442b181 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:24.239278 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-5c38392f-a2c3-4301-8c9c-df13a442b181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:24.294257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:24.324910 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 197/389] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:24.325086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ae277-727c-4c3b-a565-f5ef475890a7 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:24.325284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ae277-727c-4c3b-a565-f5ef475890a7 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:24.325518 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ae277-727c-4c3b-a565-f5ef475890a7 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:24.327251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 193/390] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:24.345473 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9adec-dfce-4b66-b2a0-ccfc19ad58b9 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:24.346032 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9adec-dfce-4b66-b2a0-ccfc19ad58b9 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:24.346497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9adec-dfce-4b66-b2a0-ccfc19ad58b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:24.374354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-c6e9adec-dfce-4b66-b2a0-ccfc19ad58b9 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:24.374582 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ae277-727c-4c3b-a565-f5ef475890a7 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:24.375916 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-c6e9adec-dfce-4b66-b2a0-ccfc19ad58b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:24.378638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:24.452943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 198/391] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:24.483779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9adec-dfce-4b66-b2a0-ccfc19ad58b9 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:24.593678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9adec-dfce-4b66-b2a0-ccfc19ad58b9 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:24.610548 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:24.632424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655bdba-52d1-4b34-a0e3-f14e9283526e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:24.633017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655bdba-52d1-4b34-a0e3-f14e9283526e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:24.633300 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655bdba-52d1-4b34-a0e3-f14e9283526e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:24.633576 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655bdba-52d1-4b34-a0e3-f14e9283526e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:24.655520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655bdba-52d1-4b34-a0e3-f14e9283526e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:24.659429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ae277-727c-4c3b-a565-f5ef475890a7 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:24.667715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-3655bdba-52d1-4b34-a0e3-f14e9283526e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:24.667715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:24.667715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:24.667715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:24.667715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:24.667715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:24.667715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:24.667715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:24.667715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:24.667715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:24.667715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:24.667715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:24.667715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:24.667715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:24.667715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:24.667715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:24.668641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:24.668641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:24.668641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:24.668641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:24.668641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:24.668641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:24.668641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:24.668641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:24.668641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:24.668641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:24.668641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:24.668641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:24.668641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:24.668641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:24.668641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:24.668641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:24.669420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:24.669420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:24.669420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:24.669420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:24.669420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:24.669420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:24.669420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:24.669420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:24.669420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:24.669420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:24.669420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:24.669420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:24.670045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 199/392] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:24.677256 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655bdba-52d1-4b34-a0e3-f14e9283526e None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:24.791280 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655bdba-52d1-4b34-a0e3-f14e9283526e None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:24.827619 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2d864-f419-497a-8d6b-a99f2de4a956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:24.828248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2d864-f419-497a-8d6b-a99f2de4a956 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:24.828452 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a0157-6b95-4d81-b278-162ad35dd576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:24.828546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2d864-f419-497a-8d6b-a99f2de4a956 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:24.831373 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2d864-f419-497a-8d6b-a99f2de4a956 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:24.831484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a0157-6b95-4d81-b278-162ad35dd576 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:24.831484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a0157-6b95-4d81-b278-162ad35dd576 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:24.831630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2d864-f419-497a-8d6b-a99f2de4a956 None admin] RBAC: Adding query filter params (name=member) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:24.831702 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a0157-6b95-4d81-b278-162ad35dd576 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:24.831767 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2d864-f419-497a-8d6b-a99f2de4a956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:24.831767 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2d864-f419-497a-8d6b-a99f2de4a956 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:24.840479 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 200/393] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:41:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:24.841495 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2910515-8f79-4a46-8228-f39e1678f877 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:24.841779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2910515-8f79-4a46-8228-f39e1678f877 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:24.842727 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2910515-8f79-4a46-8228-f39e1678f877 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:24.848634 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 201/394] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:24.849431 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2910515-8f79-4a46-8228-f39e1678f877 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:24.850546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a0157-6b95-4d81-b278-162ad35dd576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:24.871136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-d30a0157-6b95-4d81-b278-162ad35dd576 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:41:24.871136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:24.871136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:24.871136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:24.871136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:24.871136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:24.871136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:24.871136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:24.871136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:24.871136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:24.871136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:24.871136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:24.871136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:24.871136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:24.871136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:24.871136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:24.872070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:24.872070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:24.872070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:24.872070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:24.872070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:24.872070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:24.872070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:24.872070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:24.872070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:24.872070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:24.872070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:24.872070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:24.872070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:24.872070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:24.872070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:24.872070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:24.872895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:24.872895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:24.872895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:24.872895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:24.872895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:24.872895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:24.872895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:24.872895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:24.872895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:24.872895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:24.872895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:41:24.872895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:24.876736 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 194/395] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:41:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 502 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:24.878012 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a4fcd-8389-4575-aef8-65bf410b673d None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:24.881044 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a4fcd-8389-4575-aef8-65bf410b673d None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:24.886757 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a4fcd-8389-4575-aef8-65bf410b673d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:24.901287 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:24.919438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-ac3a4fcd-8389-4575-aef8-65bf410b673d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:24.920655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-ac3a4fcd-8389-4575-aef8-65bf410b673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:24.977298 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2910515-8f79-4a46-8228-f39e1678f877 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:25.029153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:25.044792 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 195/396] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:25.046693 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a4fcd-8389-4575-aef8-65bf410b673d None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:25.050717 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870e90a-dea6-4f71-9b8d-0aab61cf9a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:25.051397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870e90a-dea6-4f71-9b8d-0aab61cf9a6f None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:25.051685 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870e90a-dea6-4f71-9b8d-0aab61cf9a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:25.051967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870e90a-dea6-4f71-9b8d-0aab61cf9a6f None admin] PATH_INFO: `/v3/groups/3080b1f107a643b6b02ea7206339ecf5` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:25.053951 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870e90a-dea6-4f71-9b8d-0aab61cf9a6f None admin] RBAC: Authorizing `identity:get_group(group_id=3080b1f107a643b6b02ea7206339ecf5)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:25.055355 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870e90a-dea6-4f71-9b8d-0aab61cf9a6f None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:25.056963 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 202/397] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 3 12:41:24 2022] GET /identity/v3/groups/3080b1f107a643b6b02ea7206339ecf5 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:25.064840 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870e90a-dea6-4f71-9b8d-0aab61cf9a6f None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:25.195728 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870e90a-dea6-4f71-9b8d-0aab61cf9a6f None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:25.196340 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a4fcd-8389-4575-aef8-65bf410b673d None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:25.204060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:25.231658 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddeeb20-313e-4279-ba0b-f757cb2b2a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:25.232308 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddeeb20-313e-4279-ba0b-f757cb2b2a88 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:25.232550 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddeeb20-313e-4279-ba0b-f757cb2b2a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:25.232830 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddeeb20-313e-4279-ba0b-f757cb2b2a88 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:25.233560 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddeeb20-313e-4279-ba0b-f757cb2b2a88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:25.233870 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddeeb20-313e-4279-ba0b-f757cb2b2a88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:25.235290 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddeeb20-313e-4279-ba0b-f757cb2b2a88 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:25.235993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ca535-b3f5-4d85-8f62-c85050d2ef85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:25.237167 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ca535-b3f5-4d85-8f62-c85050d2ef85 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:25.237744 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ca535-b3f5-4d85-8f62-c85050d2ef85 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:25.238232 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ca535-b3f5-4d85-8f62-c85050d2ef85 None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:25.239620 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ca535-b3f5-4d85-8f62-c85050d2ef85 None admin] RBAC: Authorizing `identity:get_project(project_id=eec5a65c35a046b4b2021380c24c36ab)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:25.241384 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ca535-b3f5-4d85-8f62-c85050d2ef85 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:25.243335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 203/398] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:25 2022] GET /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:25.247897 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 196/399] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:25.248926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ca535-b3f5-4d85-8f62-c85050d2ef85 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:25.249370 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddeeb20-313e-4279-ba0b-f757cb2b2a88 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:25.306647 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:25.352561 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ca535-b3f5-4d85-8f62-c85050d2ef85 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:25.354211 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddeeb20-313e-4279-ba0b-f757cb2b2a88 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:25.388412 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3804f34-e53d-4df3-9beb-43025deb2554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:25.389473 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3804f34-e53d-4df3-9beb-43025deb2554 None admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:25.389765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3804f34-e53d-4df3-9beb-43025deb2554 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:25.390147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3804f34-e53d-4df3-9beb-43025deb2554 None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab/groups/3080b1f107a643b6b02ea7206339ecf5/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:25.391156 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda9505-956c-4d47-b288-c8f0abe8d59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:25.391806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda9505-956c-4d47-b288-c8f0abe8d59a None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:25.392177 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda9505-956c-4d47-b288-c8f0abe8d59a None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:25.392281 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3804f34-e53d-4df3-9beb-43025deb2554 None admin] RBAC: Authorizing `identity:create_grant(project_id=eec5a65c35a046b4b2021380c24c36ab, group_id=3080b1f107a643b6b02ea7206339ecf5, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:25.392354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda9505-956c-4d47-b288-c8f0abe8d59a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:25.393620 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3804f34-e53d-4df3-9beb-43025deb2554 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:25.403219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda9505-956c-4d47-b288-c8f0abe8d59a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:25.408654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-1dda9505-956c-4d47-b288-c8f0abe8d59a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:41:25.408654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:25.408654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:25.408654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:25.408654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:25.408654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:25.408654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:25.408654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:25.408654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:25.408654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:25.408654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:25.408654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:25.408654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:25.408654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:25.408654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:25.408654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:25.409593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:25.409593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:25.409593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:25.409593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:25.409593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:25.409593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:25.409593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:25.409593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:25.409593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:25.409593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:25.409593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:25.409593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:25.409593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:25.409593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:25.409593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:25.409593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:25.410382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:25.410382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:25.410382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:25.410382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:25.410382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:25.410382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:25.410382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:25.410382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:25.410382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:25.410382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:25.410382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:41:25.410382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:25.410382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 197/400] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:41:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:25.411049 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda9505-956c-4d47-b288-c8f0abe8d59a None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:25.513724 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 204/401] 10.222.0.64 () {58 vars in 1442 bytes} [Wed Aug 3 12:41:25 2022] PUT /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab/groups/3080b1f107a643b6b02ea7206339ecf5/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:41:25.515098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915cac7-4df5-47c6-912e-fbb54eb12b54 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:25.515541 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915cac7-4df5-47c6-912e-fbb54eb12b54 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:25.515826 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915cac7-4df5-47c6-912e-fbb54eb12b54 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:25.516165 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda9505-956c-4d47-b288-c8f0abe8d59a None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:25.517107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 205/402] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:25.517836 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915cac7-4df5-47c6-912e-fbb54eb12b54 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:25.536827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:25.561833 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c140099-0845-478f-bf0a-ba85a2774dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:25.562646 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c140099-0845-478f-bf0a-ba85a2774dda None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:25.563105 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c140099-0845-478f-bf0a-ba85a2774dda None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:25.563688 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:25.564474 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c140099-0845-478f-bf0a-ba85a2774dda None admin] PATH_INFO: `/v3/groups/3080b1f107a643b6b02ea7206339ecf5` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:25.565985 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c140099-0845-478f-bf0a-ba85a2774dda None admin] RBAC: Authorizing `identity:get_group(group_id=3080b1f107a643b6b02ea7206339ecf5)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:25.567652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c140099-0845-478f-bf0a-ba85a2774dda None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:25.570035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 198/403] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 3 12:41:25 2022] GET /identity/v3/groups/3080b1f107a643b6b02ea7206339ecf5 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:25.571357 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5be91d-a18d-46cb-a2c6-9a4ab066507b None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:25.571764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5be91d-a18d-46cb-a2c6-9a4ab066507b None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:25.572149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5be91d-a18d-46cb-a2c6-9a4ab066507b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:25.592647 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-7f5be91d-a18d-46cb-a2c6-9a4ab066507b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:25.594119 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-7f5be91d-a18d-46cb-a2c6-9a4ab066507b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:25.657140 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915cac7-4df5-47c6-912e-fbb54eb12b54 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:25.682759 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 199/404] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:25.682759 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5be91d-a18d-46cb-a2c6-9a4ab066507b None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:25.720166 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267067d-b069-4ed7-a100-dcb41b14681a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:25.721555 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267067d-b069-4ed7-a100-dcb41b14681a None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:25.721960 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267067d-b069-4ed7-a100-dcb41b14681a None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:25.722243 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267067d-b069-4ed7-a100-dcb41b14681a None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:25.723280 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267067d-b069-4ed7-a100-dcb41b14681a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:25.723612 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267067d-b069-4ed7-a100-dcb41b14681a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:25.725838 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267067d-b069-4ed7-a100-dcb41b14681a None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:25.737150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 206/405] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:25.741718 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267067d-b069-4ed7-a100-dcb41b14681a None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:25.801367 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5be91d-a18d-46cb-a2c6-9a4ab066507b None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:25.816848 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:25.846086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3287b-044a-4434-800c-d4b8dee38bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:25.846766 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3287b-044a-4434-800c-d4b8dee38bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:25.847082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3287b-044a-4434-800c-d4b8dee38bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:25.847363 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3287b-044a-4434-800c-d4b8dee38bb5 None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:25.849776 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3287b-044a-4434-800c-d4b8dee38bb5 None admin] RBAC: Authorizing `identity:get_project(project_id=d6b0a8a1377b4435987dffefaad3e6d7)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:25.852081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3287b-044a-4434-800c-d4b8dee38bb5 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:25.854539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 200/406] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:25 2022] GET /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:25.855395 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3287b-044a-4434-800c-d4b8dee38bb5 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:25.870023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267067d-b069-4ed7-a100-dcb41b14681a None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:25.891176 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:25.917725 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31445269-1f41-41f9-9ec2-7073e22c4950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:25.918622 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31445269-1f41-41f9-9ec2-7073e22c4950 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:25.920779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31445269-1f41-41f9-9ec2-7073e22c4950 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:25.920779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31445269-1f41-41f9-9ec2-7073e22c4950 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:25.932117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31445269-1f41-41f9-9ec2-7073e22c4950 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:25.937781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-31445269-1f41-41f9-9ec2-7073e22c4950 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:41:25.937781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:25.937781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:25.937781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:25.937781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:25.937781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:25.937781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:25.937781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:25.937781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:25.937781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:25.937781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:25.937781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:25.937781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:25.937781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:25.937781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:25.937781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:25.938856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:25.938856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:25.938856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:25.938856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:25.938856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:25.938856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:25.938856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:25.938856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:25.938856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:25.938856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:25.938856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:25.938856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:25.938856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:25.938856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:25.938856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:25.938856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:25.939831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:25.939831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:25.939831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:25.939831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:25.939831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:25.939831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:25.939831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:25.939831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:25.939831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:25.939831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:25.939831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:41:25.939831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:25.942046 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 207/407] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:41:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:25.947581 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31445269-1f41-41f9-9ec2-7073e22c4950 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:25.984845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3287b-044a-4434-800c-d4b8dee38bb5 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:26.032064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c044ee-5b0f-411d-85aa-760a32e3ca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:26.034661 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c044ee-5b0f-411d-85aa-760a32e3ca0e None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:26.037794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c044ee-5b0f-411d-85aa-760a32e3ca0e None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:26.038805 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c044ee-5b0f-411d-85aa-760a32e3ca0e None admin] PATH_INFO: `/v3/groups/3080b1f107a643b6b02ea7206339ecf5` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:26.040291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c044ee-5b0f-411d-85aa-760a32e3ca0e None admin] RBAC: Authorizing `identity:get_group(group_id=3080b1f107a643b6b02ea7206339ecf5)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:26.042150 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c044ee-5b0f-411d-85aa-760a32e3ca0e None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:26.048590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 201/408] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 3 12:41:25 2022] GET /identity/v3/groups/3080b1f107a643b6b02ea7206339ecf5 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:26.049608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c044ee-5b0f-411d-85aa-760a32e3ca0e None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:26.070584 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31445269-1f41-41f9-9ec2-7073e22c4950 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:26.104113 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:26.113814 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97376098-8c64-4382-82d4-843567e3320e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:26.119221 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97376098-8c64-4382-82d4-843567e3320e None admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:26.119221 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97376098-8c64-4382-82d4-843567e3320e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:26.119221 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97376098-8c64-4382-82d4-843567e3320e None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7/groups/3080b1f107a643b6b02ea7206339ecf5/roles/e39a3afcb14442a08e9a24b8a56d17cf` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:26.119959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97376098-8c64-4382-82d4-843567e3320e None admin] RBAC: Authorizing `identity:create_grant(project_id=d6b0a8a1377b4435987dffefaad3e6d7, group_id=3080b1f107a643b6b02ea7206339ecf5, role_id=e39a3afcb14442a08e9a24b8a56d17cf)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:26.122271 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97376098-8c64-4382-82d4-843567e3320e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:26.167352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c044ee-5b0f-411d-85aa-760a32e3ca0e None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:26.205990 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f10a6b-422e-469d-9f62-975d20c2ccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:26.215058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 208/409] 10.222.0.64 () {58 vars in 1442 bytes} [Wed Aug 3 12:41:25 2022] PUT /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7/groups/3080b1f107a643b6b02ea7206339ecf5/roles/e39a3afcb14442a08e9a24b8a56d17cf => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:41:26.215058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97376098-8c64-4382-82d4-843567e3320e None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:26.215367 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f10a6b-422e-469d-9f62-975d20c2ccf3 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:26.215367 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f10a6b-422e-469d-9f62-975d20c2ccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:26.215367 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f10a6b-422e-469d-9f62-975d20c2ccf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:26.215367 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f10a6b-422e-469d-9f62-975d20c2ccf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:26.215367 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f10a6b-422e-469d-9f62-975d20c2ccf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:26.215367 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f10a6b-422e-469d-9f62-975d20c2ccf3 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:26.240609 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 202/410] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:26.244378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:26.247002 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f10a6b-422e-469d-9f62-975d20c2ccf3 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:26.392730 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97376098-8c64-4382-82d4-843567e3320e None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:26.421500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f10a6b-422e-469d-9f62-975d20c2ccf3 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:26.435819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:26.442311 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e024a-6815-471b-9a92-b47583063df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:26.443256 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e024a-6815-471b-9a92-b47583063df5 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:26.443542 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e024a-6815-471b-9a92-b47583063df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:26.444121 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e024a-6815-471b-9a92-b47583063df5 None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:26.445359 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e024a-6815-471b-9a92-b47583063df5 None admin] RBAC: Authorizing `identity:get_project(project_id=eec5a65c35a046b4b2021380c24c36ab)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:26.447332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e024a-6815-471b-9a92-b47583063df5 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:26.449625 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 209/411] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:26 2022] GET /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:26.451165 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65fcc9-2edc-4655-8a87-687ea58dc50a None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:26.453544 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65fcc9-2edc-4655-8a87-687ea58dc50a None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:26.453544 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65fcc9-2edc-4655-8a87-687ea58dc50a None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:26.455728 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 210/412] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:26.458699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65fcc9-2edc-4655-8a87-687ea58dc50a None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:26.467317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e869b8-b1c1-44f4-b22a-ddfe77b6f1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:26.467966 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e869b8-b1c1-44f4-b22a-ddfe77b6f1ea None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:26.468254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e869b8-b1c1-44f4-b22a-ddfe77b6f1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:26.468536 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e869b8-b1c1-44f4-b22a-ddfe77b6f1ea None admin] PATH_INFO: `/v3/groups/4d521372a26c4915903697752743da32` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:26.469748 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e869b8-b1c1-44f4-b22a-ddfe77b6f1ea None admin] RBAC: Authorizing `identity:get_group(group_id=4d521372a26c4915903697752743da32)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:26.471250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e869b8-b1c1-44f4-b22a-ddfe77b6f1ea None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:26.478424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 203/413] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 3 12:41:26 2022] GET /identity/v3/groups/4d521372a26c4915903697752743da32 => generated 229 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:26.479966 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1011ca-2ca7-41a8-9db0-4addc1686a1c None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:26.480260 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1011ca-2ca7-41a8-9db0-4addc1686a1c None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:26.480540 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1011ca-2ca7-41a8-9db0-4addc1686a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:26.498589 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-0a1011ca-2ca7-41a8-9db0-4addc1686a1c None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:26.499934 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-0a1011ca-2ca7-41a8-9db0-4addc1686a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:26.575847 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:26.578556 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 204/414] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:26.579688 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1011ca-2ca7-41a8-9db0-4addc1686a1c None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:26.581813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65fcc9-2edc-4655-8a87-687ea58dc50a None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:26.618048 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376471bb-738f-4394-9340-8b242ed29348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:26.618867 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376471bb-738f-4394-9340-8b242ed29348 None admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:26.619251 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376471bb-738f-4394-9340-8b242ed29348 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:26.619612 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376471bb-738f-4394-9340-8b242ed29348 None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab/groups/3080b1f107a643b6b02ea7206339ecf5/roles/e39a3afcb14442a08e9a24b8a56d17cf` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:26.621847 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376471bb-738f-4394-9340-8b242ed29348 None admin] RBAC: Authorizing `identity:create_grant(project_id=eec5a65c35a046b4b2021380c24c36ab, group_id=3080b1f107a643b6b02ea7206339ecf5, role_id=e39a3afcb14442a08e9a24b8a56d17cf)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:26.623527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376471bb-738f-4394-9340-8b242ed29348 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:26.696352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1011ca-2ca7-41a8-9db0-4addc1686a1c None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:26.709246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:26.730772 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 211/415] 10.222.0.64 () {58 vars in 1442 bytes} [Wed Aug 3 12:41:26 2022] PUT /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab/groups/3080b1f107a643b6b02ea7206339ecf5/roles/e39a3afcb14442a08e9a24b8a56d17cf => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:41:26.730772 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376471bb-738f-4394-9340-8b242ed29348 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:26.782188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14d6d3-76bb-4039-9422-747e95595d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:26.782927 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14d6d3-76bb-4039-9422-747e95595d0e None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:26.783215 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14d6d3-76bb-4039-9422-747e95595d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:26.783491 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14d6d3-76bb-4039-9422-747e95595d0e None admin] PATH_INFO: `/v3/projects/5d023a6b024c4cbd9df738e8fd9e9a97` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:26.785574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14d6d3-76bb-4039-9422-747e95595d0e None admin] RBAC: Authorizing `identity:get_project(project_id=5d023a6b024c4cbd9df738e8fd9e9a97)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:26.787171 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14d6d3-76bb-4039-9422-747e95595d0e None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:26.789583 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 205/416] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:26 2022] GET /identity/v3/projects/5d023a6b024c4cbd9df738e8fd9e9a97 => generated 344 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:26.796744 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14d6d3-76bb-4039-9422-747e95595d0e None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:26.869307 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376471bb-738f-4394-9340-8b242ed29348 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:26.913994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c35a1e-a2cf-46ce-8c0e-c53c46cedd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:26.914641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c35a1e-a2cf-46ce-8c0e-c53c46cedd88 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:26.915872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c35a1e-a2cf-46ce-8c0e-c53c46cedd88 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:26.916146 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c35a1e-a2cf-46ce-8c0e-c53c46cedd88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:26.928085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c35a1e-a2cf-46ce-8c0e-c53c46cedd88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:26.935173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-b3c35a1e-a2cf-46ce-8c0e-c53c46cedd88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:26.935173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:26.935173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:26.935173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:26.935173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:26.935173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:26.935173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:26.935173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:26.935173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:26.935173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:26.935173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:26.935173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:26.935173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:26.935173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:26.935173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:26.935173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:26.936150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:26.936150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:26.936150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:26.936150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:26.936150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:26.936150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:26.936150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:26.936150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:26.936150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:26.936150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:26.936150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:26.936150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:26.936150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:26.936150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:26.936150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:26.936150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:26.936991 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:26.936991 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:26.936991 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:26.936991 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:26.936991 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:26.936991 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:26.936991 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:26.936991 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:26.936991 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:26.936991 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:26.936991 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:26.936991 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:26.936991 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 212/417] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:26.944883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c35a1e-a2cf-46ce-8c0e-c53c46cedd88 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:26.948769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:26.972627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14d6d3-76bb-4039-9422-747e95595d0e None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:27.012220 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474e532-6209-46c1-8d4b-08e009f9c990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:27.013260 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474e532-6209-46c1-8d4b-08e009f9c990 None admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:27.013740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474e532-6209-46c1-8d4b-08e009f9c990 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:27.014235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474e532-6209-46c1-8d4b-08e009f9c990 None admin] PATH_INFO: `/v3/projects/5d023a6b024c4cbd9df738e8fd9e9a97/groups/4d521372a26c4915903697752743da32/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:27.016529 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474e532-6209-46c1-8d4b-08e009f9c990 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d023a6b024c4cbd9df738e8fd9e9a97, group_id=4d521372a26c4915903697752743da32, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:27.018449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474e532-6209-46c1-8d4b-08e009f9c990 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:27.051446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c35a1e-a2cf-46ce-8c0e-c53c46cedd88 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:27.089408 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5a607-5de1-4f82-b917-7a1385638df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:27.090025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5a607-5de1-4f82-b917-7a1385638df5 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:27.090320 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5a607-5de1-4f82-b917-7a1385638df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:27.090584 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5a607-5de1-4f82-b917-7a1385638df5 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:27.091328 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5a607-5de1-4f82-b917-7a1385638df5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:27.091683 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5a607-5de1-4f82-b917-7a1385638df5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:27.093103 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5a607-5de1-4f82-b917-7a1385638df5 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:27.102977 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 213/418] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:41:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:27.111872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5a607-5de1-4f82-b917-7a1385638df5 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:27.114284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 206/419] 10.222.0.64 () {58 vars in 1442 bytes} [Wed Aug 3 12:41:26 2022] PUT /identity/v3/projects/5d023a6b024c4cbd9df738e8fd9e9a97/groups/4d521372a26c4915903697752743da32/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:41:27.204926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:27.263161 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5a607-5de1-4f82-b917-7a1385638df5 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:27.305068 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea420b0-f47a-42d6-b0d3-12c3d0a9f215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:27.305875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea420b0-f47a-42d6-b0d3-12c3d0a9f215 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:27.306233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea420b0-f47a-42d6-b0d3-12c3d0a9f215 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:27.306581 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea420b0-f47a-42d6-b0d3-12c3d0a9f215 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:27.387814 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea420b0-f47a-42d6-b0d3-12c3d0a9f215 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:27.389597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea420b0-f47a-42d6-b0d3-12c3d0a9f215 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:27.470429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:27.525642 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 214/420] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:27.531447 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474e532-6209-46c1-8d4b-08e009f9c990 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:27.595380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:27.654659 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3923871-6e43-4f87-a92c-e26a33c1fbe0 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:27.655330 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3923871-6e43-4f87-a92c-e26a33c1fbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:27.655802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3923871-6e43-4f87-a92c-e26a33c1fbe0 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:27.657336 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 215/421] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:27.662673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e406e-7f35-44fc-9ae5-533a00a72b9f None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:27.663065 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e406e-7f35-44fc-9ae5-533a00a72b9f None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:27.663344 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e406e-7f35-44fc-9ae5-533a00a72b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:27.690912 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474e532-6209-46c1-8d4b-08e009f9c990 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:27.702823 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-d19e406e-7f35-44fc-9ae5-533a00a72b9f None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:27.704073 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d19e406e-7f35-44fc-9ae5-533a00a72b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:27.753670 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb41dd-a4b5-48ee-bca9-0fadfd29d4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:27.754244 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb41dd-a4b5-48ee-bca9-0fadfd29d4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:27.754528 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb41dd-a4b5-48ee-bca9-0fadfd29d4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:27.754825 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb41dd-a4b5-48ee-bca9-0fadfd29d4c4 None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:27.757071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb41dd-a4b5-48ee-bca9-0fadfd29d4c4 None admin] RBAC: Authorizing `identity:get_project(project_id=d6b0a8a1377b4435987dffefaad3e6d7)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:27.758505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb41dd-a4b5-48ee-bca9-0fadfd29d4c4 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:27.761187 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 207/422] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:27 2022] GET /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:27.766492 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb41dd-a4b5-48ee-bca9-0fadfd29d4c4 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:27.829686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 216/423] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:41:27.868190 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e406e-7f35-44fc-9ae5-533a00a72b9f None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:27.916877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb41dd-a4b5-48ee-bca9-0fadfd29d4c4 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:27.920210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:27.988842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc49aee-da7b-480b-a242-00753fe3132d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:27.989520 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc49aee-da7b-480b-a242-00753fe3132d None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:27.989804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc49aee-da7b-480b-a242-00753fe3132d None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:27.990078 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc49aee-da7b-480b-a242-00753fe3132d None admin] PATH_INFO: `/v3/groups/3080b1f107a643b6b02ea7206339ecf5` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:27.992308 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc49aee-da7b-480b-a242-00753fe3132d None admin] RBAC: Authorizing `identity:get_group(group_id=3080b1f107a643b6b02ea7206339ecf5)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:27.993756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc49aee-da7b-480b-a242-00753fe3132d None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:27.996110 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 208/424] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 3 12:41:27 2022] GET /identity/v3/groups/3080b1f107a643b6b02ea7206339ecf5 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:28.001960 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc49aee-da7b-480b-a242-00753fe3132d None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:28.007884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:28.018450 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e406e-7f35-44fc-9ae5-533a00a72b9f None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:28.082378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087cbfa-3f12-456e-9fd1-363ffb85a184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:28.083041 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087cbfa-3f12-456e-9fd1-363ffb85a184 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:28.083328 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087cbfa-3f12-456e-9fd1-363ffb85a184 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:28.083607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087cbfa-3f12-456e-9fd1-363ffb85a184 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:28.103034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087cbfa-3f12-456e-9fd1-363ffb85a184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:28.108056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-4087cbfa-3f12-456e-9fd1-363ffb85a184 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:28.108056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:28.108056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:28.108056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:28.108056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:28.108056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:28.108056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:28.108056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:28.108056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:28.108056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:28.108056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:28.108056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:28.108056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:28.108056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:28.108056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:28.108056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:28.108946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:28.108946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:28.108946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:28.108946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:28.108946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:28.108946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:28.108946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:28.108946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:28.108946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:28.108946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:28.108946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:28.108946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:28.108946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:28.108946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:28.108946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:28.108946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:28.109723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:28.109723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:28.109723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:28.109723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:28.109723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:28.109723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:28.109723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:28.109723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:28.109723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:28.109723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:28.109723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:41:28.109723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:28.109723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 217/425] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:28.117099 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087cbfa-3f12-456e-9fd1-363ffb85a184 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:28.156913 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc49aee-da7b-480b-a242-00753fe3132d None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:28.193746 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d90286-11b2-4afa-b58a-0043d54a74b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:28.195196 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d90286-11b2-4afa-b58a-0043d54a74b1 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:28.195624 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d90286-11b2-4afa-b58a-0043d54a74b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:28.196065 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d90286-11b2-4afa-b58a-0043d54a74b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:28.197072 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d90286-11b2-4afa-b58a-0043d54a74b1 None admin] RBAC: Adding query filter params (group.id=3080b1f107a643b6b02ea7206339ecf5, role.id=26c9fe6916a4412d96492e41ff62cca6, scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:28.197528 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d90286-11b2-4afa-b58a-0043d54a74b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:28.199209 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d90286-11b2-4afa-b58a-0043d54a74b1 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:28.206635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 209/426] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 3 12:41:28 2022] GET /identity/v3/role_assignments?group.id=3080b1f107a643b6b02ea7206339ecf5&scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7&role.id=26c9fe6916a4412d96492e41ff62cca6 => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:28.300727 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087cbfa-3f12-456e-9fd1-363ffb85a184 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:28.353416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e676e37-0e4f-4839-90c8-cbd8ba102f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:28.354457 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e676e37-0e4f-4839-90c8-cbd8ba102f24 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:28.354979 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e676e37-0e4f-4839-90c8-cbd8ba102f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:28.355454 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e676e37-0e4f-4839-90c8-cbd8ba102f24 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:28.356414 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e676e37-0e4f-4839-90c8-cbd8ba102f24 None admin] RBAC: Adding query filter params (name=member) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:28.356928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e676e37-0e4f-4839-90c8-cbd8ba102f24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:28.358597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e676e37-0e4f-4839-90c8-cbd8ba102f24 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:28.371115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 218/427] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:41:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:28.376556 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d90286-11b2-4afa-b58a-0043d54a74b1 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:28.416103 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:28.483908 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d90286-11b2-4afa-b58a-0043d54a74b1 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:28.521694 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0b058-efa3-4993-ae81-a348564e2cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:28.522697 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0b058-efa3-4993-ae81-a348564e2cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:28.523225 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0b058-efa3-4993-ae81-a348564e2cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:28.523708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0b058-efa3-4993-ae81-a348564e2cb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:28.600034 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0b058-efa3-4993-ae81-a348564e2cb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:28.602299 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0b058-efa3-4993-ae81-a348564e2cb6 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:28.638704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:28.706313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 210/428] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:28.713870 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e676e37-0e4f-4839-90c8-cbd8ba102f24 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:28.733130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a239f3-0644-4693-869d-dffe448b1709 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:28.733315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a239f3-0644-4693-869d-dffe448b1709 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:28.733548 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a239f3-0644-4693-869d-dffe448b1709 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:28.735078 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 211/429] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:41:28.740812 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37549730-006f-46f0-ac49-301fe606465a None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:28.741626 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37549730-006f-46f0-ac49-301fe606465a None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:28.741902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37549730-006f-46f0-ac49-301fe606465a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:28.746556 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:28.768234 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-37549730-006f-46f0-ac49-301fe606465a None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:28.770004 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-37549730-006f-46f0-ac49-301fe606465a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:28.849069 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e676e37-0e4f-4839-90c8-cbd8ba102f24 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:28.851414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 212/430] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:28.881275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37549730-006f-46f0-ac49-301fe606465a None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:28.897611 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145db9b0-7017-4bfa-b3be-d95dd3ffc418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:28.898574 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145db9b0-7017-4bfa-b3be-d95dd3ffc418 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:28.899056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145db9b0-7017-4bfa-b3be-d95dd3ffc418 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:28.899554 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145db9b0-7017-4bfa-b3be-d95dd3ffc418 None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:28.900974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145db9b0-7017-4bfa-b3be-d95dd3ffc418 None admin] RBAC: Authorizing `identity:get_project(project_id=eec5a65c35a046b4b2021380c24c36ab)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:28.902605 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145db9b0-7017-4bfa-b3be-d95dd3ffc418 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:28.904837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 219/431] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:28 2022] GET /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:28.916759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145db9b0-7017-4bfa-b3be-d95dd3ffc418 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:28.966201 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:29.026961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37549730-006f-46f0-ac49-301fe606465a None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:29.030492 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:29.051166 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145db9b0-7017-4bfa-b3be-d95dd3ffc418 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:29.071377 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896eec7c-c7ef-4bae-9b2b-ede4a299ba06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:29.072304 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896eec7c-c7ef-4bae-9b2b-ede4a299ba06 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:29.072584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896eec7c-c7ef-4bae-9b2b-ede4a299ba06 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:29.072867 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896eec7c-c7ef-4bae-9b2b-ede4a299ba06 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:29.087805 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896eec7c-c7ef-4bae-9b2b-ede4a299ba06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:29.095219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-896eec7c-c7ef-4bae-9b2b-ede4a299ba06 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:41:29.095219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:29.095219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:29.095219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:29.095219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:29.095219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:29.095219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:29.095219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:29.095219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:29.095219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:29.095219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:29.095219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:29.095219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:29.095219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:29.095219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:29.095219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:29.096295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:29.096295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:29.096295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:29.096295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:29.096295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:29.096295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:29.096295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:29.096295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:29.096295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:29.096295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:29.096295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:29.096295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:29.096295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:29.096295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:29.096295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:29.096295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:29.097286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:29.097286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:29.097286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:29.097286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:29.097286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:29.097286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:29.097286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:29.097286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:29.097286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:29.097286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:29.097286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:41:29.097286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:29.097286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 213/432] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:41:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:29.100988 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e5793-4e1a-47fa-bab6-07c5d7f969d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:29.102194 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e5793-4e1a-47fa-bab6-07c5d7f969d8 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:29.102655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e5793-4e1a-47fa-bab6-07c5d7f969d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:29.102814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896eec7c-c7ef-4bae-9b2b-ede4a299ba06 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:29.103285 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e5793-4e1a-47fa-bab6-07c5d7f969d8 None admin] PATH_INFO: `/v3/groups/3080b1f107a643b6b02ea7206339ecf5` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:29.104662 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e5793-4e1a-47fa-bab6-07c5d7f969d8 None admin] RBAC: Authorizing `identity:get_group(group_id=3080b1f107a643b6b02ea7206339ecf5)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:29.106403 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e5793-4e1a-47fa-bab6-07c5d7f969d8 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:29.108523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 220/433] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 3 12:41:28 2022] GET /identity/v3/groups/3080b1f107a643b6b02ea7206339ecf5 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:29.120405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e5793-4e1a-47fa-bab6-07c5d7f969d8 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:29.233120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896eec7c-c7ef-4bae-9b2b-ede4a299ba06 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:29.261562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:29.264864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e5793-4e1a-47fa-bab6-07c5d7f969d8 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:29.270918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03217d-bf44-48d5-8a23-08276907ed6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:29.271590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03217d-bf44-48d5-8a23-08276907ed6d None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:29.271877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03217d-bf44-48d5-8a23-08276907ed6d None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:29.272157 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03217d-bf44-48d5-8a23-08276907ed6d None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:29.273429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03217d-bf44-48d5-8a23-08276907ed6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:29.273743 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03217d-bf44-48d5-8a23-08276907ed6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:29.275214 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03217d-bf44-48d5-8a23-08276907ed6d None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:29.290214 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 214/434] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:29.292788 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03217d-bf44-48d5-8a23-08276907ed6d None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:29.304101 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637769b-bbe6-4348-872b-6cbbabddc9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:29.305366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637769b-bbe6-4348-872b-6cbbabddc9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:29.306761 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637769b-bbe6-4348-872b-6cbbabddc9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:29.307247 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637769b-bbe6-4348-872b-6cbbabddc9a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:29.308238 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637769b-bbe6-4348-872b-6cbbabddc9a4 None admin] RBAC: Adding query filter params (group.id=3080b1f107a643b6b02ea7206339ecf5, role.id=26c9fe6916a4412d96492e41ff62cca6, scope.project.id=eec5a65c35a046b4b2021380c24c36ab) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:29.308838 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637769b-bbe6-4348-872b-6cbbabddc9a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:29.310570 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637769b-bbe6-4348-872b-6cbbabddc9a4 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:29.322889 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 221/435] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 3 12:41:29 2022] GET /identity/v3/role_assignments?group.id=3080b1f107a643b6b02ea7206339ecf5&scope.project.id=eec5a65c35a046b4b2021380c24c36ab&role.id=26c9fe6916a4412d96492e41ff62cca6 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:29.326511 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe86ef3-af26-4d54-971c-3473d4581e60 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:29.326848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe86ef3-af26-4d54-971c-3473d4581e60 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:29.327127 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe86ef3-af26-4d54-971c-3473d4581e60 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:29.328897 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 222/436] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:41:29.334444 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d3df6-7f79-49de-b88c-8ce8b318a95b None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:29.335688 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d3df6-7f79-49de-b88c-8ce8b318a95b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:29.335980 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d3df6-7f79-49de-b88c-8ce8b318a95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:29.355763 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-473d3df6-7f79-49de-b88c-8ce8b318a95b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:29.357070 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-473d3df6-7f79-49de-b88c-8ce8b318a95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:29.376250 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:29.407789 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03217d-bf44-48d5-8a23-08276907ed6d None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:29.438616 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 223/437] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:41:29.447698 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db47eb2-6089-4738-9049-70fbfe7bd7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:29.448339 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db47eb2-6089-4738-9049-70fbfe7bd7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:29.448626 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db47eb2-6089-4738-9049-70fbfe7bd7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:29.448960 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db47eb2-6089-4738-9049-70fbfe7bd7b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:29.455606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d3df6-7f79-49de-b88c-8ce8b318a95b None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:29.513324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:29.533069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db47eb2-6089-4738-9049-70fbfe7bd7b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:29.534670 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db47eb2-6089-4738-9049-70fbfe7bd7b7 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:29.588206 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d3df6-7f79-49de-b88c-8ce8b318a95b None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:29.622252 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ea157-f898-4563-98e4-d339a36bb84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:29.622854 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ea157-f898-4563-98e4-d339a36bb84b None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:29.623142 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ea157-f898-4563-98e4-d339a36bb84b None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:29.623419 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ea157-f898-4563-98e4-d339a36bb84b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:29.633820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ea157-f898-4563-98e4-d339a36bb84b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:29.638755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-fe6ea157-f898-4563-98e4-d339a36bb84b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:41:29.638755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:29.638755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:29.638755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:29.638755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:29.638755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:29.638755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:29.638755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:29.638755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:29.638755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:29.638755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:29.638755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:29.638755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:29.638755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:29.638755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:29.638755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:29.639864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:29.639864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:29.639864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:29.639864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:29.639864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:29.639864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:29.639864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:29.639864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:29.639864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:29.639864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:29.639864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:29.639864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:29.639864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:29.639864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:29.639864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:29.639864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:29.645855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:29.645855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:29.645855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:29.645855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:29.645855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:29.645855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:29.645855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:29.645855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:29.645855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:29.645855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:29.645855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:41:29.645855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:29.646460 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 215/438] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:29.646460 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b07d8-d5cb-4e99-8e7f-1d952d49f883 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:29.646460 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b07d8-d5cb-4e99-8e7f-1d952d49f883 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:29.646460 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b07d8-d5cb-4e99-8e7f-1d952d49f883 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:29.647954 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 224/439] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:41:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:29.648024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 216/440] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:29.648089 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ea157-f898-4563-98e4-d339a36bb84b None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:29.648785 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b07d8-d5cb-4e99-8e7f-1d952d49f883 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:29.657582 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:29.737186 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:29.743996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ea157-f898-4563-98e4-d339a36bb84b None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:29.749902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b07d8-d5cb-4e99-8e7f-1d952d49f883 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:29.778398 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff87c6-2221-4bd2-aebe-74c1661e1e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:29.779056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff87c6-2221-4bd2-aebe-74c1661e1e49 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:29.779346 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff87c6-2221-4bd2-aebe-74c1661e1e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:29.779627 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff87c6-2221-4bd2-aebe-74c1661e1e49 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:29.780353 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff87c6-2221-4bd2-aebe-74c1661e1e49 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:29.780665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff87c6-2221-4bd2-aebe-74c1661e1e49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:29.782126 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff87c6-2221-4bd2-aebe-74c1661e1e49 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:29.784289 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bc6f4-88ec-4231-a0a4-11b1463296c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:29.784919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bc6f4-88ec-4231-a0a4-11b1463296c1 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:29.785207 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bc6f4-88ec-4231-a0a4-11b1463296c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:29.785486 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bc6f4-88ec-4231-a0a4-11b1463296c1 None admin] PATH_INFO: `/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:29.786658 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bc6f4-88ec-4231-a0a4-11b1463296c1 None admin] RBAC: Authorizing `identity:get_project(project_id=d6b0a8a1377b4435987dffefaad3e6d7)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:29.788151 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bc6f4-88ec-4231-a0a4-11b1463296c1 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:29.789801 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 217/441] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:29 2022] GET /identity/v3/projects/d6b0a8a1377b4435987dffefaad3e6d7 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:29.789970 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 225/442] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:29.795536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff87c6-2221-4bd2-aebe-74c1661e1e49 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:29.795675 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46b185-60fb-412b-9368-9ee175d4ef69 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:29.795957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46b185-60fb-412b-9368-9ee175d4ef69 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:29.796244 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46b185-60fb-412b-9368-9ee175d4ef69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:29.813564 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-2b46b185-60fb-412b-9368-9ee175d4ef69 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:29.814795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-2b46b185-60fb-412b-9368-9ee175d4ef69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:29.862495 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:29.880389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 218/443] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:29.881006 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46b185-60fb-412b-9368-9ee175d4ef69 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:29.895366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff87c6-2221-4bd2-aebe-74c1661e1e49 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:29.930676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663d295-b999-40ed-8586-adcb55e7d096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:29.931362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663d295-b999-40ed-8586-adcb55e7d096 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:29.931642 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663d295-b999-40ed-8586-adcb55e7d096 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:29.931915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663d295-b999-40ed-8586-adcb55e7d096 None admin] PATH_INFO: `/v3/groups/3080b1f107a643b6b02ea7206339ecf5` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:29.933074 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663d295-b999-40ed-8586-adcb55e7d096 None admin] RBAC: Authorizing `identity:get_group(group_id=3080b1f107a643b6b02ea7206339ecf5)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:29.934509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663d295-b999-40ed-8586-adcb55e7d096 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:29.936129 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 226/444] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 3 12:41:29 2022] GET /identity/v3/groups/3080b1f107a643b6b02ea7206339ecf5 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:29.936876 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663d295-b999-40ed-8586-adcb55e7d096 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:29.965840 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:29.980432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46b185-60fb-412b-9368-9ee175d4ef69 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:30.014601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba7aac-e0a7-47c8-8daf-1454a60f4de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:30.015249 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba7aac-e0a7-47c8-8daf-1454a60f4de0 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:30.015539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba7aac-e0a7-47c8-8daf-1454a60f4de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:30.015820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba7aac-e0a7-47c8-8daf-1454a60f4de0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:30.040987 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663d295-b999-40ed-8586-adcb55e7d096 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:30.075647 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b577f28-18e5-491f-83aa-5061abcb0a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:30.076284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b577f28-18e5-491f-83aa-5061abcb0a3c None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:30.076572 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b577f28-18e5-491f-83aa-5061abcb0a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:30.076857 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b577f28-18e5-491f-83aa-5061abcb0a3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:30.082209 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba7aac-e0a7-47c8-8daf-1454a60f4de0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:30.083586 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:30.083868 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba7aac-e0a7-47c8-8daf-1454a60f4de0 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:30.087830 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b577f28-18e5-491f-83aa-5061abcb0a3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:30.092745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-0b577f28-18e5-491f-83aa-5061abcb0a3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:41:30.092745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:30.092745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:30.092745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:30.092745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:30.092745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:30.092745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:30.092745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:30.092745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:30.092745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:30.092745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:30.092745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:30.092745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:30.092745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:30.092745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:30.092745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:30.093677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:30.093677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:30.093677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:30.093677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:30.093677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:30.093677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:30.093677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:30.093677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:30.093677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:30.093677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:30.093677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:30.093677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:30.093677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:30.093677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:30.093677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:30.093677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:30.094537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:30.094537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:30.094537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:30.094537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:30.094537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:30.094537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:30.094537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:30.094537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:30.094537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:30.094537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:30.094537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:41:30.094537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:30.094537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 227/445] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:41:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:30.095261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b577f28-18e5-491f-83aa-5061abcb0a3c None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:30.172112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:30.187474 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 219/446] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:30.188288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba7aac-e0a7-47c8-8daf-1454a60f4de0 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:30.196704 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b577f28-18e5-491f-83aa-5061abcb0a3c None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:30.230919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72148cbf-1b74-4b69-bee4-c2a22d849fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:30.231528 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72148cbf-1b74-4b69-bee4-c2a22d849fbe None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:30.231812 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72148cbf-1b74-4b69-bee4-c2a22d849fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:30.232090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72148cbf-1b74-4b69-bee4-c2a22d849fbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:30.232877 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72148cbf-1b74-4b69-bee4-c2a22d849fbe None admin] RBAC: Adding query filter params (group.id=3080b1f107a643b6b02ea7206339ecf5, role.id=e39a3afcb14442a08e9a24b8a56d17cf, scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:30.233193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72148cbf-1b74-4b69-bee4-c2a22d849fbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:30.234639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72148cbf-1b74-4b69-bee4-c2a22d849fbe None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:30.240296 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 228/447] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 3 12:41:30 2022] GET /identity/v3/role_assignments?group.id=3080b1f107a643b6b02ea7206339ecf5&scope.project.id=d6b0a8a1377b4435987dffefaad3e6d7&role.id=e39a3afcb14442a08e9a24b8a56d17cf => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:30.241641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72148cbf-1b74-4b69-bee4-c2a22d849fbe None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:30.294680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba7aac-e0a7-47c8-8daf-1454a60f4de0 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:30.311674 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:30.336290 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c99fb-b15e-4f82-84ef-8d624cb6a3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:30.336938 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c99fb-b15e-4f82-84ef-8d624cb6a3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:30.337225 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c99fb-b15e-4f82-84ef-8d624cb6a3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:30.337506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c99fb-b15e-4f82-84ef-8d624cb6a3b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:30.338241 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c99fb-b15e-4f82-84ef-8d624cb6a3b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:30.338556 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c99fb-b15e-4f82-84ef-8d624cb6a3b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:30.340042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c99fb-b15e-4f82-84ef-8d624cb6a3b8 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:30.353834 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 220/448] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:30.355500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c99fb-b15e-4f82-84ef-8d624cb6a3b8 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:30.359686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72148cbf-1b74-4b69-bee4-c2a22d849fbe None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:30.396485 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e406f-6d84-4c95-9d98-7a67ebd1dce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:30.396974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e406f-6d84-4c95-9d98-7a67ebd1dce0 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:30.397295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e406f-6d84-4c95-9d98-7a67ebd1dce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:30.398219 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e406f-6d84-4c95-9d98-7a67ebd1dce0 None admin] PATH_INFO: `/v3/projects/eec5a65c35a046b4b2021380c24c36ab` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:30.398786 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e406f-6d84-4c95-9d98-7a67ebd1dce0 None admin] RBAC: Authorizing `identity:get_project(project_id=eec5a65c35a046b4b2021380c24c36ab)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:30.400736 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e406f-6d84-4c95-9d98-7a67ebd1dce0 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:30.402159 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 229/449] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:30 2022] GET /identity/v3/projects/eec5a65c35a046b4b2021380c24c36ab => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:30.407549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e406f-6d84-4c95-9d98-7a67ebd1dce0 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:30.412465 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:30.473933 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c99fb-b15e-4f82-84ef-8d624cb6a3b8 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:30.523310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d6f33-a2d8-4c7e-9ce4-1de8e9de0501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:30.523948 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d6f33-a2d8-4c7e-9ce4-1de8e9de0501 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:30.524252 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d6f33-a2d8-4c7e-9ce4-1de8e9de0501 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:30.524545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d6f33-a2d8-4c7e-9ce4-1de8e9de0501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:30.533585 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e406f-6d84-4c95-9d98-7a67ebd1dce0 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:30.569453 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:30.576830 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c98ecd-d0e1-4f72-a2f0-5083003b6d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:30.577486 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c98ecd-d0e1-4f72-a2f0-5083003b6d6d None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:30.577833 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c98ecd-d0e1-4f72-a2f0-5083003b6d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:30.578123 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c98ecd-d0e1-4f72-a2f0-5083003b6d6d None admin] PATH_INFO: `/v3/groups/3080b1f107a643b6b02ea7206339ecf5` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:30.579482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c98ecd-d0e1-4f72-a2f0-5083003b6d6d None admin] RBAC: Authorizing `identity:get_group(group_id=3080b1f107a643b6b02ea7206339ecf5)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:30.580946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c98ecd-d0e1-4f72-a2f0-5083003b6d6d None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:30.582562 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 230/450] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 3 12:41:30 2022] GET /identity/v3/groups/3080b1f107a643b6b02ea7206339ecf5 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:30.588673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c98ecd-d0e1-4f72-a2f0-5083003b6d6d None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:30.605115 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d6f33-a2d8-4c7e-9ce4-1de8e9de0501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:30.606047 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d6f33-a2d8-4c7e-9ce4-1de8e9de0501 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:30.667347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:30.708754 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c98ecd-d0e1-4f72-a2f0-5083003b6d6d None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:30.730601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 221/451] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 12:41:30.736851 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d6f33-a2d8-4c7e-9ce4-1de8e9de0501 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:30.753852 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c087af-2f56-4826-bae2-dddb1398a98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:30.754500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c087af-2f56-4826-bae2-dddb1398a98e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:30.754785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c087af-2f56-4826-bae2-dddb1398a98e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:30.755170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c087af-2f56-4826-bae2-dddb1398a98e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:30.755966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c087af-2f56-4826-bae2-dddb1398a98e None admin] RBAC: Adding query filter params (group.id=3080b1f107a643b6b02ea7206339ecf5, role.id=e39a3afcb14442a08e9a24b8a56d17cf, scope.project.id=eec5a65c35a046b4b2021380c24c36ab) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:30.756281 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c087af-2f56-4826-bae2-dddb1398a98e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:30.757772 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c087af-2f56-4826-bae2-dddb1398a98e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:30.764206 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 231/452] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 3 12:41:30 2022] GET /identity/v3/role_assignments?group.id=3080b1f107a643b6b02ea7206339ecf5&scope.project.id=eec5a65c35a046b4b2021380c24c36ab&role.id=e39a3afcb14442a08e9a24b8a56d17cf => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:30.843714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d6f33-a2d8-4c7e-9ce4-1de8e9de0501 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:30.879384 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0ca44-1e94-4021-a6df-09e861bdcde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:30.880045 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0ca44-1e94-4021-a6df-09e861bdcde4 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:30.880333 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0ca44-1e94-4021-a6df-09e861bdcde4 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:30.880615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0ca44-1e94-4021-a6df-09e861bdcde4 None admin] PATH_INFO: `/v3/projects/5d023a6b024c4cbd9df738e8fd9e9a97` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:30.881854 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0ca44-1e94-4021-a6df-09e861bdcde4 None admin] RBAC: Authorizing `identity:get_project(project_id=5d023a6b024c4cbd9df738e8fd9e9a97)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:30.883403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0ca44-1e94-4021-a6df-09e861bdcde4 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:30.885128 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 222/453] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:41:30 2022] GET /identity/v3/projects/5d023a6b024c4cbd9df738e8fd9e9a97 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:30.890895 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c087af-2f56-4826-bae2-dddb1398a98e None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:30.957942 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:31.000862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c087af-2f56-4826-bae2-dddb1398a98e None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:31.034450 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179043a-007e-4d97-9087-9570d5f7e7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:31.035119 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179043a-007e-4d97-9087-9570d5f7e7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:31.035396 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179043a-007e-4d97-9087-9570d5f7e7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:31.035668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179043a-007e-4d97-9087-9570d5f7e7b5 None admin] PATH_INFO: `/v3/groups/4d521372a26c4915903697752743da32` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:31.036809 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179043a-007e-4d97-9087-9570d5f7e7b5 None admin] RBAC: Authorizing `identity:get_group(group_id=4d521372a26c4915903697752743da32)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:31.038841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179043a-007e-4d97-9087-9570d5f7e7b5 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:31.040414 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 232/454] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Aug 3 12:41:30 2022] GET /identity/v3/groups/4d521372a26c4915903697752743da32 => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:31.046684 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0ca44-1e94-4021-a6df-09e861bdcde4 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:31.065918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:31.146271 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0ca44-1e94-4021-a6df-09e861bdcde4 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:31.179635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd506352-5bb2-4647-a104-c6215e3d0396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:31.180244 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd506352-5bb2-4647-a104-c6215e3d0396 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:31.180529 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd506352-5bb2-4647-a104-c6215e3d0396 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:31.180808 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd506352-5bb2-4647-a104-c6215e3d0396 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:31.181599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd506352-5bb2-4647-a104-c6215e3d0396 None admin] RBAC: Adding query filter params (group.id=4d521372a26c4915903697752743da32, role.id=a6d209169b77456f9f1cc3ff53646cfc, scope.project.id=5d023a6b024c4cbd9df738e8fd9e9a97) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:31.181915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd506352-5bb2-4647-a104-c6215e3d0396 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:31.183408 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd506352-5bb2-4647-a104-c6215e3d0396 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:31.189032 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 223/455] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Aug 3 12:41:31 2022] GET /identity/v3/role_assignments?group.id=4d521372a26c4915903697752743da32&scope.project.id=5d023a6b024c4cbd9df738e8fd9e9a97&role.id=a6d209169b77456f9f1cc3ff53646cfc => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:33.726760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a1e09-6628-4485-8774-a5b62264a150 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:33.726760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a1e09-6628-4485-8774-a5b62264a150 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:33.726760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a1e09-6628-4485-8774-a5b62264a150 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:33.729049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 233/456] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:33.734048 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ee118-4458-4d5d-9814-7562f88032eb None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:33.734913 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ee118-4458-4d5d-9814-7562f88032eb None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:33.735422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ee118-4458-4d5d-9814-7562f88032eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:33.758100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-b89ee118-4458-4d5d-9814-7562f88032eb None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:33.759334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b89ee118-4458-4d5d-9814-7562f88032eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:33.806439 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776d7e1-425e-4844-8387-afd93f8e7c62 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:33.807085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776d7e1-425e-4844-8387-afd93f8e7c62 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:33.807567 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776d7e1-425e-4844-8387-afd93f8e7c62 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:33.809378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 234/457] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:41:33.813958 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e74bf-4ba2-4224-83fe-b7cf0821f011 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:33.814248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e74bf-4ba2-4224-83fe-b7cf0821f011 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:33.814531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e74bf-4ba2-4224-83fe-b7cf0821f011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:33.843152 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-fe4e74bf-4ba2-4224-83fe-b7cf0821f011 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:33.844377 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-fe4e74bf-4ba2-4224-83fe-b7cf0821f011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:33.867798 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 224/458] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:33.936184 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ee118-4458-4d5d-9814-7562f88032eb None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:33.951208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 235/459] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:41:33.960092 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:33.972176 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e74bf-4ba2-4224-83fe-b7cf0821f011 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:34.055308 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:34.083104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ee118-4458-4d5d-9814-7562f88032eb None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:34.085817 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e74bf-4ba2-4224-83fe-b7cf0821f011 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:34.120621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91bac5-f478-4079-9980-4fdc92bcd169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:34.121656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91bac5-f478-4079-9980-4fdc92bcd169 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:34.122141 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91bac5-f478-4079-9980-4fdc92bcd169 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:34.122622 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91bac5-f478-4079-9980-4fdc92bcd169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:34.124225 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efc3b2-6f5f-4836-a0ec-7421dbd727cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:34.124876 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efc3b2-6f5f-4836-a0ec-7421dbd727cd None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:34.125268 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efc3b2-6f5f-4836-a0ec-7421dbd727cd None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:34.125711 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efc3b2-6f5f-4836-a0ec-7421dbd727cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:34.134754 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91bac5-f478-4079-9980-4fdc92bcd169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:34.136709 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91bac5-f478-4079-9980-4fdc92bcd169 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:34.137211 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9efc3b2-6f5f-4836-a0ec-7421dbd727cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:34.139023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9efc3b2-6f5f-4836-a0ec-7421dbd727cd None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:34.154842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-b9efc3b2-6f5f-4836-a0ec-7421dbd727cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:34.154842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:34.154842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:34.154842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:34.154842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:34.154842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:34.154842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:34.154842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:34.154842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:34.154842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:34.154842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:34.154842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:34.154842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:34.154842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:34.154842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:34.155901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:34.155901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:34.155901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:34.155901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:34.155901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:34.155901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:34.155901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:34.155901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:34.155901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:34.155901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:34.155901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:34.155901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:34.155901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:34.155901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:34.155901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:34.155901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:34.155901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:34.156961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:34.156961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:34.156961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:34.156961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:34.158781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 236/460] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:34.158892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-6c91bac5-f478-4079-9980-4fdc92bcd169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:34.158892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:34.158892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:34.158892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:34.158892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:34.158892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:34.158892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:34.158892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:34.158892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:34.158892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:34.158892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:34.158892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:34.158892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:34.158892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:34.158892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:34.159818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:34.159818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:34.159818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:34.159818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:34.159818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:34.159818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:34.159818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:34.159818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:34.159818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:34.159818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:34.159818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:34.159818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:34.159818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:34.159818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:34.159818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:34.159818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:34.159818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:34.160723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:34.160723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:34.160723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:34.160723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:34.161785 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 225/461] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:34.163171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613d9ec-b6a1-43e3-9023-65215da37793 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:34.163589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613d9ec-b6a1-43e3-9023-65215da37793 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:34.164847 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613d9ec-b6a1-43e3-9023-65215da37793 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:34.167776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 237/462] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:34.173226 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91bac5-f478-4079-9980-4fdc92bcd169 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:34.174609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55134832-3b30-4666-913c-d99857fd9dab None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:34.174926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55134832-3b30-4666-913c-d99857fd9dab None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:34.175199 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55134832-3b30-4666-913c-d99857fd9dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:34.193478 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-55134832-3b30-4666-913c-d99857fd9dab None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:34.194696 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-55134832-3b30-4666-913c-d99857fd9dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:34.241640 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:34.283926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 238/463] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:34.285826 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55134832-3b30-4666-913c-d99857fd9dab None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:34.293528 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91bac5-f478-4079-9980-4fdc92bcd169 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:34.340768 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfed4f-e369-4daf-9d6b-2896bbdb7188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:34.341823 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfed4f-e369-4daf-9d6b-2896bbdb7188 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:34.342393 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfed4f-e369-4daf-9d6b-2896bbdb7188 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:34.342889 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfed4f-e369-4daf-9d6b-2896bbdb7188 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:34.343777 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfed4f-e369-4daf-9d6b-2896bbdb7188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:34.344376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfed4f-e369-4daf-9d6b-2896bbdb7188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:34.345927 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:34.346983 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfed4f-e369-4daf-9d6b-2896bbdb7188 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:34.362484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 226/464] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:34.363259 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfed4f-e369-4daf-9d6b-2896bbdb7188 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:34.411928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55134832-3b30-4666-913c-d99857fd9dab None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:34.454758 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc88162-8fec-44b1-a0f3-bac17dc741a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:34.455245 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc88162-8fec-44b1-a0f3-bac17dc741a3 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:34.455539 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc88162-8fec-44b1-a0f3-bac17dc741a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:34.455824 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc88162-8fec-44b1-a0f3-bac17dc741a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:34.456587 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc88162-8fec-44b1-a0f3-bac17dc741a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:34.456914 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc88162-8fec-44b1-a0f3-bac17dc741a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:34.458305 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc88162-8fec-44b1-a0f3-bac17dc741a3 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:34.471044 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 239/465] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:34.473439 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e9fb9-318c-4a1c-bf36-e1f48f948bba None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:34.473732 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e9fb9-318c-4a1c-bf36-e1f48f948bba None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:34.474010 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e9fb9-318c-4a1c-bf36-e1f48f948bba None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:34.478867 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 240/466] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:34.478867 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e9fb9-318c-4a1c-bf36-e1f48f948bba None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:34.482326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfed4f-e369-4daf-9d6b-2896bbdb7188 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:34.508542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:34.520782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befba1a5-9189-4424-95b0-ffeac9e1ddea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:34.521430 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befba1a5-9189-4424-95b0-ffeac9e1ddea None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:34.521715 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befba1a5-9189-4424-95b0-ffeac9e1ddea None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:34.522511 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befba1a5-9189-4424-95b0-ffeac9e1ddea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:34.532496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befba1a5-9189-4424-95b0-ffeac9e1ddea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:34.533968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befba1a5-9189-4424-95b0-ffeac9e1ddea None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:34.551172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-befba1a5-9189-4424-95b0-ffeac9e1ddea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:34.551172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:34.551172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:34.551172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:34.551172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:34.551172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:34.551172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:34.551172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:34.551172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:34.551172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:34.551172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:34.551172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:34.551172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:34.551172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:34.551172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:34.552042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:34.552042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:34.552042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:34.552042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:34.552042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:34.552042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:34.552042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:34.552042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:34.552042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:34.552042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:34.552042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:34.552042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:34.552042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:34.552042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:34.552042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:34.552042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:34.552042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:34.552891 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:34.552891 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:34.552891 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:34.552891 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:34.552891 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 227/467] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:34.553179 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befba1a5-9189-4424-95b0-ffeac9e1ddea None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:34.595118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e9fb9-318c-4a1c-bf36-e1f48f948bba None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:34.597158 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:34.632934 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995925e3-7f81-4f5d-b401-4056470a358e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:34.633679 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995925e3-7f81-4f5d-b401-4056470a358e None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:34.633963 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995925e3-7f81-4f5d-b401-4056470a358e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:34.634245 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995925e3-7f81-4f5d-b401-4056470a358e None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:34.634961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995925e3-7f81-4f5d-b401-4056470a358e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:34.636540 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995925e3-7f81-4f5d-b401-4056470a358e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:34.659894 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befba1a5-9189-4424-95b0-ffeac9e1ddea None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:34.692853 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc65f3-4a82-48f1-b84a-12cc0f3d8fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:34.693471 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc65f3-4a82-48f1-b84a-12cc0f3d8fd4 None admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:34.693774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc65f3-4a82-48f1-b84a-12cc0f3d8fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:34.694065 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc65f3-4a82-48f1-b84a-12cc0f3d8fd4 None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:34.694759 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc65f3-4a82-48f1-b84a-12cc0f3d8fd4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:34.696205 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc65f3-4a82-48f1-b84a-12cc0f3d8fd4 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:34.724261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 241/468] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 3 12:41:34 2022] POST /identity/v3/users => generated 248 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:41:34.726799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab18cf8-0d72-498a-a31f-4ab71a4e81bd None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:34.726799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab18cf8-0d72-498a-a31f-4ab71a4e81bd None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:34.726799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab18cf8-0d72-498a-a31f-4ab71a4e81bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:34.752083 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-eab18cf8-0d72-498a-a31f-4ab71a4e81bd None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:34.756051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-eab18cf8-0d72-498a-a31f-4ab71a4e81bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:34.820742 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 228/469] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 3 12:41:34 2022] POST /identity/v3/users => generated 246 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:41:34.822636 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc65f3-4a82-48f1-b84a-12cc0f3d8fd4 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:34.852707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 242/470] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:34.866109 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:34.879809 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab18cf8-0d72-498a-a31f-4ab71a4e81bd None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:34.976494 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc65f3-4a82-48f1-b84a-12cc0f3d8fd4 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:35.002157 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:35.018401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab18cf8-0d72-498a-a31f-4ab71a4e81bd None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:35.022634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc8f81-371e-406c-ad9a-ff3724bda84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:35.022634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc8f81-371e-406c-ad9a-ff3724bda84a None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:35.022946 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc8f81-371e-406c-ad9a-ff3724bda84a None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:35.023176 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc8f81-371e-406c-ad9a-ff3724bda84a None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:35.023871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc8f81-371e-406c-ad9a-ff3724bda84a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:35.024174 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc8f81-371e-406c-ad9a-ff3724bda84a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:35.025725 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc8f81-371e-406c-ad9a-ff3724bda84a None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:35.040053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 229/471] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:35.041870 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a71fd4-8c82-4d25-8c0b-2ca85dabbd66 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:35.042082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a71fd4-8c82-4d25-8c0b-2ca85dabbd66 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:35.042349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a71fd4-8c82-4d25-8c0b-2ca85dabbd66 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:35.048637 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 230/472] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:35.049310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a71fd4-8c82-4d25-8c0b-2ca85dabbd66 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:35.074587 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824382f-f166-47db-bc94-c66c84f9d8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:35.075339 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824382f-f166-47db-bc94-c66c84f9d8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:35.075626 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824382f-f166-47db-bc94-c66c84f9d8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:35.075908 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824382f-f166-47db-bc94-c66c84f9d8a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:35.089239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824382f-f166-47db-bc94-c66c84f9d8a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:35.090692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824382f-f166-47db-bc94-c66c84f9d8a9 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:35.114558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-f824382f-f166-47db-bc94-c66c84f9d8a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:35.114558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:35.114558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:35.114558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:35.114558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:35.114558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:35.114558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:35.114558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:35.114558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:35.114558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:35.114558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:35.114558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:35.114558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:35.114558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:35.114558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:35.115502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:35.115502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:35.115502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:35.115502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:35.115502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:35.115502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:35.115502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:35.115502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:35.115502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:35.115502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:35.115502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:35.115502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:35.115502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:35.115502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:35.115502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:35.115502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:35.115502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:35.116526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:35.116526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:35.116526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:35.116526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:35.117069 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 243/473] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:35.119401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fba4b0-c923-4174-b6a2-5f4481730ff6 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:35.119694 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fba4b0-c923-4174-b6a2-5f4481730ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:35.119957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fba4b0-c923-4174-b6a2-5f4481730ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:35.143184 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-81fba4b0-c923-4174-b6a2-5f4481730ff6 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:35.143521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-81fba4b0-c923-4174-b6a2-5f4481730ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:35.184299 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:35.199629 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a71fd4-8c82-4d25-8c0b-2ca85dabbd66 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:35.230284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 244/474] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:35.230284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fba4b0-c923-4174-b6a2-5f4481730ff6 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:35.260763 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39152c0d-78df-4dcf-b612-47e48c91e0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:35.261454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39152c0d-78df-4dcf-b612-47e48c91e0b7 None admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:35.261739 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39152c0d-78df-4dcf-b612-47e48c91e0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:35.262013 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39152c0d-78df-4dcf-b612-47e48c91e0b7 None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:35.262704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39152c0d-78df-4dcf-b612-47e48c91e0b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:35.264200 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39152c0d-78df-4dcf-b612-47e48c91e0b7 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:35.317817 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:35.350450 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fba4b0-c923-4174-b6a2-5f4481730ff6 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:35.370605 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 231/475] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 3 12:41:35 2022] POST /identity/v3/users => generated 248 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:41:35.372839 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39152c0d-78df-4dcf-b612-47e48c91e0b7 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:35.392966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46757efb-fcac-4bd8-883d-0588af2a6727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:35.394163 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46757efb-fcac-4bd8-883d-0588af2a6727 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:35.394644 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46757efb-fcac-4bd8-883d-0588af2a6727 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:35.395224 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46757efb-fcac-4bd8-883d-0588af2a6727 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:35.396369 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46757efb-fcac-4bd8-883d-0588af2a6727 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:35.398795 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46757efb-fcac-4bd8-883d-0588af2a6727 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:35.398795 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46757efb-fcac-4bd8-883d-0588af2a6727 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:35.413834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 245/476] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:35.423896 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46757efb-fcac-4bd8-883d-0588af2a6727 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:35.497948 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39152c0d-78df-4dcf-b612-47e48c91e0b7 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:35.538343 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad55f4-69d8-47f9-976f-4f333c2c46ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:35.539077 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad55f4-69d8-47f9-976f-4f333c2c46ec None admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:35.539358 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad55f4-69d8-47f9-976f-4f333c2c46ec None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:35.539631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad55f4-69d8-47f9-976f-4f333c2c46ec None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:35.541003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad55f4-69d8-47f9-976f-4f333c2c46ec None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:35.542401 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad55f4-69d8-47f9-976f-4f333c2c46ec None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:35.580483 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.sql.core [None req-92ad55f4-69d8-47f9-976f-4f333c2c46ec None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 03 12:41:35.580483 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 03 12:41:35.580483 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [parameters: {'id': 'c58a5ab8ccb54d2abfd6eb192027b347', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 03 12:41:35.580483 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81208) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 03 12:41:35.599162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-92ad55f4-69d8-47f9-976f-4f333c2c46ec None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 03 12:41:35.599162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:35.599162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 12:41:35.599162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 12:41:35.599162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 12:41:35.599162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 12:41:35.599162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 12:41:35.599162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 12:41:35.599162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 12:41:35.599162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application conn.query(q) Aug 03 12:41:35.599162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 12:41:35.599162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 12:41:35.599162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 12:41:35.599162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application result.read() Aug 03 12:41:35.599162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 12:41:35.600652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 12:41:35.600652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 12:41:35.600652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 12:41:35.600652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 12:41:35.600652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 12:41:35.600652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 12:41:35.600652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 12:41:35.600652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 03 12:41:35.600652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:35.600652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 03 12:41:35.600652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:35.600652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:35.600652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 03 12:41:35.600652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 03 12:41:35.600652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 03 12:41:35.600652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return ref.to_dict() Aug 03 12:41:35.600652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 12:41:35.600652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application next(self.gen) Aug 03 12:41:35.601599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 03 12:41:35.601599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application yield resource Aug 03 12:41:35.601599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 12:41:35.601599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application next(self.gen) Aug 03 12:41:35.601599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 03 12:41:35.601599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self.session.rollback() Aug 03 12:41:35.601599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 12:41:35.601599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self.force_reraise() Aug 03 12:41:35.601599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 12:41:35.601599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise self.value Aug 03 12:41:35.601599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 03 12:41:35.601599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 03 12:41:35.601599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 03 12:41:35.601599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application session.commit() Aug 03 12:41:35.601599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 03 12:41:35.601599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 03 12:41:35.601599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 03 12:41:35.602434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._prepare_impl() Aug 03 12:41:35.602434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 03 12:41:35.602434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self.session.flush() Aug 03 12:41:35.602434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 03 12:41:35.602434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._flush(objects) Aug 03 12:41:35.602434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 03 12:41:35.602434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 03 12:41:35.602434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 03 12:41:35.602434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application compat.raise_( Aug 03 12:41:35.602434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 12:41:35.602434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception Aug 03 12:41:35.602434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 03 12:41:35.602434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application flush_context.execute() Aug 03 12:41:35.602434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 03 12:41:35.602434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rec.execute(self) Aug 03 12:41:35.602434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 03 12:41:35.602434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 03 12:41:35.608410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 03 12:41:35.608410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 03 12:41:35.608410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 03 12:41:35.608410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 03 12:41:35.608410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 03 12:41:35.608410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 03 12:41:35.608410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 03 12:41:35.608410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 03 12:41:35.608410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 03 12:41:35.608410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 03 12:41:35.608410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 03 12:41:35.608410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 03 12:41:35.608410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 03 12:41:35.608410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 03 12:41:35.608410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 12:41:35.608410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception Aug 03 12:41:35.610664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 12:41:35.610664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 12:41:35.610664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 12:41:35.610664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 12:41:35.610664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 12:41:35.610664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 12:41:35.610664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 12:41:35.610664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application conn.query(q) Aug 03 12:41:35.610664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 12:41:35.610664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 12:41:35.610664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 12:41:35.610664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application result.read() Aug 03 12:41:35.610664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 12:41:35.610664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 12:41:35.610664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 12:41:35.610664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 12:41:35.612414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 12:41:35.612414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 12:41:35.612414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 12:41:35.612414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 12:41:35.612414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 03 12:41:35.612414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 03 12:41:35.612414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [parameters: {'id': 'c58a5ab8ccb54d2abfd6eb192027b347', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 03 12:41:35.612414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 03 12:41:35.612414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:35.612414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:41:35.612414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:35.612414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:35.612414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:35.612414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:35.612414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:35.612414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:35.613878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:35.613878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:35.613878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:35.613878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:35.613878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:35.613878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:35.613878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 03 12:41:35.613878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 03 12:41:35.613878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:35.613878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:35.613878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 03 12:41:35.613878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 03 12:41:35.613878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 03 12:41:35.613878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 03 12:41:35.613878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 03 12:41:35.613878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:35.617241 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 232/477] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Aug 3 12:41:35 2022] POST /identity/v3/roles => generated 144 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:35.619788 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad55f4-69d8-47f9-976f-4f333c2c46ec None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:35.620714 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46757efb-fcac-4bd8-883d-0588af2a6727 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:35.640108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:35.684653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:35.696170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfaeada-776c-4a58-a034-2c1d8194466e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:35.697345 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaeada-776c-4a58-a034-2c1d8194466e None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:35.697874 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaeada-776c-4a58-a034-2c1d8194466e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:35.698378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaeada-776c-4a58-a034-2c1d8194466e None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:35.699625 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaeada-776c-4a58-a034-2c1d8194466e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:35.702135 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaeada-776c-4a58-a034-2c1d8194466e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:35.739717 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad55f4-69d8-47f9-976f-4f333c2c46ec None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:35.780119 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c0497-b4cf-4cec-854b-0b06cf5bacda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:35.781269 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c0497-b4cf-4cec-854b-0b06cf5bacda None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:35.781769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c0497-b4cf-4cec-854b-0b06cf5bacda None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:35.782247 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c0497-b4cf-4cec-854b-0b06cf5bacda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:35.796592 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c0497-b4cf-4cec-854b-0b06cf5bacda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:35.802575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-d12c0497-b4cf-4cec-854b-0b06cf5bacda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:41:35.802575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:35.802575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:35.802575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:35.802575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:35.802575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:35.802575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:35.802575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:35.802575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:35.802575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:35.802575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:35.802575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:35.802575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:35.802575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:35.802575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:35.802575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:35.808235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:35.808235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:35.808235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:35.808235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:35.808235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:35.808235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:35.808235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:35.808235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:35.808235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:35.808235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:35.808235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:35.808235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:35.808235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:35.808235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:35.808235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:35.808235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:35.809024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:35.809024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:35.809024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:35.809024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:35.809024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:35.809024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:35.809024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:35.809024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:35.809024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:35.809024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:35.809024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:41:35.809024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:35.809024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 233/478] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:41:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:35.813568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c0497-b4cf-4cec-854b-0b06cf5bacda None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:35.833338 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 246/479] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 3 12:41:35 2022] POST /identity/v3/users => generated 249 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:41:35.906001 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:35.943126 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c0497-b4cf-4cec-854b-0b06cf5bacda None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:35.982990 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68e122-5aa8-4d66-9be2-4ec10d422ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:35.984065 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68e122-5aa8-4d66-9be2-4ec10d422ace None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:35.984598 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68e122-5aa8-4d66-9be2-4ec10d422ace None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:35.985073 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68e122-5aa8-4d66-9be2-4ec10d422ace None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:35.986015 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68e122-5aa8-4d66-9be2-4ec10d422ace None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:35.986540 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68e122-5aa8-4d66-9be2-4ec10d422ace None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:35.988174 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68e122-5aa8-4d66-9be2-4ec10d422ace None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:35.998384 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 234/480] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:37.349590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dfc30-537f-4cf5-84cf-b710279fcdf4 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:37.350163 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dfc30-537f-4cf5-84cf-b710279fcdf4 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:37.350240 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dfc30-537f-4cf5-84cf-b710279fcdf4 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:37.351861 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 247/481] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:37.365621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cd6e3-1d8f-4869-a176-3fde23fdd372 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:37.366083 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cd6e3-1d8f-4869-a176-3fde23fdd372 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:37.366179 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cd6e3-1d8f-4869-a176-3fde23fdd372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:37.388083 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3f4a3-f727-4732-81fe-0ad15a954fa9 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:37.388367 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3f4a3-f727-4732-81fe-0ad15a954fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:37.388651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3f4a3-f727-4732-81fe-0ad15a954fa9 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:37.389502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-7c3cd6e3-1d8f-4869-a176-3fde23fdd372 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:37.396056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 248/482] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:41:37.396172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-7c3cd6e3-1d8f-4869-a176-3fde23fdd372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:37.396260 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e474bb3-cc1f-491f-ae2f-8ce02bd1f93c None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:37.396260 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e474bb3-cc1f-491f-ae2f-8ce02bd1f93c None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:37.396260 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e474bb3-cc1f-491f-ae2f-8ce02bd1f93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:37.438031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-5e474bb3-cc1f-491f-ae2f-8ce02bd1f93c None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:37.439267 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-5e474bb3-cc1f-491f-ae2f-8ce02bd1f93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:37.493640 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 235/483] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:37.521409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cd6e3-1d8f-4869-a176-3fde23fdd372 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:37.594767 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:37.609214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 249/484] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:41:37.638387 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cd6e3-1d8f-4869-a176-3fde23fdd372 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:37.652603 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e474bb3-cc1f-491f-ae2f-8ce02bd1f93c None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:37.675395 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942066e-dc4d-4444-a492-e1a153815368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:37.676444 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942066e-dc4d-4444-a492-e1a153815368 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:37.676926 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942066e-dc4d-4444-a492-e1a153815368 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:37.677419 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942066e-dc4d-4444-a492-e1a153815368 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:37.689172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942066e-dc4d-4444-a492-e1a153815368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:37.695535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-0942066e-dc4d-4444-a492-e1a153815368 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:37.695535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:37.695535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:37.695535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:37.695535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:37.695535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:37.695535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:37.695535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:37.695535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:37.695535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:37.695535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:37.695535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:37.695535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:37.695535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:37.695535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:37.695535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:37.696406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:37.696406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:37.696406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:37.696406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:37.696406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:37.696406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:37.696406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:37.696406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:37.696406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:37.696406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:37.696406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:37.696406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:37.696406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:37.696406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:37.696406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:37.696406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:37.697189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:37.697189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:37.697189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:37.697189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:37.697189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:37.697189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:37.697189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:37.697189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:37.697189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:37.697189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:37.697189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:37.697189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:37.699854 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 236/485] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:41:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:37.705808 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942066e-dc4d-4444-a492-e1a153815368 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:37.827114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e474bb3-cc1f-491f-ae2f-8ce02bd1f93c None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:37.846962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:37.861209 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942066e-dc4d-4444-a492-e1a153815368 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:37.873771 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a1c66-a987-4deb-af69-a936e92c5caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:37.875065 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a1c66-a987-4deb-af69-a936e92c5caa None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:37.875565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a1c66-a987-4deb-af69-a936e92c5caa None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:37.876318 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a1c66-a987-4deb-af69-a936e92c5caa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:37.888312 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:37.891782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a1c66-a987-4deb-af69-a936e92c5caa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:37.898498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-626a1c66-a987-4deb-af69-a936e92c5caa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:37.898498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:37.898498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:37.898498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:37.898498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:37.898498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:37.898498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:37.898498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:37.898498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:37.898498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:37.898498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:37.898498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:37.898498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:37.898498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:37.898498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:37.898498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:37.899406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:37.899406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:37.899406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:37.899406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:37.899406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:37.899406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:37.899406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:37.899406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:37.899406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:37.899406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:37.899406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:37.899406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:37.899406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:37.899406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:37.899406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:37.899406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:37.900193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:37.900193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:37.900193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:37.900193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:37.900193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:37.900193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:37.900193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:37.900193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:37.900193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:37.900193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:37.900193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:37.900193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:37.900792 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac3492-ccad-405b-ae24-46853e315b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:37.901165 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac3492-ccad-405b-ae24-46853e315b11 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:37.901756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac3492-ccad-405b-ae24-46853e315b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:37.902130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac3492-ccad-405b-ae24-46853e315b11 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:37.903100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac3492-ccad-405b-ae24-46853e315b11 None admin] RBAC: Adding query filter params (name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:37.903246 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 250/486] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:41:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:37.905071 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaef582-40af-449c-bf0a-b35a230f5a5f None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:37.905493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaef582-40af-449c-bf0a-b35a230f5a5f None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:37.905913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaef582-40af-449c-bf0a-b35a230f5a5f None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:37.907584 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 251/487] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:37.908136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac3492-ccad-405b-ae24-46853e315b11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:37.909702 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac3492-ccad-405b-ae24-46853e315b11 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:37.913544 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fb162-0c39-48b0-a7ec-a0631a13a743 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:37.914180 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fb162-0c39-48b0-a7ec-a0631a13a743 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:37.914865 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fb162-0c39-48b0-a7ec-a0631a13a743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:37.923309 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 237/488] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 3 12:41:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:37.924265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac3492-ccad-405b-ae24-46853e315b11 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:37.940154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-a37fb162-0c39-48b0-a7ec-a0631a13a743 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:37.942072 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-a37fb162-0c39-48b0-a7ec-a0631a13a743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:38.041061 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac3492-ccad-405b-ae24-46853e315b11 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:38.041245 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 252/489] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:38.041245 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fb162-0c39-48b0-a7ec-a0631a13a743 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:38.089858 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a6460-cc30-40e6-bb4f-1b8ad31db6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:38.090727 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a6460-cc30-40e6-bb4f-1b8ad31db6f2 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:38.091075 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a6460-cc30-40e6-bb4f-1b8ad31db6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:38.091322 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a6460-cc30-40e6-bb4f-1b8ad31db6f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:38.092049 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a6460-cc30-40e6-bb4f-1b8ad31db6f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:38.092526 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a6460-cc30-40e6-bb4f-1b8ad31db6f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:38.094072 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a6460-cc30-40e6-bb4f-1b8ad31db6f2 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:38.110810 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 238/490] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 3 12:41:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:38.112215 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a6460-cc30-40e6-bb4f-1b8ad31db6f2 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:38.179385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:38.188219 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fb162-0c39-48b0-a7ec-a0631a13a743 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:38.199205 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:38.237397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4c322-0bac-4a63-a416-b57bd3c9633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:38.238206 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4c322-0bac-4a63-a416-b57bd3c9633a None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:38.238679 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4c322-0bac-4a63-a416-b57bd3c9633a None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:38.239079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4c322-0bac-4a63-a416-b57bd3c9633a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:38.250442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4c322-0bac-4a63-a416-b57bd3c9633a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:38.250617 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a6460-cc30-40e6-bb4f-1b8ad31db6f2 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:38.252185 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4c322-0bac-4a63-a416-b57bd3c9633a None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:38.267943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-96d4c322-0bac-4a63-a416-b57bd3c9633a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:38.267943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:38.267943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:38.267943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:38.267943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:38.267943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:38.267943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:38.267943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:38.267943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:38.267943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:38.267943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:38.267943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:38.267943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:38.267943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:38.267943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:38.269002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:38.269002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:38.269002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:38.269002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:38.269002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:38.269002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:38.269002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:38.269002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:38.269002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:38.269002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:38.269002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:38.269002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:38.269002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:38.269002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:38.269002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:38.269002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:38.269002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:38.269890 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:38.269890 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:38.269890 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:38.269890 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:38.271045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 253/491] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:38.272679 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4c322-0bac-4a63-a416-b57bd3c9633a None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:38.297217 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcc54f-291d-41f5-9a61-48032018fc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:38.298667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcc54f-291d-41f5-9a61-48032018fc7d None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:38.299195 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcc54f-291d-41f5-9a61-48032018fc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:38.299953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcc54f-291d-41f5-9a61-48032018fc7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:38.314861 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcc54f-291d-41f5-9a61-48032018fc7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:38.322385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-68fcc54f-291d-41f5-9a61-48032018fc7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:38.322385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:38.322385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:38.322385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:38.322385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:38.322385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:38.322385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:38.322385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:38.322385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:38.322385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:38.322385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:38.322385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:38.322385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:38.322385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:38.322385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:38.322385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:38.323319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:38.323319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:38.323319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:38.323319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:38.323319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:38.323319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:38.323319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:38.323319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:38.323319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:38.323319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:38.323319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:38.323319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:38.323319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:38.323319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:38.323319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:38.323319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:38.324094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:38.324094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:38.324094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:38.324094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:38.324094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:38.324094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:38.324094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:38.324094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:38.324094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:38.324094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:38.324094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:38.324094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:38.331363 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 239/492] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:41:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:38.331363 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcc54f-291d-41f5-9a61-48032018fc7d None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:38.391104 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4c322-0bac-4a63-a416-b57bd3c9633a None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:38.429154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94526d8-e4ae-42d8-a2fa-439b3cb33ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:38.430142 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94526d8-e4ae-42d8-a2fa-439b3cb33ede None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:38.430628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94526d8-e4ae-42d8-a2fa-439b3cb33ede None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:38.431176 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94526d8-e4ae-42d8-a2fa-439b3cb33ede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:38.440132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcc54f-291d-41f5-9a61-48032018fc7d None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:38.449620 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94526d8-e4ae-42d8-a2fa-439b3cb33ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:38.449620 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94526d8-e4ae-42d8-a2fa-439b3cb33ede None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:38.449805 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:38.462701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-a94526d8-e4ae-42d8-a2fa-439b3cb33ede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:38.462701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:38.462701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:38.462701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:38.462701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:38.462701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:38.462701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:38.462701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:38.462701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:38.462701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:38.462701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:38.462701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:38.462701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:38.462701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:38.462701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:38.463785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:38.463785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:38.463785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:38.463785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:38.463785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:38.463785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:38.463785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:38.463785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:38.463785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:38.463785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:38.463785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:38.463785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:38.463785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:38.463785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:38.463785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:38.463785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:38.463785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:38.464830 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:38.464830 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:38.464830 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:38.464830 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:38.466372 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 254/493] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:38.467342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94526d8-e4ae-42d8-a2fa-439b3cb33ede None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:38.478480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91953a6e-c297-44e2-8356-290f11d640e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:38.479150 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91953a6e-c297-44e2-8356-290f11d640e0 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:38.479548 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91953a6e-c297-44e2-8356-290f11d640e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:38.479827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91953a6e-c297-44e2-8356-290f11d640e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:38.480522 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91953a6e-c297-44e2-8356-290f11d640e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:38.480827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91953a6e-c297-44e2-8356-290f11d640e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:38.481190 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:38.483213 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91953a6e-c297-44e2-8356-290f11d640e0 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:38.494925 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 240/494] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:38.496161 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b850f3-04be-4e70-9a23-1c4308068307 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:38.496718 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b850f3-04be-4e70-9a23-1c4308068307 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:38.497511 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b850f3-04be-4e70-9a23-1c4308068307 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:38.498858 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 241/495] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:38.499463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b850f3-04be-4e70-9a23-1c4308068307 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:38.577211 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94526d8-e4ae-42d8-a2fa-439b3cb33ede None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:38.600566 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b850f3-04be-4e70-9a23-1c4308068307 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:38.609958 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2959515-6687-4b93-b225-84d13441b7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:38.610569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2959515-6687-4b93-b225-84d13441b7ab None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:38.610879 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2959515-6687-4b93-b225-84d13441b7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:38.611204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2959515-6687-4b93-b225-84d13441b7ab None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:38.611914 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2959515-6687-4b93-b225-84d13441b7ab None admin] RBAC: Adding query filter params (name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:38.612217 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2959515-6687-4b93-b225-84d13441b7ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:38.613570 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2959515-6687-4b93-b225-84d13441b7ab None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:38.621297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 255/496] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 3 12:41:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:38.622421 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c83a0-c954-4ec9-8335-278a5fd1f915 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:38.622707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c83a0-c954-4ec9-8335-278a5fd1f915 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:38.623008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c83a0-c954-4ec9-8335-278a5fd1f915 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:38.626903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 256/497] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:38.626903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c83a0-c954-4ec9-8335-278a5fd1f915 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:38.639332 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40225765-87f5-417a-bed9-2134ebcbdcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:38.639956 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40225765-87f5-417a-bed9-2134ebcbdcee None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:38.640247 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40225765-87f5-417a-bed9-2134ebcbdcee None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:38.640528 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40225765-87f5-417a-bed9-2134ebcbdcee None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:38.641229 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40225765-87f5-417a-bed9-2134ebcbdcee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:38.641536 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40225765-87f5-417a-bed9-2134ebcbdcee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:38.643026 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40225765-87f5-417a-bed9-2134ebcbdcee None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:38.654527 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 242/498] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:38.655768 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7340c-97a3-4d04-8b5d-9e56e13ca92e None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:38.656067 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7340c-97a3-4d04-8b5d-9e56e13ca92e None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:38.656351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7340c-97a3-4d04-8b5d-9e56e13ca92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:38.674235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-e0e7340c-97a3-4d04-8b5d-9e56e13ca92e None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:38.675478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e0e7340c-97a3-4d04-8b5d-9e56e13ca92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:38.695817 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:38.699690 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:38.729571 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c83a0-c954-4ec9-8335-278a5fd1f915 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:38.741257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 243/499] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:38.742078 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7340c-97a3-4d04-8b5d-9e56e13ca92e None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:38.764813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f2af7-6746-4e38-870f-b4226e25fa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:38.765462 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f2af7-6746-4e38-870f-b4226e25fa88 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:38.765753 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f2af7-6746-4e38-870f-b4226e25fa88 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:38.766031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f2af7-6746-4e38-870f-b4226e25fa88 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:38.774092 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f2af7-6746-4e38-870f-b4226e25fa88 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:38.775568 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f2af7-6746-4e38-870f-b4226e25fa88 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:38.787943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-328f2af7-6746-4e38-870f-b4226e25fa88 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 03 12:41:38.787943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:38.787943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:38.787943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:38.787943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:38.787943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:38.787943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:38.787943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:38.787943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:38.787943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:38.787943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:38.787943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:38.787943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:38.787943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:38.787943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:38.787943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:38.789016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:38.789016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:38.789016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:38.789016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:38.789016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:38.789016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:38.789016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:38.789016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:38.789016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:38.789016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:38.789016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:38.789016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:38.789016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:38.789016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:38.789016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:38.789016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:38.789016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:38.789016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:38.789913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:38.789913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:38.789913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:38.789913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:38.789913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:38.789913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:38.789913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:38.789913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:38.789913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 03 12:41:38.789913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:38.789913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 257/500] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:38.791866 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f88fa-69f0-4b4f-92f5-797215cecbe1 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:38.792153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f88fa-69f0-4b4f-92f5-797215cecbe1 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:38.792429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f88fa-69f0-4b4f-92f5-797215cecbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:38.810106 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-813f88fa-69f0-4b4f-92f5-797215cecbe1 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:38.811363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-813f88fa-69f0-4b4f-92f5-797215cecbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:38.854152 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7340c-97a3-4d04-8b5d-9e56e13ca92e None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:38.880736 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 258/501] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:38.881898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f88fa-69f0-4b4f-92f5-797215cecbe1 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:38.902427 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49722e2b-8881-47d0-a4f6-bc7c4c311b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:38.903343 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49722e2b-8881-47d0-a4f6-bc7c4c311b60 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:38.903650 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49722e2b-8881-47d0-a4f6-bc7c4c311b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:38.903930 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49722e2b-8881-47d0-a4f6-bc7c4c311b60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:38.914155 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49722e2b-8881-47d0-a4f6-bc7c4c311b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:38.916093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49722e2b-8881-47d0-a4f6-bc7c4c311b60 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:38.931071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-49722e2b-8881-47d0-a4f6-bc7c4c311b60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:38.931071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:38.931071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:38.931071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:38.931071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:38.931071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:38.931071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:38.931071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:38.931071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:38.931071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:38.931071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:38.931071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:38.931071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:38.931071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:38.931071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:38.931919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:38.931919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:38.931919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:38.931919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:38.931919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:38.931919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:38.931919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:38.931919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:38.931919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:38.931919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:38.931919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:38.931919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:38.931919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:38.931919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:38.931919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:38.931919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:38.931919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:38.932764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:38.932764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:38.932764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:38.932764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:38.932764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 244/502] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:38.933027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49722e2b-8881-47d0-a4f6-bc7c4c311b60 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:38.941809 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:38.944326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:38.980149 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f88fa-69f0-4b4f-92f5-797215cecbe1 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:39.014897 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7ff4c-4172-4b88-a94c-36c265a91941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:39.015535 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7ff4c-4172-4b88-a94c-36c265a91941 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:39.015819 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7ff4c-4172-4b88-a94c-36c265a91941 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:39.016099 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7ff4c-4172-4b88-a94c-36c265a91941 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:39.023058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7ff4c-4172-4b88-a94c-36c265a91941 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:39.024502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7ff4c-4172-4b88-a94c-36c265a91941 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:39.030883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49722e2b-8881-47d0-a4f6-bc7c4c311b60 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:39.035779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-8ce7ff4c-4172-4b88-a94c-36c265a91941 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:41:39.035779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:39.035779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:39.035779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:39.035779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:39.035779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:39.035779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:39.035779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:39.035779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:39.035779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:39.035779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:39.035779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:39.035779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:39.035779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:39.035779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:39.035779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:39.036742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:39.036742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:39.036742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:39.036742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:39.036742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:39.036742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:39.036742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:39.036742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:39.036742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:39.036742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:39.036742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:39.036742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:39.036742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:39.036742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:39.036742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:39.036742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:39.036742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:39.036742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:39.037748 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:39.037748 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:39.037748 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:39.037748 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:39.037748 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:39.037748 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:39.037748 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:39.037748 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:39.037748 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:41:39.037748 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:39.037748 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 259/503] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 3 12:41:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:39.037748 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7ff4c-4172-4b88-a94c-36c265a91941 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:39.066212 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1baf7-acc8-4bbd-bdd1-b002dc1b9f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:39.066888 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1baf7-acc8-4bbd-bdd1-b002dc1b9f1e None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:39.067168 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1baf7-acc8-4bbd-bdd1-b002dc1b9f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:39.067447 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1baf7-acc8-4bbd-bdd1-b002dc1b9f1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:39.078355 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1baf7-acc8-4bbd-bdd1-b002dc1b9f1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:39.079849 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1baf7-acc8-4bbd-bdd1-b002dc1b9f1e None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:39.094005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-c1d1baf7-acc8-4bbd-bdd1-b002dc1b9f1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:39.094005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:39.094005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:39.094005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:39.094005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:39.094005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:39.094005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:39.094005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:39.094005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:39.094005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:39.094005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:39.094005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:39.094005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:39.094005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:39.094005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:39.094882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:39.094882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:39.094882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:39.094882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:39.094882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:39.094882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:39.094882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:39.094882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:39.094882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:39.094882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:39.094882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:39.094882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:39.094882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:39.094882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:39.094882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:39.094882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:39.094882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:39.095764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:39.095764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:39.095764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:39.095764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:39.095764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 245/504] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:39.096028 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1baf7-acc8-4bbd-bdd1-b002dc1b9f1e None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:39.145404 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7ff4c-4172-4b88-a94c-36c265a91941 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:39.155893 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:39.168285 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:39.180108 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dbe18-dd9c-441a-b9a2-2f8432c06b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:39.180729 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dbe18-dd9c-441a-b9a2-2f8432c06b26 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:39.181015 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dbe18-dd9c-441a-b9a2-2f8432c06b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:39.181296 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dbe18-dd9c-441a-b9a2-2f8432c06b26 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:39.182093 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dbe18-dd9c-441a-b9a2-2f8432c06b26 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:39.182440 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dbe18-dd9c-441a-b9a2-2f8432c06b26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:39.183907 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dbe18-dd9c-441a-b9a2-2f8432c06b26 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:39.197184 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1baf7-acc8-4bbd-bdd1-b002dc1b9f1e None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:39.220165 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 260/505] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 3 12:41:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:39.220989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dbe18-dd9c-441a-b9a2-2f8432c06b26 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:39.234242 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b3c37-3b6f-4a58-8a2e-fb446ea70f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:39.234851 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b3c37-3b6f-4a58-8a2e-fb446ea70f9d None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:39.235140 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b3c37-3b6f-4a58-8a2e-fb446ea70f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:39.235428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b3c37-3b6f-4a58-8a2e-fb446ea70f9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:39.246250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b3c37-3b6f-4a58-8a2e-fb446ea70f9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:39.251655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-a09b3c37-3b6f-4a58-8a2e-fb446ea70f9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:39.251655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:39.251655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:39.251655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:39.251655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:39.251655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:39.251655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:39.251655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:39.251655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:39.251655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:39.251655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:39.251655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:39.251655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:39.251655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:39.251655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:39.251655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:39.252700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:39.252700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:39.252700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:39.252700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:39.252700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:39.252700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:39.252700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:39.252700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:39.252700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:39.252700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:39.252700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:39.252700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:39.252700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:39.252700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:39.252700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:39.252700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:39.253500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:39.253500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:39.253500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:39.253500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:39.253500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:39.253500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:39.253500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:39.253500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:39.253500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:39.253500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:39.253500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:39.253500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:39.253500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 246/506] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:41:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:39.254172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b3c37-3b6f-4a58-8a2e-fb446ea70f9d None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:39.325641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dbe18-dd9c-441a-b9a2-2f8432c06b26 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:39.351659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b3c37-3b6f-4a58-8a2e-fb446ea70f9d None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:39.360839 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864562af-c8c7-4b78-bdcf-5f586608d870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:39.361762 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864562af-c8c7-4b78-bdcf-5f586608d870 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:39.362055 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864562af-c8c7-4b78-bdcf-5f586608d870 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:39.362485 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864562af-c8c7-4b78-bdcf-5f586608d870 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:39.363213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864562af-c8c7-4b78-bdcf-5f586608d870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:39.363523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864562af-c8c7-4b78-bdcf-5f586608d870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:39.364901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864562af-c8c7-4b78-bdcf-5f586608d870 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:39.372285 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:39.376790 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 261/507] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:39.377552 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864562af-c8c7-4b78-bdcf-5f586608d870 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:39.386901 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de05391-6514-450d-83fd-23d0137626ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:39.387522 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de05391-6514-450d-83fd-23d0137626ee None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:39.387809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de05391-6514-450d-83fd-23d0137626ee None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:39.388091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de05391-6514-450d-83fd-23d0137626ee None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:39.388897 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de05391-6514-450d-83fd-23d0137626ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:39.389216 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de05391-6514-450d-83fd-23d0137626ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:39.390664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de05391-6514-450d-83fd-23d0137626ee None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:39.420446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:39.427318 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 247/508] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 3 12:41:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:39.428735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de05391-6514-450d-83fd-23d0137626ee None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:39.479446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864562af-c8c7-4b78-bdcf-5f586608d870 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:39.512513 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba105a-4ccd-48c6-999a-c09f91ef7ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:39.513070 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba105a-4ccd-48c6-999a-c09f91ef7ebf None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:39.513357 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba105a-4ccd-48c6-999a-c09f91ef7ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:39.513640 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba105a-4ccd-48c6-999a-c09f91ef7ebf None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:39.514338 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba105a-4ccd-48c6-999a-c09f91ef7ebf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:39.514647 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba105a-4ccd-48c6-999a-c09f91ef7ebf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:39.516060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba105a-4ccd-48c6-999a-c09f91ef7ebf None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:39.525863 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de05391-6514-450d-83fd-23d0137626ee None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:39.527477 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 262/509] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:39.528263 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba105a-4ccd-48c6-999a-c09f91ef7ebf None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:39.560773 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b843d-2476-4abb-8f59-41e945b25d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:39.561386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b843d-2476-4abb-8f59-41e945b25d8e None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:39.561668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b843d-2476-4abb-8f59-41e945b25d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:39.561939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b843d-2476-4abb-8f59-41e945b25d8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:39.606530 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:39.623388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:39.626270 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba105a-4ccd-48c6-999a-c09f91ef7ebf None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:39.628169 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b843d-2476-4abb-8f59-41e945b25d8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:39.629654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b843d-2476-4abb-8f59-41e945b25d8e None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:39.659852 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724670b-b0c4-4a91-9870-27f9141af26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:39.660587 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724670b-b0c4-4a91-9870-27f9141af26e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:39.660877 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724670b-b0c4-4a91-9870-27f9141af26e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:39.661160 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724670b-b0c4-4a91-9870-27f9141af26e None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:39.661886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724670b-b0c4-4a91-9870-27f9141af26e None admin] RBAC: Adding query filter params (name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:39.662837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724670b-b0c4-4a91-9870-27f9141af26e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:39.664226 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724670b-b0c4-4a91-9870-27f9141af26e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:39.672493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 263/510] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 3 12:41:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:39.673280 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724670b-b0c4-4a91-9870-27f9141af26e None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:39.728731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 248/511] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:39.729879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b843d-2476-4abb-8f59-41e945b25d8e None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:39.770149 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724670b-b0c4-4a91-9870-27f9141af26e None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:39.803596 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1156b-e472-41fc-b42a-af62d2e24b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:39.804243 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1156b-e472-41fc-b42a-af62d2e24b92 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:39.804532 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1156b-e472-41fc-b42a-af62d2e24b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:39.804811 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1156b-e472-41fc-b42a-af62d2e24b92 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:39.807608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:39.813500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1156b-e472-41fc-b42a-af62d2e24b92 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:39.814997 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1156b-e472-41fc-b42a-af62d2e24b92 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:39.826306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-35a1156b-e472-41fc-b42a-af62d2e24b92 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:41:39.826306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:39.826306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:39.826306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:39.826306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:39.826306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:39.826306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:39.826306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:39.826306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:39.826306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:39.826306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:39.826306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:39.826306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:39.826306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:39.826306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:39.826306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:39.827411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:39.827411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:39.827411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:39.827411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:39.827411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:39.827411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:39.827411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:39.827411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:39.827411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:39.827411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:39.827411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:39.827411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:39.827411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:39.827411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:39.827411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:39.827411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:39.827411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:39.827411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:39.828342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:39.828342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:39.828342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:39.828342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:39.828342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:39.828342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:39.828342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:39.828342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:39.828342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:41:39.828342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:39.828342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 264/512] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:39.828894 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b843d-2476-4abb-8f59-41e945b25d8e None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:39.828962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1156b-e472-41fc-b42a-af62d2e24b92 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:39.854718 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:39.862913 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073157d-c4fc-4998-9207-1d059c31e147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:39.863569 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073157d-c4fc-4998-9207-1d059c31e147 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:39.869850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073157d-c4fc-4998-9207-1d059c31e147 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:39.869850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073157d-c4fc-4998-9207-1d059c31e147 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:39.931801 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1156b-e472-41fc-b42a-af62d2e24b92 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:39.938523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073157d-c4fc-4998-9207-1d059c31e147 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:39.940040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073157d-c4fc-4998-9207-1d059c31e147 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:39.965065 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d7dc6-cc00-45f8-b44a-ee11a985e2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:39.965716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d7dc6-cc00-45f8-b44a-ee11a985e2cc None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:39.966004 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d7dc6-cc00-45f8-b44a-ee11a985e2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:39.966277 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d7dc6-cc00-45f8-b44a-ee11a985e2cc None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:39.966983 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d7dc6-cc00-45f8-b44a-ee11a985e2cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:39.968396 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d7dc6-cc00-45f8-b44a-ee11a985e2cc None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:40.016430 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:40.037925 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 265/513] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 3 12:41:39 2022] POST /identity/v3/users => generated 247 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:41:40.038539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 249/514] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:40.039102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d7dc6-cc00-45f8-b44a-ee11a985e2cc None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:40.039389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073157d-c4fc-4998-9207-1d059c31e147 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:40.132389 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:40.160148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d7dc6-cc00-45f8-b44a-ee11a985e2cc None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:40.160634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073157d-c4fc-4998-9207-1d059c31e147 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:40.198411 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b58e6a-d8aa-41fe-8faa-df899417e367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:40.199084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b58e6a-d8aa-41fe-8faa-df899417e367 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:40.199368 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b58e6a-d8aa-41fe-8faa-df899417e367 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:40.199647 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b58e6a-d8aa-41fe-8faa-df899417e367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:40.199838 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02200fc5-22b6-4cb6-b0df-2f85c00788ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:40.200489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02200fc5-22b6-4cb6-b0df-2f85c00788ad None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:40.200774 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02200fc5-22b6-4cb6-b0df-2f85c00788ad None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:40.201055 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02200fc5-22b6-4cb6-b0df-2f85c00788ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:40.212240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b58e6a-d8aa-41fe-8faa-df899417e367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:40.213370 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02200fc5-22b6-4cb6-b0df-2f85c00788ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:40.213883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b58e6a-d8aa-41fe-8faa-df899417e367 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:40.214842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02200fc5-22b6-4cb6-b0df-2f85c00788ad None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:40.229272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-d7b58e6a-d8aa-41fe-8faa-df899417e367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:40.229272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:40.229272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:40.229272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:40.229272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:40.229272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:40.229272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:40.229272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:40.229272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:40.229272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:40.229272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:40.229272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:40.229272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:40.229272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:40.229272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:40.230130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:40.230130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:40.230130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:40.230130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:40.230130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:40.230130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:40.230130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:40.230130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:40.230130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:40.230130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:40.230130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:40.230130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:40.230130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:40.230130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:40.230130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:40.230130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:40.230130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:40.231024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:40.231024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:40.231024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:40.231024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:40.231248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-02200fc5-22b6-4cb6-b0df-2f85c00788ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:40.231248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:40.231248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:40.231248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:40.231248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:40.231248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:40.231248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:40.231248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:40.231248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:40.231248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:40.231248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:40.231248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:40.231248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:40.231248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:40.231248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:40.231968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:40.231968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:40.231968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:40.231968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:40.231968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:40.231968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:40.231968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:40.231968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:40.231968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:40.231968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:40.231968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:40.231968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:40.231968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:40.231968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:40.231968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:40.231968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:40.231968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:40.232801 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:40.232801 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:40.232801 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:40.232801 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:40.233011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 250/515] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:40.233011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b58e6a-d8aa-41fe-8faa-df899417e367 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:40.233140 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 266/516] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:40.233998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02200fc5-22b6-4cb6-b0df-2f85c00788ad None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:40.277799 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:40.344449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02200fc5-22b6-4cb6-b0df-2f85c00788ad None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:40.353218 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b58e6a-d8aa-41fe-8faa-df899417e367 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:40.373317 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:40.379042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cec706-3682-4d5f-886f-3b9c4c9bdb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:40.379692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cec706-3682-4d5f-886f-3b9c4c9bdb44 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:40.379981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cec706-3682-4d5f-886f-3b9c4c9bdb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:40.380263 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cec706-3682-4d5f-886f-3b9c4c9bdb44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:40.389108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefbd4e-3f80-4033-bf13-9bbd411d46cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:40.389728 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefbd4e-3f80-4033-bf13-9bbd411d46cd None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:40.390039 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefbd4e-3f80-4033-bf13-9bbd411d46cd None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:40.390319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefbd4e-3f80-4033-bf13-9bbd411d46cd None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:40.391162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefbd4e-3f80-4033-bf13-9bbd411d46cd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:40.393862 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefbd4e-3f80-4033-bf13-9bbd411d46cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:40.393967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cec706-3682-4d5f-886f-3b9c4c9bdb44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:40.394056 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefbd4e-3f80-4033-bf13-9bbd411d46cd None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:40.394148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cec706-3682-4d5f-886f-3b9c4c9bdb44 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:40.410085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-92cec706-3682-4d5f-886f-3b9c4c9bdb44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:40.410085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:40.410085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:40.410085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:40.410085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:40.410085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:40.410085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:40.410085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:40.410085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:40.410085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:40.410085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:40.410085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:40.410085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:40.410085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:40.410085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:40.411000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:40.411000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:40.411000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:40.411000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:40.411000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:40.411000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:40.411000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:40.411000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:40.411000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:40.411000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:40.411000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:40.411000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:40.411000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:40.411000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:40.411000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:40.411000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:40.411000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:40.411855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:40.411855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:40.411855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:40.411855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:40.411855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 267/517] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:40.412151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cec706-3682-4d5f-886f-3b9c4c9bdb44 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:40.419166 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 251/518] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 3 12:41:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:40.420021 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefbd4e-3f80-4033-bf13-9bbd411d46cd None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:40.518238 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:40.523285 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cec706-3682-4d5f-886f-3b9c4c9bdb44 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:40.531536 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefbd4e-3f80-4033-bf13-9bbd411d46cd None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:40.563049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231de8d-f154-4309-89ed-16234721d08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:40.563671 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231de8d-f154-4309-89ed-16234721d08d None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:40.563956 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231de8d-f154-4309-89ed-16234721d08d None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:40.564231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231de8d-f154-4309-89ed-16234721d08d None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:40.564927 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231de8d-f154-4309-89ed-16234721d08d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:40.565227 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231de8d-f154-4309-89ed-16234721d08d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:40.566612 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231de8d-f154-4309-89ed-16234721d08d None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:40.570016 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92505e2f-5d86-4ccb-b0b8-adb06888eee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:40.570634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92505e2f-5d86-4ccb-b0b8-adb06888eee6 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:40.570947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92505e2f-5d86-4ccb-b0b8-adb06888eee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:40.571227 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92505e2f-5d86-4ccb-b0b8-adb06888eee6 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:40.571919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92505e2f-5d86-4ccb-b0b8-adb06888eee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:40.572226 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92505e2f-5d86-4ccb-b0b8-adb06888eee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:40.573610 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92505e2f-5d86-4ccb-b0b8-adb06888eee6 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:40.583923 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 268/519] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:40.583923 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231de8d-f154-4309-89ed-16234721d08d None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:40.591059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 252/520] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:40.591059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92505e2f-5d86-4ccb-b0b8-adb06888eee6 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:40.633204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:40.690316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231de8d-f154-4309-89ed-16234721d08d None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:40.713270 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92505e2f-5d86-4ccb-b0b8-adb06888eee6 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:40.725201 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d105b4b-4e69-407a-bfdd-53a264e0a931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:40.725824 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d105b4b-4e69-407a-bfdd-53a264e0a931 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:40.726110 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d105b4b-4e69-407a-bfdd-53a264e0a931 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:40.726390 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d105b4b-4e69-407a-bfdd-53a264e0a931 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:40.727112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d105b4b-4e69-407a-bfdd-53a264e0a931 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:40.727424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d105b4b-4e69-407a-bfdd-53a264e0a931 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:40.728791 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d105b4b-4e69-407a-bfdd-53a264e0a931 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:40.744622 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 269/521] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:40.744622 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d105b4b-4e69-407a-bfdd-53a264e0a931 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:40.755544 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875787e-cc2c-4d78-b91e-60c599fddcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:40.756790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875787e-cc2c-4d78-b91e-60c599fddcc6 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:40.757096 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875787e-cc2c-4d78-b91e-60c599fddcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:40.757491 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875787e-cc2c-4d78-b91e-60c599fddcc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:40.776644 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:40.830097 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875787e-cc2c-4d78-b91e-60c599fddcc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:40.831596 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875787e-cc2c-4d78-b91e-60c599fddcc6 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:40.855231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d105b4b-4e69-407a-bfdd-53a264e0a931 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:40.856898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:40.891118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000de2d-7ea8-4e46-a596-a9f5013fd5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:40.891713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000de2d-7ea8-4e46-a596-a9f5013fd5d1 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:40.891992 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000de2d-7ea8-4e46-a596-a9f5013fd5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:40.892259 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000de2d-7ea8-4e46-a596-a9f5013fd5d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:40.899112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000de2d-7ea8-4e46-a596-a9f5013fd5d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:40.900548 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000de2d-7ea8-4e46-a596-a9f5013fd5d1 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:40.912782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-0000de2d-7ea8-4e46-a596-a9f5013fd5d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:40.912782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:40.912782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:40.912782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:40.912782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:40.912782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:40.912782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:40.912782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:40.912782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:40.912782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:40.912782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:40.912782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:40.912782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:41:40.912782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:41:40.912782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:41:40.913971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:41:40.913971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:40.913971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:40.913971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:40.913971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:40.913971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:40.913971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:40.913971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:40.913971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:40.913971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:40.913971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:40.913971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:40.913971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:40.913971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:40.913971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:40.913971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:40.913971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:40.914841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:41:40.914841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:41:40.914841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:41:40.914841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:41:40.914841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:41:40.914841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:41:40.914841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:40.914841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:40.914841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 270/522] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:40.914841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000de2d-7ea8-4e46-a596-a9f5013fd5d1 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:40.940512 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 253/523] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:40.941431 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875787e-cc2c-4d78-b91e-60c599fddcc6 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:40.993664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:41.026860 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000de2d-7ea8-4e46-a596-a9f5013fd5d1 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:41.047046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875787e-cc2c-4d78-b91e-60c599fddcc6 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:41.064030 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40246346-7bee-410c-ac75-72c49ba9552d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:41.064679 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40246346-7bee-410c-ac75-72c49ba9552d None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:41.064963 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40246346-7bee-410c-ac75-72c49ba9552d None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:41.065271 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40246346-7bee-410c-ac75-72c49ba9552d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:41.072337 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40246346-7bee-410c-ac75-72c49ba9552d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:41.073795 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40246346-7bee-410c-ac75-72c49ba9552d None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:41.085877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43ea19-e0db-409f-b208-b6f1a2766c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:41.086589 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43ea19-e0db-409f-b208-b6f1a2766c1b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:41.086903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-40246346-7bee-410c-ac75-72c49ba9552d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 12:41:41.086903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:41.086903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:41.086903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:41.086903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:41.086903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:41.086903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:41.086903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:41.086903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:41.086903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:41.086903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:41.086903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:41.086903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:41.086903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:41.086903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:41.086903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:41.087739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:41.087739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:41.087739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:41.087739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:41.087739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:41.087739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:41.087739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:41.087739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:41.087739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:41.087739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:41.087739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:41.087739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:41.087739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:41.087739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:41.087739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:41.087739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:41.087739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:41.087739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:41.088678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:41.088678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:41.088678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:41.088678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:41.088678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:41.088678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:41.088678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:41.088678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:41.088678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 12:41:41.088678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:41.089167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43ea19-e0db-409f-b208-b6f1a2766c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:41.089167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43ea19-e0db-409f-b208-b6f1a2766c1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:41.089283 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 271/524] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:41:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:41.089283 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40246346-7bee-410c-ac75-72c49ba9552d None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:41.096454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43ea19-e0db-409f-b208-b6f1a2766c1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:41.098085 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43ea19-e0db-409f-b208-b6f1a2766c1b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:41.110962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-9e43ea19-e0db-409f-b208-b6f1a2766c1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:41.110962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:41.110962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:41.110962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:41.110962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:41.110962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:41.110962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:41.110962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:41.110962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:41.110962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:41.110962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:41.110962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:41.110962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:41:41.110962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:41:41.110962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:41:41.111800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:41:41.111800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:41.111800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:41.111800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:41.111800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:41.111800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:41.111800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:41.111800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:41.111800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:41.111800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:41.111800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:41.111800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:41.111800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:41.111800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:41.111800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:41.111800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:41.111800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:41.118011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:41:41.118011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:41:41.118011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:41:41.118011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:41:41.118011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:41:41.118011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:41:41.118011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:41.118011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:41.118011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 254/525] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:41.118011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43ea19-e0db-409f-b208-b6f1a2766c1b None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:41.122590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:41.210990 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40246346-7bee-410c-ac75-72c49ba9552d None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:41.230084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43ea19-e0db-409f-b208-b6f1a2766c1b None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:41.239894 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:41.247050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b20a2-b2fa-4ae8-9ab4-2cf3debdcb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:41.247674 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b20a2-b2fa-4ae8-9ab4-2cf3debdcb71 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:41.247977 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b20a2-b2fa-4ae8-9ab4-2cf3debdcb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:41.248284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b20a2-b2fa-4ae8-9ab4-2cf3debdcb71 None admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:41.249038 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b20a2-b2fa-4ae8-9ab4-2cf3debdcb71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:41.249345 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b20a2-b2fa-4ae8-9ab4-2cf3debdcb71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:41.250800 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b20a2-b2fa-4ae8-9ab4-2cf3debdcb71 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:41.267443 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4d1e5-1139-4798-a0ce-b76861fc5937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:41.268086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4d1e5-1139-4798-a0ce-b76861fc5937 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:41.268379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4d1e5-1139-4798-a0ce-b76861fc5937 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:41.268655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4d1e5-1139-4798-a0ce-b76861fc5937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:41.270545 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 272/526] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:41:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:41.271283 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b20a2-b2fa-4ae8-9ab4-2cf3debdcb71 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:41.290581 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4d1e5-1139-4798-a0ce-b76861fc5937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:41.292120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4d1e5-1139-4798-a0ce-b76861fc5937 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:41.307104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-3ef4d1e5-1139-4798-a0ce-b76861fc5937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:41.307104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:41.307104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:41.307104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:41.307104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:41.307104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:41.307104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:41.307104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:41.307104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:41.307104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:41.307104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:41.307104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:41.307104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:41.307104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:41.307104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:41.307963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:41.307963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:41.307963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:41.307963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:41.307963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:41.307963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:41.307963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:41.307963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:41.307963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:41.307963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:41.307963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:41.307963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:41.307963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:41.307963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:41.307963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:41.307963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:41.307963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:41.308791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:41.308791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:41.308791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:41.308791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:41.308791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 255/527] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:41.309068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4d1e5-1139-4798-a0ce-b76861fc5937 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:41.360033 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:41.379753 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b20a2-b2fa-4ae8-9ab4-2cf3debdcb71 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:41.409372 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4d1e5-1139-4798-a0ce-b76861fc5937 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:41.415963 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef56759-83b4-4232-8f37-c3f68d8e89a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:41.416696 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef56759-83b4-4232-8f37-c3f68d8e89a8 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:41.416977 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef56759-83b4-4232-8f37-c3f68d8e89a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:41.417249 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef56759-83b4-4232-8f37-c3f68d8e89a8 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:41.418148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef56759-83b4-4232-8f37-c3f68d8e89a8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:41.418462 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef56759-83b4-4232-8f37-c3f68d8e89a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:41.420030 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef56759-83b4-4232-8f37-c3f68d8e89a8 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:41.439505 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 273/528] 10.222.0.64 () {56 vars in 1139 bytes} [Wed Aug 3 12:41:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:41.440318 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef56759-83b4-4232-8f37-c3f68d8e89a8 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:41.448861 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4d9cd-02bb-4032-8e3c-c58b456d3e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:41.449479 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4d9cd-02bb-4032-8e3c-c58b456d3e25 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:41.450135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4d9cd-02bb-4032-8e3c-c58b456d3e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:41.450433 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4d9cd-02bb-4032-8e3c-c58b456d3e25 None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:41.451219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4d9cd-02bb-4032-8e3c-c58b456d3e25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:41.451533 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4d9cd-02bb-4032-8e3c-c58b456d3e25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:41.453645 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4d9cd-02bb-4032-8e3c-c58b456d3e25 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:41.474099 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 256/529] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:41:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:41.475634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4d9cd-02bb-4032-8e3c-c58b456d3e25 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:41.497633 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:41.560706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef56759-83b4-4232-8f37-c3f68d8e89a8 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:41.576553 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4d9cd-02bb-4032-8e3c-c58b456d3e25 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:41.597876 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c4707-0741-4c34-8e00-aad65b448098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:41.598508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c4707-0741-4c34-8e00-aad65b448098 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:41.598803 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c4707-0741-4c34-8e00-aad65b448098 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:41.599115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c4707-0741-4c34-8e00-aad65b448098 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:41.600139 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c4707-0741-4c34-8e00-aad65b448098 None admin] RBAC: Adding query filter params (role.id=72fab3a91c004428b7e615dac55116cd, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=74b99f03a7c14a2e89384dcca532dc61) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:41.600465 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c4707-0741-4c34-8e00-aad65b448098 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:41.601869 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c4707-0741-4c34-8e00-aad65b448098 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:41.614772 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 274/530] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:41:41 2022] GET /identity/v3/role_assignments?user.id=74b99f03a7c14a2e89384dcca532dc61&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=72fab3a91c004428b7e615dac55116cd => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:41.614772 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c4707-0741-4c34-8e00-aad65b448098 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:41.617240 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:41.622768 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044080b-f7d9-4ef6-a900-9a873f0aa647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:41.622768 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044080b-f7d9-4ef6-a900-9a873f0aa647 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:41.622768 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044080b-f7d9-4ef6-a900-9a873f0aa647 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:41.622768 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044080b-f7d9-4ef6-a900-9a873f0aa647 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:41.623131 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044080b-f7d9-4ef6-a900-9a873f0aa647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:41.623131 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044080b-f7d9-4ef6-a900-9a873f0aa647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:41.623131 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044080b-f7d9-4ef6-a900-9a873f0aa647 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:41.635873 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 257/531] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:41.636743 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044080b-f7d9-4ef6-a900-9a873f0aa647 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:41.736784 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c4707-0741-4c34-8e00-aad65b448098 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:41.752871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:41.776778 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044080b-f7d9-4ef6-a900-9a873f0aa647 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:41.785666 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cb042-db1b-4b9b-ab45-e67067c7e1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:41.786597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cb042-db1b-4b9b-ab45-e67067c7e1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:41.787453 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cb042-db1b-4b9b-ab45-e67067c7e1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:41.787921 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cb042-db1b-4b9b-ab45-e67067c7e1a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:41.815510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe6e6a-2091-4c24-8ad2-33832cb4a824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:41.816133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe6e6a-2091-4c24-8ad2-33832cb4a824 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:41.816418 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe6e6a-2091-4c24-8ad2-33832cb4a824 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:41.816695 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe6e6a-2091-4c24-8ad2-33832cb4a824 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:41.817539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe6e6a-2091-4c24-8ad2-33832cb4a824 None admin] RBAC: Adding query filter params (role.id=72fab3a91c004428b7e615dac55116cd, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=bc939818c9224b0ebe2dbaa1eaaec5e5) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:41.817942 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe6e6a-2091-4c24-8ad2-33832cb4a824 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:41.819985 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe6e6a-2091-4c24-8ad2-33832cb4a824 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:41.834778 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 258/532] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:41:41 2022] GET /identity/v3/role_assignments?user.id=bc939818c9224b0ebe2dbaa1eaaec5e5&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=72fab3a91c004428b7e615dac55116cd => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:41.834778 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe6e6a-2091-4c24-8ad2-33832cb4a824 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:41.917607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222cb042-db1b-4b9b-ab45-e67067c7e1a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:41.919395 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222cb042-db1b-4b9b-ab45-e67067c7e1a5 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:41.932716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:42.034368 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe6e6a-2091-4c24-8ad2-33832cb4a824 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:42.079864 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813d392-d847-40eb-950c-ccd2c186a402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:42.080732 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813d392-d847-40eb-950c-ccd2c186a402 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:42.081119 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813d392-d847-40eb-950c-ccd2c186a402 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:42.081489 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813d392-d847-40eb-950c-ccd2c186a402 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:42.086661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 275/533] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:42.090796 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813d392-d847-40eb-950c-ccd2c186a402 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:42.090796 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813d392-d847-40eb-950c-ccd2c186a402 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:42.092417 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cb042-db1b-4b9b-ab45-e67067c7e1a5 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:42.103769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-7813d392-d847-40eb-950c-ccd2c186a402 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:42.103769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:42.103769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:42.103769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:42.103769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:42.103769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:42.103769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:42.103769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:42.103769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:42.103769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:42.103769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:42.103769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:42.103769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:41:42.103769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:41:42.103769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:41:42.104852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:41:42.104852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:42.104852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:42.104852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:42.104852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:42.104852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:42.104852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:42.104852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:42.104852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:42.104852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:42.104852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:42.104852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:42.104852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:42.104852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:42.104852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:42.104852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:42.104852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:42.105881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:41:42.105881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:41:42.105881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:41:42.105881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:41:42.105881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:41:42.105881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:41:42.105881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:42.105881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:42.107675 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 259/534] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:42.108978 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce625b1-8777-4abe-b765-915b64bf8e4b None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:42.109372 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce625b1-8777-4abe-b765-915b64bf8e4b None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:42.109751 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce625b1-8777-4abe-b765-915b64bf8e4b None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:42.116284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 260/535] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:42.117174 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce625b1-8777-4abe-b765-915b64bf8e4b None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:42.158538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:42.206485 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cb042-db1b-4b9b-ab45-e67067c7e1a5 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:42.209216 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:42.233679 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce625b1-8777-4abe-b765-915b64bf8e4b None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:42.243300 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b8957-7461-456f-b20b-7a314490c4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:42.243647 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b8957-7461-456f-b20b-7a314490c4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:42.243934 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b8957-7461-456f-b20b-7a314490c4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:42.244214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b8957-7461-456f-b20b-7a314490c4e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:42.255128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b8957-7461-456f-b20b-7a314490c4e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:42.257143 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b8957-7461-456f-b20b-7a314490c4e0 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:42.274600 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c1611-d853-4f0c-a4ed-6c3979eebe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:42.275536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-288b8957-7461-456f-b20b-7a314490c4e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:42.275536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:42.275536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:42.275536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:42.275536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:42.275536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:42.275536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:42.275536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:42.275536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:42.275536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:42.275536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:42.275536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:42.275536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:42.275536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:42.275536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:42.276347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:42.276347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:42.276347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:42.276347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:42.276347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:42.276347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:42.276347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:42.276347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:42.276347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:42.276347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:42.276347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:42.276347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:42.276347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:42.276347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:42.276347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:42.276347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:42.276347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:42.277258 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:42.277258 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:42.277258 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:42.277258 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:42.277258 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 276/536] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:42.278047 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c1611-d853-4f0c-a4ed-6c3979eebe5e None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:42.278461 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f825a14-f38d-42d6-a4ca-3b997b3fdc7d None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:42.278772 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f825a14-f38d-42d6-a4ca-3b997b3fdc7d None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:42.278971 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c1611-d853-4f0c-a4ed-6c3979eebe5e None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:42.279064 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f825a14-f38d-42d6-a4ca-3b997b3fdc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:42.279526 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c1611-d853-4f0c-a4ed-6c3979eebe5e None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:42.280491 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c1611-d853-4f0c-a4ed-6c3979eebe5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:42.280996 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c1611-d853-4f0c-a4ed-6c3979eebe5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:42.282647 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c1611-d853-4f0c-a4ed-6c3979eebe5e None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:42.296728 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 261/537] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:41:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:42.297835 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c1611-d853-4f0c-a4ed-6c3979eebe5e None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:42.304222 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-0f825a14-f38d-42d6-a4ca-3b997b3fdc7d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:42.305462 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-0f825a14-f38d-42d6-a4ca-3b997b3fdc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:42.366341 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:42.377377 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 277/538] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:42.378139 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f825a14-f38d-42d6-a4ca-3b997b3fdc7d None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:42.407350 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c1611-d853-4f0c-a4ed-6c3979eebe5e None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:42.454563 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad11cc-5c14-48f9-9d0a-388d1632fa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:42.455224 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad11cc-5c14-48f9-9d0a-388d1632fa25 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:42.455523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad11cc-5c14-48f9-9d0a-388d1632fa25 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:42.455811 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad11cc-5c14-48f9-9d0a-388d1632fa25 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:42.456520 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad11cc-5c14-48f9-9d0a-388d1632fa25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:42.456939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad11cc-5c14-48f9-9d0a-388d1632fa25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:42.458480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad11cc-5c14-48f9-9d0a-388d1632fa25 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:42.471533 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 262/539] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:42.475860 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad11cc-5c14-48f9-9d0a-388d1632fa25 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:42.504412 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:42.523862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f825a14-f38d-42d6-a4ca-3b997b3fdc7d None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:42.576609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8da871-b763-4994-a172-1263bf13aaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:42.577598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8da871-b763-4994-a172-1263bf13aaba None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:42.577598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8da871-b763-4994-a172-1263bf13aaba None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:42.577846 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8da871-b763-4994-a172-1263bf13aaba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:42.578689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8da871-b763-4994-a172-1263bf13aaba None admin] RBAC: Adding query filter params (role.id=72fab3a91c004428b7e615dac55116cd, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=19337279eb414e62b529feb6e7c9b1b7) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:42.579027 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8da871-b763-4994-a172-1263bf13aaba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:42.580476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8da871-b763-4994-a172-1263bf13aaba None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:42.587021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 278/540] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:41:42 2022] GET /identity/v3/role_assignments?user.id=19337279eb414e62b529feb6e7c9b1b7&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=72fab3a91c004428b7e615dac55116cd => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:42.587956 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8da871-b763-4994-a172-1263bf13aaba None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:42.609898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad11cc-5c14-48f9-9d0a-388d1632fa25 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:42.663864 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:42.689069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37325a-cb01-4da3-b448-f9754fd2f5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:42.689727 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37325a-cb01-4da3-b448-f9754fd2f5ad None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:42.690011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37325a-cb01-4da3-b448-f9754fd2f5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:42.690286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37325a-cb01-4da3-b448-f9754fd2f5ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:42.711026 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8da871-b763-4994-a172-1263bf13aaba None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:42.717883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37325a-cb01-4da3-b448-f9754fd2f5ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:42.730921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-6c37325a-cb01-4da3-b448-f9754fd2f5ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:42.730921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:42.730921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:42.730921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:42.730921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:42.730921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:42.730921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:42.730921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:42.730921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:42.730921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:42.730921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:42.730921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:42.730921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:42.730921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:42.730921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:42.730921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:42.731871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:42.731871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:42.731871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:42.731871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:42.731871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:42.731871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:42.731871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:42.731871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:42.731871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:42.731871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:42.731871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:42.731871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:42.731871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:42.731871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:42.731871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:42.731871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:42.732653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:42.732653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:42.732653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:42.732653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:42.732653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:42.732653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:42.732653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:42.732653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:42.732653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:42.732653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:42.732653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:42.732653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:42.732653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 263/541] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:41:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:42.751795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37325a-cb01-4da3-b448-f9754fd2f5ad None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:42.756787 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfb15c-3118-438a-9cde-bb34abee4a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:42.757468 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfb15c-3118-438a-9cde-bb34abee4a7f None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:42.757755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfb15c-3118-438a-9cde-bb34abee4a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:42.758040 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfb15c-3118-438a-9cde-bb34abee4a7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:42.765869 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfb15c-3118-438a-9cde-bb34abee4a7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:42.767522 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfb15c-3118-438a-9cde-bb34abee4a7f None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:42.780599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-12dfb15c-3118-438a-9cde-bb34abee4a7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:42.780599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:42.780599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:42.780599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:42.780599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:42.780599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:42.780599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:42.780599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:42.780599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:42.780599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:42.780599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:42.780599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:42.780599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:41:42.780599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:41:42.780599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:41:42.781494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:41:42.781494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:42.781494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:42.781494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:42.781494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:42.781494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:42.781494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:42.781494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:42.781494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:42.781494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:42.781494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:42.781494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:42.781494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:42.781494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:42.781494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:42.781494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:42.781494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:42.782314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:41:42.782314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:41:42.782314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:41:42.782314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:41:42.782314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:41:42.782314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:41:42.782314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:42.782314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:42.782314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 279/542] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:42.788688 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfb15c-3118-438a-9cde-bb34abee4a7f None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:42.812202 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:42.903276 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfb15c-3118-438a-9cde-bb34abee4a7f None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:42.944311 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce23d6-0abc-46d6-b31d-8ad93e981477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:42.944943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce23d6-0abc-46d6-b31d-8ad93e981477 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:42.945231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce23d6-0abc-46d6-b31d-8ad93e981477 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:42.945513 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce23d6-0abc-46d6-b31d-8ad93e981477 None admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:42.946276 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce23d6-0abc-46d6-b31d-8ad93e981477 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:42.946587 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce23d6-0abc-46d6-b31d-8ad93e981477 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:42.948560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce23d6-0abc-46d6-b31d-8ad93e981477 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:42.964274 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 280/543] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:41:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:42.970332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce23d6-0abc-46d6-b31d-8ad93e981477 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:42.997419 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37325a-cb01-4da3-b448-f9754fd2f5ad None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:43.051022 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b38102-ce60-49a3-995d-7462a12f34d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:43.051652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b38102-ce60-49a3-995d-7462a12f34d8 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:43.051943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b38102-ce60-49a3-995d-7462a12f34d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:43.052233 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b38102-ce60-49a3-995d-7462a12f34d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:43.052996 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b38102-ce60-49a3-995d-7462a12f34d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:43.053309 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b38102-ce60-49a3-995d-7462a12f34d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:43.054702 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b38102-ce60-49a3-995d-7462a12f34d8 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:43.064746 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 264/544] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 3 12:41:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:43.072573 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b38102-ce60-49a3-995d-7462a12f34d8 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:43.107082 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:43.125239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:43.183539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b38102-ce60-49a3-995d-7462a12f34d8 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:43.212936 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce23d6-0abc-46d6-b31d-8ad93e981477 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:43.221622 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a04ab8-e2f4-4569-835c-819f785d7d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:43.222279 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a04ab8-e2f4-4569-835c-819f785d7d68 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:43.222570 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a04ab8-e2f4-4569-835c-819f785d7d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:43.222879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a04ab8-e2f4-4569-835c-819f785d7d68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:43.234288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a04ab8-e2f4-4569-835c-819f785d7d68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:43.235784 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a04ab8-e2f4-4569-835c-819f785d7d68 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:43.252915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-03a04ab8-e2f4-4569-835c-819f785d7d68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:43.252915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:43.252915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:43.252915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:43.252915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:43.252915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:43.252915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:43.252915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:43.252915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:43.252915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:43.252915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:43.252915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:43.252915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:43.252915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:43.252915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:43.253802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:43.253802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:43.253802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:43.253802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:43.253802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:43.253802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:43.253802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:43.253802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:43.253802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:43.253802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:43.253802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:43.253802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:43.253802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:43.253802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:43.253802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:43.253802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:43.253802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:43.254725 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:43.254725 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:43.254725 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:43.254725 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:43.254725 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 265/545] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:43.260366 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a04ab8-e2f4-4569-835c-819f785d7d68 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:43.311408 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70047c-b216-4621-b0e9-23668988f176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:43.313181 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70047c-b216-4621-b0e9-23668988f176 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:43.313577 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70047c-b216-4621-b0e9-23668988f176 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:43.313855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70047c-b216-4621-b0e9-23668988f176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:43.314712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70047c-b216-4621-b0e9-23668988f176 None admin] RBAC: Adding query filter params (role.id=72fab3a91c004428b7e615dac55116cd, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=05c4c07ff52c43ebb5056484eac94afa) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:43.315050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70047c-b216-4621-b0e9-23668988f176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:43.316745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70047c-b216-4621-b0e9-23668988f176 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:43.331884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 281/546] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:41:42 2022] GET /identity/v3/role_assignments?user.id=05c4c07ff52c43ebb5056484eac94afa&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=72fab3a91c004428b7e615dac55116cd => generated 259 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:43.369714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:43.373127 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a04ab8-e2f4-4569-835c-819f785d7d68 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:43.412737 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b6dcd-0aa4-4230-847d-999ab6e023bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:43.413380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b6dcd-0aa4-4230-847d-999ab6e023bc None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:43.413822 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b6dcd-0aa4-4230-847d-999ab6e023bc None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:43.414109 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b6dcd-0aa4-4230-847d-999ab6e023bc None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:43.414851 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b6dcd-0aa4-4230-847d-999ab6e023bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:43.415415 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b6dcd-0aa4-4230-847d-999ab6e023bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:43.416835 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b6dcd-0aa4-4230-847d-999ab6e023bc None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:43.431441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 266/547] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:43.437106 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70047c-b216-4621-b0e9-23668988f176 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:43.579916 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70047c-b216-4621-b0e9-23668988f176 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:43.616019 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb006498-202c-4b5e-9fdb-41158517c46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:43.616676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb006498-202c-4b5e-9fdb-41158517c46c None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:43.616962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb006498-202c-4b5e-9fdb-41158517c46c None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:43.617243 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb006498-202c-4b5e-9fdb-41158517c46c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:43.619463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:43.625940 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb006498-202c-4b5e-9fdb-41158517c46c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:43.627432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb006498-202c-4b5e-9fdb-41158517c46c None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:43.639295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-bb006498-202c-4b5e-9fdb-41158517c46c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:41:43.639295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:43.639295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:43.639295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:43.639295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:43.639295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:43.639295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:43.639295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:43.639295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:43.639295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:43.639295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:43.639295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:43.639295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:43.639295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:43.639295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:43.639295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:43.641154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:43.641154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:43.641154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:43.641154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:43.641154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:43.641154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:43.641154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:43.641154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:43.641154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:43.641154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:43.641154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:43.641154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:43.641154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:43.641154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:43.641154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:43.641154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:43.641154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:43.641154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:43.643392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:43.643392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:43.643392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:43.643392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:43.643392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:43.643392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:43.643392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:43.643392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:43.643392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:41:43.643392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:43.643392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 282/548] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:41:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:43.648895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b6dcd-0aa4-4230-847d-999ab6e023bc None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:43.763595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b6dcd-0aa4-4230-847d-999ab6e023bc None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:43.799785 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d606948-b9c9-46cf-9b8a-9755a7f2667c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:43.800417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d606948-b9c9-46cf-9b8a-9755a7f2667c None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:43.800709 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d606948-b9c9-46cf-9b8a-9755a7f2667c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:43.800985 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d606948-b9c9-46cf-9b8a-9755a7f2667c None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:43.801796 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d606948-b9c9-46cf-9b8a-9755a7f2667c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:43.802168 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d606948-b9c9-46cf-9b8a-9755a7f2667c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:43.804955 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d606948-b9c9-46cf-9b8a-9755a7f2667c None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:43.823415 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 267/549] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 3 12:41:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:43.829887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb006498-202c-4b5e-9fdb-41158517c46c None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:43.840333 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0060f03-b952-4437-836a-d5cb9b71a138 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:43.840608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0060f03-b952-4437-836a-d5cb9b71a138 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:43.840892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0060f03-b952-4437-836a-d5cb9b71a138 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:43.842488 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 268/550] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:43.847463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c049c5-b4b5-4f39-b9d7-8df9fb8c805a None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:43.847789 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c049c5-b4b5-4f39-b9d7-8df9fb8c805a None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:43.847999 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c049c5-b4b5-4f39-b9d7-8df9fb8c805a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:43.870295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-35c049c5-b4b5-4f39-b9d7-8df9fb8c805a None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:43.871541 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-35c049c5-b4b5-4f39-b9d7-8df9fb8c805a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:43.895902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:43.987658 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb006498-202c-4b5e-9fdb-41158517c46c None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:43.988435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 269/551] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:41:44.031648 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c049c5-b4b5-4f39-b9d7-8df9fb8c805a None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:44.033635 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe904801-ffba-42b9-9f61-59625a9bab85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:44.034321 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe904801-ffba-42b9-9f61-59625a9bab85 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:44.034604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe904801-ffba-42b9-9f61-59625a9bab85 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:44.034916 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe904801-ffba-42b9-9f61-59625a9bab85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:44.131150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:44.139221 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe904801-ffba-42b9-9f61-59625a9bab85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:44.140676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe904801-ffba-42b9-9f61-59625a9bab85 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:44.192861 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c049c5-b4b5-4f39-b9d7-8df9fb8c805a None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:44.258045 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799b511-29cd-4cd1-8096-6496b073c8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:44.258705 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799b511-29cd-4cd1-8096-6496b073c8ba None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:44.259015 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799b511-29cd-4cd1-8096-6496b073c8ba None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:44.259298 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799b511-29cd-4cd1-8096-6496b073c8ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:44.277659 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 283/552] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:44.283379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe904801-ffba-42b9-9f61-59625a9bab85 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:44.288390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799b511-29cd-4cd1-8096-6496b073c8ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:44.293593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-9799b511-29cd-4cd1-8096-6496b073c8ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:44.293593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:44.293593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:44.293593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:44.293593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:44.293593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:44.293593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:44.293593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:44.293593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:44.293593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:44.293593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:44.293593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:44.293593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:44.293593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:44.293593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:44.293593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:44.294504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:44.294504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:44.294504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:44.294504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:44.294504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:44.294504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:44.294504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:44.294504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:44.294504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:44.294504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:44.294504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:44.294504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:44.294504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:44.294504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:44.294504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:44.294504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:44.295356 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:44.295356 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:44.295356 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:44.295356 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:44.295356 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:44.295356 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:44.295356 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:44.295356 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:44.295356 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:44.295356 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:44.295356 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:44.295356 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:44.307308 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 270/553] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:41:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:44.308539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799b511-29cd-4cd1-8096-6496b073c8ba None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:44.321965 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:44.437758 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:44.444745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe904801-ffba-42b9-9f61-59625a9bab85 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:44.455195 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799b511-29cd-4cd1-8096-6496b073c8ba None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:44.491927 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031aba5-2a67-4d7d-87b0-3de7f7456808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:44.493566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031aba5-2a67-4d7d-87b0-3de7f7456808 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:44.494057 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031aba5-2a67-4d7d-87b0-3de7f7456808 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:44.494799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031aba5-2a67-4d7d-87b0-3de7f7456808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:44.500597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096433a5-40d4-40e9-a877-1242f3c0f0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:44.501202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096433a5-40d4-40e9-a877-1242f3c0f0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:44.501482 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096433a5-40d4-40e9-a877-1242f3c0f0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:44.501754 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096433a5-40d4-40e9-a877-1242f3c0f0c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:44.502467 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096433a5-40d4-40e9-a877-1242f3c0f0c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:44.502790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096433a5-40d4-40e9-a877-1242f3c0f0c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:44.504660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096433a5-40d4-40e9-a877-1242f3c0f0c6 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:44.508309 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031aba5-2a67-4d7d-87b0-3de7f7456808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:44.509934 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031aba5-2a67-4d7d-87b0-3de7f7456808 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:44.518816 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 271/554] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 3 12:41:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:44.520335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c7e1b-4303-4f01-b502-7433339f65cf None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:44.522643 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c7e1b-4303-4f01-b502-7433339f65cf None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:44.523149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c7e1b-4303-4f01-b502-7433339f65cf None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:44.525828 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 272/555] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:44.528524 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c7e1b-4303-4f01-b502-7433339f65cf None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:44.532435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-b031aba5-2a67-4d7d-87b0-3de7f7456808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:44.532435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:44.532435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:44.532435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:44.532435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:44.532435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:44.532435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:44.532435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:44.532435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:44.532435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:44.532435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:44.532435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:44.532435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:44.532435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:44.532435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:44.533360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:44.533360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:44.533360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:44.533360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:44.533360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:44.533360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:44.533360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:44.533360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:44.533360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:44.533360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:44.533360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:44.533360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:44.533360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:44.533360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:44.533360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:44.533360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:44.533360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:44.534480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:44.534480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:44.534480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:44.534480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:44.536336 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 284/556] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:44.538276 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db9054-a9fd-444a-85c0-8addea16cc41 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:44.538764 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db9054-a9fd-444a-85c0-8addea16cc41 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:44.539305 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db9054-a9fd-444a-85c0-8addea16cc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:44.557347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-81db9054-a9fd-444a-85c0-8addea16cc41 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:44.558906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-81db9054-a9fd-444a-85c0-8addea16cc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:44.617229 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:44.640153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 285/557] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:44.641704 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db9054-a9fd-444a-85c0-8addea16cc41 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:44.672692 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c7e1b-4303-4f01-b502-7433339f65cf None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:44.720441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be679f77-378e-4ddd-808b-8fcb23139fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:44.721089 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be679f77-378e-4ddd-808b-8fcb23139fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:44.721378 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be679f77-378e-4ddd-808b-8fcb23139fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:44.721659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be679f77-378e-4ddd-808b-8fcb23139fb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:44.736262 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:44.736439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be679f77-378e-4ddd-808b-8fcb23139fb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:44.739081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be679f77-378e-4ddd-808b-8fcb23139fb6 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:44.757018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-be679f77-378e-4ddd-808b-8fcb23139fb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:44.757018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:44.757018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:44.757018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:44.757018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:44.757018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:44.757018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:44.757018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:44.757018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:44.757018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:44.757018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:44.757018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:44.757018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:44.757018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:44.757018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:44.758424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:44.758424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:44.758424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:44.758424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:44.758424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:44.758424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:44.758424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:44.758424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:44.758424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:44.758424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:44.758424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:44.758424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:44.758424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:44.758424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:44.758424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:44.758424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:44.758424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:44.760138 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:44.760138 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:44.760138 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:44.760138 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:44.760138 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 273/558] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:44.761738 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be679f77-378e-4ddd-808b-8fcb23139fb6 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:44.782297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db9054-a9fd-444a-85c0-8addea16cc41 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:44.831042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7ffd0-4237-4a70-b068-7ca577690f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:44.831590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7ffd0-4237-4a70-b068-7ca577690f51 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:44.831881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7ffd0-4237-4a70-b068-7ca577690f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:44.832164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7ffd0-4237-4a70-b068-7ca577690f51 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:44.833138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7ffd0-4237-4a70-b068-7ca577690f51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:44.833453 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7ffd0-4237-4a70-b068-7ca577690f51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:44.836195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7ffd0-4237-4a70-b068-7ca577690f51 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:44.858487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 286/559] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:44.858487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7ffd0-4237-4a70-b068-7ca577690f51 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:44.888430 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be679f77-378e-4ddd-808b-8fcb23139fb6 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:44.911345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:44.929207 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626e409-ef90-4264-8412-81f0c58858dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:44.930172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626e409-ef90-4264-8412-81f0c58858dc None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:44.930687 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626e409-ef90-4264-8412-81f0c58858dc None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:44.931231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626e409-ef90-4264-8412-81f0c58858dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:44.942677 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626e409-ef90-4264-8412-81f0c58858dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:44.949373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-d626e409-ef90-4264-8412-81f0c58858dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:44.949373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:44.949373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:44.949373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:44.949373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:44.949373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:44.949373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:44.949373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:44.949373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:44.949373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:44.949373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:44.949373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:44.949373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:44.949373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:44.949373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:44.949373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:44.950267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:44.950267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:44.950267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:44.950267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:44.950267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:44.950267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:44.950267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:44.950267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:44.950267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:44.950267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:44.950267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:44.950267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:44.950267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:44.950267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:44.950267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:44.950267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:44.951248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:44.951248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:44.951248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:44.951248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:44.951248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:44.951248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:44.951248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:44.951248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:44.951248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:44.951248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:44.951248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:44.951248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:44.955433 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 274/560] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:41:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:44.957020 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626e409-ef90-4264-8412-81f0c58858dc None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:44.994958 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7ffd0-4237-4a70-b068-7ca577690f51 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:45.038327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df446026-a743-477c-b9cf-099730fbd441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:45.039229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df446026-a743-477c-b9cf-099730fbd441 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:45.039519 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df446026-a743-477c-b9cf-099730fbd441 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:45.039800 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df446026-a743-477c-b9cf-099730fbd441 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:45.041638 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df446026-a743-477c-b9cf-099730fbd441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:45.041961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df446026-a743-477c-b9cf-099730fbd441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:45.043721 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df446026-a743-477c-b9cf-099730fbd441 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:45.047860 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:45.066821 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 287/561] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:45.067994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df446026-a743-477c-b9cf-099730fbd441 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:45.079680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626e409-ef90-4264-8412-81f0c58858dc None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:45.123369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42474db3-0a6c-4b5d-b6e0-7663550bc16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:45.124584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42474db3-0a6c-4b5d-b6e0-7663550bc16c None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:45.124993 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42474db3-0a6c-4b5d-b6e0-7663550bc16c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:45.125374 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42474db3-0a6c-4b5d-b6e0-7663550bc16c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:45.135432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42474db3-0a6c-4b5d-b6e0-7663550bc16c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:45.136905 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42474db3-0a6c-4b5d-b6e0-7663550bc16c None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:45.149040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-42474db3-0a6c-4b5d-b6e0-7663550bc16c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:45.149040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:45.149040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:45.149040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:45.149040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:45.149040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:45.149040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:45.149040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:45.149040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:45.149040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:45.149040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:45.149040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:45.149040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:41:45.149040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:41:45.149040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:41:45.150058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:41:45.150058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:45.150058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:45.150058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:45.150058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:45.150058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:45.150058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:45.150058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:45.150058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:45.150058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:45.150058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:45.150058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:45.150058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:45.150058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:45.150058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:45.150058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:45.150058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:45.150957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:41:45.150957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:41:45.150957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:41:45.150957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:41:45.150957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:41:45.150957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:41:45.150957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:45.150957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:45.155246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 275/562] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:45.156131 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42474db3-0a6c-4b5d-b6e0-7663550bc16c None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:45.200739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df446026-a743-477c-b9cf-099730fbd441 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:45.204405 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:45.238091 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5198730-9eff-4f5a-b93e-71c5ed71cf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:45.238768 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5198730-9eff-4f5a-b93e-71c5ed71cf7f None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:45.239043 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5198730-9eff-4f5a-b93e-71c5ed71cf7f None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:45.239323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5198730-9eff-4f5a-b93e-71c5ed71cf7f None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:45.240987 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5198730-9eff-4f5a-b93e-71c5ed71cf7f None admin] RBAC: Adding query filter params (name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:45.241303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5198730-9eff-4f5a-b93e-71c5ed71cf7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:45.242724 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5198730-9eff-4f5a-b93e-71c5ed71cf7f None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:45.257151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 288/563] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 3 12:41:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:45.257151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5198730-9eff-4f5a-b93e-71c5ed71cf7f None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:45.272595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42474db3-0a6c-4b5d-b6e0-7663550bc16c None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:45.307630 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f046fe-12d9-43bf-bc1b-de10979adf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:45.308267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f046fe-12d9-43bf-bc1b-de10979adf42 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:45.308550 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f046fe-12d9-43bf-bc1b-de10979adf42 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:45.308824 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f046fe-12d9-43bf-bc1b-de10979adf42 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:45.316492 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:45.316629 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f046fe-12d9-43bf-bc1b-de10979adf42 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:45.317989 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f046fe-12d9-43bf-bc1b-de10979adf42 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:45.330662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-c0f046fe-12d9-43bf-bc1b-de10979adf42 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 03 12:41:45.330662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:45.330662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:45.330662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:45.330662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:45.330662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:45.330662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:45.330662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:45.330662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:45.330662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:45.330662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:45.330662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:45.330662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:45.330662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:45.330662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:45.330662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:45.331667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:45.331667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:45.331667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:45.331667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:45.331667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:45.331667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:45.331667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:45.331667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:45.331667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:45.331667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:45.331667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:45.331667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:45.331667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:45.331667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:45.331667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:45.331667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:45.331667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:45.331667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:45.332601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:45.332601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:45.332601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:45.332601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:45.332601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:45.332601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:45.332601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:45.332601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:45.332601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 03 12:41:45.332601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:45.332601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 276/564] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:45.333707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd5c96-d632-4428-9eb4-9884b946b9ab None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:45.333707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd5c96-d632-4428-9eb4-9884b946b9ab None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:45.333954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd5c96-d632-4428-9eb4-9884b946b9ab None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:45.335292 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 277/565] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:45.339770 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd5c96-d632-4428-9eb4-9884b946b9ab None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:45.370396 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5198730-9eff-4f5a-b93e-71c5ed71cf7f None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:45.409595 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b19f37-9770-43dc-82a6-95b596ec6c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:45.410146 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b19f37-9770-43dc-82a6-95b596ec6c62 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:45.410491 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b19f37-9770-43dc-82a6-95b596ec6c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:45.410805 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b19f37-9770-43dc-82a6-95b596ec6c62 None admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:45.411607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b19f37-9770-43dc-82a6-95b596ec6c62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:45.412831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b19f37-9770-43dc-82a6-95b596ec6c62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:45.414279 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b19f37-9770-43dc-82a6-95b596ec6c62 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:45.428369 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 289/566] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:41:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:45.429068 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b19f37-9770-43dc-82a6-95b596ec6c62 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:45.470874 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:45.475058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd5c96-d632-4428-9eb4-9884b946b9ab None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:45.509726 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270a3d1-74b0-44f5-92c4-c75189b140b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:45.510407 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270a3d1-74b0-44f5-92c4-c75189b140b0 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:45.510689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270a3d1-74b0-44f5-92c4-c75189b140b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:45.511028 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270a3d1-74b0-44f5-92c4-c75189b140b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:45.522950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270a3d1-74b0-44f5-92c4-c75189b140b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:45.524405 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270a3d1-74b0-44f5-92c4-c75189b140b0 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:45.537332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b19f37-9770-43dc-82a6-95b596ec6c62 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:45.543939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-e270a3d1-74b0-44f5-92c4-c75189b140b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:45.543939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:45.543939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:45.543939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:45.543939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:45.543939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:45.543939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:45.543939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:45.543939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:45.543939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:45.543939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:45.543939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:45.543939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:45.543939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:45.543939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:45.544958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:45.544958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:45.544958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:45.544958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:45.544958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:45.544958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:45.544958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:45.544958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:45.544958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:45.544958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:45.544958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:45.544958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:45.544958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:45.544958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:45.544958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:45.544958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:45.544958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:45.545883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:45.545883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:45.545883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:45.545883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:45.545883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 278/567] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:45.546689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bed818-69e4-4b2c-bdf8-bdb6812513fd None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:45.547002 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bed818-69e4-4b2c-bdf8-bdb6812513fd None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:45.547289 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bed818-69e4-4b2c-bdf8-bdb6812513fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:45.561924 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:45.566552 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-94bed818-69e4-4b2c-bdf8-bdb6812513fd None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:45.567774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-94bed818-69e4-4b2c-bdf8-bdb6812513fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:45.578455 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb82ba-aa68-4574-81d9-9c5093e238ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:45.579117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb82ba-aa68-4574-81d9-9c5093e238ec None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:45.579404 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb82ba-aa68-4574-81d9-9c5093e238ec None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:45.579690 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb82ba-aa68-4574-81d9-9c5093e238ec None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:45.580491 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb82ba-aa68-4574-81d9-9c5093e238ec None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:45.580803 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb82ba-aa68-4574-81d9-9c5093e238ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:45.582298 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb82ba-aa68-4574-81d9-9c5093e238ec None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:45.602890 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 290/568] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 3 12:41:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:45.603718 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb82ba-aa68-4574-81d9-9c5093e238ec None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:45.642280 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 279/569] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:45.643429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bed818-69e4-4b2c-bdf8-bdb6812513fd None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:45.715385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb82ba-aa68-4574-81d9-9c5093e238ec None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:45.737836 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:45.749755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffbae7-5344-41f1-9f2c-2aef1fbf3de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:45.750372 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffbae7-5344-41f1-9f2c-2aef1fbf3de2 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:45.750861 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffbae7-5344-41f1-9f2c-2aef1fbf3de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:45.751134 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffbae7-5344-41f1-9f2c-2aef1fbf3de2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:45.751924 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffbae7-5344-41f1-9f2c-2aef1fbf3de2 None admin] RBAC: Adding query filter params (role.id=72fab3a91c004428b7e615dac55116cd, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=5209ec838a4f45d6b746edb27970c93d) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:45.752238 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffbae7-5344-41f1-9f2c-2aef1fbf3de2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:45.753666 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffbae7-5344-41f1-9f2c-2aef1fbf3de2 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:45.755259 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bed818-69e4-4b2c-bdf8-bdb6812513fd None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:45.759126 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 291/570] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:41:45 2022] GET /identity/v3/role_assignments?user.id=5209ec838a4f45d6b746edb27970c93d&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=72fab3a91c004428b7e615dac55116cd => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:45.759898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffbae7-5344-41f1-9f2c-2aef1fbf3de2 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:45.801530 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8ae7b-3725-4cb2-8b64-e0b4a7f2adb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:45.802060 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8ae7b-3725-4cb2-8b64-e0b4a7f2adb2 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:45.802347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8ae7b-3725-4cb2-8b64-e0b4a7f2adb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:45.802667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8ae7b-3725-4cb2-8b64-e0b4a7f2adb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:45.803410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8ae7b-3725-4cb2-8b64-e0b4a7f2adb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:45.803721 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8ae7b-3725-4cb2-8b64-e0b4a7f2adb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:45.805130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8ae7b-3725-4cb2-8b64-e0b4a7f2adb2 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:45.808953 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:45.817735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 280/571] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:45.829842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8ae7b-3725-4cb2-8b64-e0b4a7f2adb2 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:45.875711 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffbae7-5344-41f1-9f2c-2aef1fbf3de2 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:45.921536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92903be9-c3fe-4771-ad64-e058c28b520e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:45.922191 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92903be9-c3fe-4771-ad64-e058c28b520e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:45.922482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92903be9-c3fe-4771-ad64-e058c28b520e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:45.922802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92903be9-c3fe-4771-ad64-e058c28b520e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:45.933543 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8ae7b-3725-4cb2-8b64-e0b4a7f2adb2 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:45.940530 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92903be9-c3fe-4771-ad64-e058c28b520e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:45.941990 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92903be9-c3fe-4771-ad64-e058c28b520e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:45.957122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-92903be9-c3fe-4771-ad64-e058c28b520e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:45.957122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:45.957122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:45.957122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:45.957122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:45.957122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:45.957122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:45.957122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:45.957122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:45.957122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:45.957122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:45.957122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:45.957122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:45.957122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:45.957122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:45.958009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:45.958009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:45.958009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:45.958009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:45.958009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:45.958009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:45.958009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:45.958009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:45.958009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:45.958009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:45.958009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:45.958009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:45.958009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:45.958009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:45.958009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:45.958009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:45.958009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:45.959886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:45.959886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:45.959886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:45.959886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:45.959886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 292/572] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:45.960327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7ad1a-ca3d-4ec4-ad8f-45dbf74c7034 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:45.960782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7ad1a-ca3d-4ec4-ad8f-45dbf74c7034 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:45.960782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7ad1a-ca3d-4ec4-ad8f-45dbf74c7034 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:45.962200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 293/573] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:45.966839 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7ad1a-ca3d-4ec4-ad8f-45dbf74c7034 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:45.977421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddee857-514e-4403-b74d-246b986703cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:45.978316 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddee857-514e-4403-b74d-246b986703cc None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:45.978670 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddee857-514e-4403-b74d-246b986703cc None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:45.979030 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddee857-514e-4403-b74d-246b986703cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:45.989313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddee857-514e-4403-b74d-246b986703cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:45.995525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-dddee857-514e-4403-b74d-246b986703cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:45.995525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:45.995525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:45.995525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:45.995525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:45.995525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:45.995525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:45.995525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:45.995525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:45.995525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:45.995525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:45.995525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:45.995525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:45.995525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:45.995525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:45.995525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:45.996428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:45.996428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:45.996428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:45.996428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:45.996428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:45.996428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:45.996428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:45.996428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:45.996428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:45.996428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:45.996428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:45.996428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:45.996428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:45.996428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:45.996428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:45.996428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:45.997256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:45.997256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:45.997256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:45.997256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:45.997256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:45.997256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:45.997256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:45.997256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:45.997256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:45.997256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:45.997256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:45.997256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:45.997256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 281/574] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:41:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:45.997947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddee857-514e-4403-b74d-246b986703cc None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:46.000440 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:46.067948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:46.079985 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7ad1a-ca3d-4ec4-ad8f-45dbf74c7034 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:46.108091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddee857-514e-4403-b74d-246b986703cc None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:46.114922 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a88a4-09f7-44e4-93a9-74edf14128f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:46.115570 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a88a4-09f7-44e4-93a9-74edf14128f0 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:46.115855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a88a4-09f7-44e4-93a9-74edf14128f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:46.116131 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a88a4-09f7-44e4-93a9-74edf14128f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:46.123229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a88a4-09f7-44e4-93a9-74edf14128f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:46.124668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a88a4-09f7-44e4-93a9-74edf14128f0 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:46.136383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-c05a88a4-09f7-44e4-93a9-74edf14128f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:41:46.136383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:46.136383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:46.136383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:46.136383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:46.136383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:46.136383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:46.136383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:46.136383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:46.136383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:46.136383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:46.136383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:46.136383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:46.136383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:46.136383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:46.136383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:46.137303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:46.137303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:46.137303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:46.137303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:46.137303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:46.137303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:46.137303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:46.137303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:46.137303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:46.137303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:46.137303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:46.137303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:46.137303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:46.137303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:46.137303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:46.137303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:46.137303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:46.137303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:46.138248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:46.138248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:46.138248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:46.138248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:46.138248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:46.138248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:46.138248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:46.138248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:46.138248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:41:46.138248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:46.138248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 294/575] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 3 12:41:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:46.139389 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22846eb-8fb3-4ec6-b981-deb03ef964e5 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:46.139389 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22846eb-8fb3-4ec6-b981-deb03ef964e5 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:46.139389 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22846eb-8fb3-4ec6-b981-deb03ef964e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:46.150419 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d27515-d004-41f5-9ab4-c3b2dcf79683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:46.151082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d27515-d004-41f5-9ab4-c3b2dcf79683 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:46.151364 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d27515-d004-41f5-9ab4-c3b2dcf79683 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:46.151645 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d27515-d004-41f5-9ab4-c3b2dcf79683 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:46.152367 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d27515-d004-41f5-9ab4-c3b2dcf79683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:46.152674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d27515-d004-41f5-9ab4-c3b2dcf79683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:46.154053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d27515-d004-41f5-9ab4-c3b2dcf79683 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:46.162240 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-e22846eb-8fb3-4ec6-b981-deb03ef964e5 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:46.163480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e22846eb-8fb3-4ec6-b981-deb03ef964e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:46.173508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 282/576] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:46.173508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d27515-d004-41f5-9ab4-c3b2dcf79683 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:46.239628 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:46.251005 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 295/577] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:46.251825 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22846eb-8fb3-4ec6-b981-deb03ef964e5 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:46.279415 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d27515-d004-41f5-9ab4-c3b2dcf79683 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:46.315332 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba437a8-1b63-4bf4-a3ac-00a29e473fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:46.315956 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba437a8-1b63-4bf4-a3ac-00a29e473fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:46.316240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba437a8-1b63-4bf4-a3ac-00a29e473fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:46.316515 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba437a8-1b63-4bf4-a3ac-00a29e473fe8 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:46.317228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba437a8-1b63-4bf4-a3ac-00a29e473fe8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:46.317538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba437a8-1b63-4bf4-a3ac-00a29e473fe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:46.319460 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba437a8-1b63-4bf4-a3ac-00a29e473fe8 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:46.327665 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 283/578] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 3 12:41:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:46.328441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba437a8-1b63-4bf4-a3ac-00a29e473fe8 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:46.352952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:46.372161 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22846eb-8fb3-4ec6-b981-deb03ef964e5 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:46.408618 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad16c57-251c-4bfa-83cc-984bdbd6d1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:46.409359 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad16c57-251c-4bfa-83cc-984bdbd6d1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:46.409712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad16c57-251c-4bfa-83cc-984bdbd6d1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:46.410000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad16c57-251c-4bfa-83cc-984bdbd6d1c4 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:46.410830 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad16c57-251c-4bfa-83cc-984bdbd6d1c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:46.411143 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad16c57-251c-4bfa-83cc-984bdbd6d1c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:46.412595 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad16c57-251c-4bfa-83cc-984bdbd6d1c4 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:46.434984 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba437a8-1b63-4bf4-a3ac-00a29e473fe8 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:46.457725 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 296/579] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 3 12:41:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:46.465972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad16c57-251c-4bfa-83cc-984bdbd6d1c4 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:46.475713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:46.486511 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8625c4-3d1f-4b22-bf9c-eb4973c96914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:46.487184 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8625c4-3d1f-4b22-bf9c-eb4973c96914 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:46.487471 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8625c4-3d1f-4b22-bf9c-eb4973c96914 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:46.487814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8625c4-3d1f-4b22-bf9c-eb4973c96914 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:46.495089 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8625c4-3d1f-4b22-bf9c-eb4973c96914 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:46.496478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8625c4-3d1f-4b22-bf9c-eb4973c96914 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:46.508334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-5e8625c4-3d1f-4b22-bf9c-eb4973c96914 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:46.508334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:46.508334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:46.508334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:46.508334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:46.508334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:46.508334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:46.508334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:46.508334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:46.508334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:46.508334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:46.508334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:46.508334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:41:46.508334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:41:46.508334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:41:46.509421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:41:46.509421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:46.509421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:46.509421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:46.509421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:46.509421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:46.509421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:46.509421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:46.509421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:46.509421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:46.509421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:46.509421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:46.509421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:46.509421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:46.509421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:46.509421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:46.509421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:46.510306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:41:46.510306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:41:46.510306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:41:46.510306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:41:46.510306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:41:46.510306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:41:46.510306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:46.510306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:46.510306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 284/580] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:46.510306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8625c4-3d1f-4b22-bf9c-eb4973c96914 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:46.570660 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad16c57-251c-4bfa-83cc-984bdbd6d1c4 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:46.604435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e404d-ac4a-43c9-8b46-6907f1f23f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:46.605071 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e404d-ac4a-43c9-8b46-6907f1f23f16 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:46.605355 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e404d-ac4a-43c9-8b46-6907f1f23f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:46.605630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e404d-ac4a-43c9-8b46-6907f1f23f16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:46.612283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8625c4-3d1f-4b22-bf9c-eb4973c96914 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:46.613325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:46.617931 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e404d-ac4a-43c9-8b46-6907f1f23f16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:46.623929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-2b8e404d-ac4a-43c9-8b46-6907f1f23f16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:46.623929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:46.623929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:46.623929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:46.623929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:46.623929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:46.623929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:46.623929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:46.623929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:46.623929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:46.623929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:46.623929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:46.623929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:46.623929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:46.623929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:46.623929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:46.632153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:46.632153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:46.632153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:46.632153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:46.632153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:46.632153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:46.632153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:46.632153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:46.632153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:46.632153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:46.632153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:46.632153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:46.632153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:46.632153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:46.632153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:46.632153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:46.633053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:46.633053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:46.633053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:46.633053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:46.633053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:46.633053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:46.633053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:46.633053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:46.633053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:46.633053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:46.633053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:46.633053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:46.633053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 297/581] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:41:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:46.633053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e404d-ac4a-43c9-8b46-6907f1f23f16 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:46.655567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47002d-8c0a-4375-bd86-6d4f6673dff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:46.656214 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47002d-8c0a-4375-bd86-6d4f6673dff9 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:46.656499 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47002d-8c0a-4375-bd86-6d4f6673dff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:46.656784 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47002d-8c0a-4375-bd86-6d4f6673dff9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:46.667959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47002d-8c0a-4375-bd86-6d4f6673dff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:46.669607 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47002d-8c0a-4375-bd86-6d4f6673dff9 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:46.684170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-2e47002d-8c0a-4375-bd86-6d4f6673dff9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:46.684170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:46.684170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:46.684170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:46.684170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:46.684170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:46.684170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:46.684170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:46.684170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:46.684170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:46.684170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:46.684170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:46.684170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:46.684170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:46.684170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:46.685070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:46.685070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:46.685070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:46.685070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:46.685070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:46.685070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:46.685070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:46.685070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:46.685070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:46.685070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:46.685070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:46.685070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:46.685070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:46.685070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:46.685070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:46.685070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:46.685070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:46.685936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:46.685936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:46.685936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:46.685936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:46.685936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 285/582] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:46.687103 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47002d-8c0a-4375-bd86-6d4f6673dff9 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:46.724437 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:46.745660 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e404d-ac4a-43c9-8b46-6907f1f23f16 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:46.781594 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc71f76-4e21-4c5e-91dc-c2ac8c6dd0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:46.782233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc71f76-4e21-4c5e-91dc-c2ac8c6dd0bb None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:46.782517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc71f76-4e21-4c5e-91dc-c2ac8c6dd0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:46.782821 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc71f76-4e21-4c5e-91dc-c2ac8c6dd0bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:46.794129 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc71f76-4e21-4c5e-91dc-c2ac8c6dd0bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:46.795599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc71f76-4e21-4c5e-91dc-c2ac8c6dd0bb None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:46.796466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47002d-8c0a-4375-bd86-6d4f6673dff9 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:46.813172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-6fc71f76-4e21-4c5e-91dc-c2ac8c6dd0bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:46.813172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:46.813172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:46.813172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:46.813172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:46.813172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:46.813172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:46.813172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:46.813172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:46.813172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:46.813172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:46.813172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:46.813172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:46.813172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:46.813172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:46.814079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:46.814079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:46.814079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:46.814079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:46.814079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:46.814079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:46.814079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:46.814079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:46.814079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:46.814079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:46.814079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:46.814079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:46.814079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:46.814079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:46.814079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:46.814079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:46.814079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:46.815475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:46.815475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:46.815475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:46.815475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:46.816888 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 298/583] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:46.817702 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc71f76-4e21-4c5e-91dc-c2ac8c6dd0bb None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:46.837923 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d9c58-11d6-47e0-a04a-c2e40c521563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:46.838842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d9c58-11d6-47e0-a04a-c2e40c521563 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:46.839306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d9c58-11d6-47e0-a04a-c2e40c521563 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:46.839761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d9c58-11d6-47e0-a04a-c2e40c521563 None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:46.840761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d9c58-11d6-47e0-a04a-c2e40c521563 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:46.841251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d9c58-11d6-47e0-a04a-c2e40c521563 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:46.842917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d9c58-11d6-47e0-a04a-c2e40c521563 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:46.861669 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 286/584] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:41:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:46.861669 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d9c58-11d6-47e0-a04a-c2e40c521563 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:46.874978 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:46.930375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc71f76-4e21-4c5e-91dc-c2ac8c6dd0bb None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:46.963700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:46.965183 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d46717-ea34-41d8-927d-3f9677d1c0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:46.965806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d46717-ea34-41d8-927d-3f9677d1c0ad None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:46.966089 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d46717-ea34-41d8-927d-3f9677d1c0ad None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:46.966367 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d46717-ea34-41d8-927d-3f9677d1c0ad None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:46.967120 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d46717-ea34-41d8-927d-3f9677d1c0ad None admin] RBAC: Adding query filter params (name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:46.967437 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d46717-ea34-41d8-927d-3f9677d1c0ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:46.968793 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d46717-ea34-41d8-927d-3f9677d1c0ad None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:46.970203 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d9c58-11d6-47e0-a04a-c2e40c521563 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:46.981863 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 299/585] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 3 12:41:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:46.981863 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d46717-ea34-41d8-927d-3f9677d1c0ad None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:47.012402 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089fd4c-bfc3-45b4-94dd-6c3459cc3a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:47.013227 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089fd4c-bfc3-45b4-94dd-6c3459cc3a5d None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:47.013669 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089fd4c-bfc3-45b4-94dd-6c3459cc3a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:47.013948 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089fd4c-bfc3-45b4-94dd-6c3459cc3a5d None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:47.014639 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089fd4c-bfc3-45b4-94dd-6c3459cc3a5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:47.014979 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089fd4c-bfc3-45b4-94dd-6c3459cc3a5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:47.016345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089fd4c-bfc3-45b4-94dd-6c3459cc3a5d None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:47.027415 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 287/586] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:47.028177 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089fd4c-bfc3-45b4-94dd-6c3459cc3a5d None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:47.091530 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d46717-ea34-41d8-927d-3f9677d1c0ad None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:47.107618 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:47.128826 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadf5a0-00f4-4bbd-9a4a-35cae99acc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:47.129443 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadf5a0-00f4-4bbd-9a4a-35cae99acc8b None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:47.129730 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadf5a0-00f4-4bbd-9a4a-35cae99acc8b None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:47.130011 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadf5a0-00f4-4bbd-9a4a-35cae99acc8b None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:47.130764 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadf5a0-00f4-4bbd-9a4a-35cae99acc8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:47.131071 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadf5a0-00f4-4bbd-9a4a-35cae99acc8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:47.132548 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadf5a0-00f4-4bbd-9a4a-35cae99acc8b None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:47.134075 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089fd4c-bfc3-45b4-94dd-6c3459cc3a5d None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:47.149690 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 300/587] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:47.150608 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadf5a0-00f4-4bbd-9a4a-35cae99acc8b None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:47.177805 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b055b-96d2-43a6-aed1-c0bde515b695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:47.178752 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b055b-96d2-43a6-aed1-c0bde515b695 None admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:47.179045 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b055b-96d2-43a6-aed1-c0bde515b695 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:47.179745 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b055b-96d2-43a6-aed1-c0bde515b695 None admin] PATH_INFO: `/v3/projects/020d395e82f0448f95789a896703ce98/users/74b99f03a7c14a2e89384dcca532dc61/roles/72fab3a91c004428b7e615dac55116cd` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:47.201834 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b055b-96d2-43a6-aed1-c0bde515b695 None admin] RBAC: Authorizing `identity:create_grant(project_id=020d395e82f0448f95789a896703ce98, user_id=74b99f03a7c14a2e89384dcca532dc61, role_id=72fab3a91c004428b7e615dac55116cd)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:47.203415 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b055b-96d2-43a6-aed1-c0bde515b695 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:47.259773 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadf5a0-00f4-4bbd-9a4a-35cae99acc8b None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:47.274798 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 288/588] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:41:47 2022] PUT /identity/v3/projects/020d395e82f0448f95789a896703ce98/users/74b99f03a7c14a2e89384dcca532dc61/roles/72fab3a91c004428b7e615dac55116cd => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:41:47.275708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b055b-96d2-43a6-aed1-c0bde515b695 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:47.295039 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:47.311585 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c55d8b-0a2d-432b-9360-cb81ce11d8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:47.312637 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c55d8b-0a2d-432b-9360-cb81ce11d8fb None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:47.312922 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c55d8b-0a2d-432b-9360-cb81ce11d8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:47.313255 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c55d8b-0a2d-432b-9360-cb81ce11d8fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:47.325032 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c55d8b-0a2d-432b-9360-cb81ce11d8fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:47.326504 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c55d8b-0a2d-432b-9360-cb81ce11d8fb None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:47.346521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-08c55d8b-0a2d-432b-9360-cb81ce11d8fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:47.346521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:47.346521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:47.346521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:47.346521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:47.346521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:47.346521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:47.346521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:47.346521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:47.346521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:47.346521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:47.346521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:47.346521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:47.346521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:47.346521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:47.351362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:47.351362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:47.351362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:47.351362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:47.351362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:47.351362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:47.351362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:47.351362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:47.351362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:47.351362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:47.351362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:47.351362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:47.351362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:47.351362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:47.351362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:47.351362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:47.351362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:47.352266 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:47.352266 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:47.352266 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:47.352266 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:47.352266 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 301/589] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:47.352266 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c55d8b-0a2d-432b-9360-cb81ce11d8fb None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:47.382039 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:47.429231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b055b-96d2-43a6-aed1-c0bde515b695 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:47.468575 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c55d8b-0a2d-432b-9360-cb81ce11d8fb None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:47.473576 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a38fb-e4e1-4c7e-9d4a-556719b197c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:47.474332 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a38fb-e4e1-4c7e-9d4a-556719b197c9 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:47.474616 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a38fb-e4e1-4c7e-9d4a-556719b197c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:47.475838 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a38fb-e4e1-4c7e-9d4a-556719b197c9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:47.484801 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a38fb-e4e1-4c7e-9d4a-556719b197c9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:47.486259 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a38fb-e4e1-4c7e-9d4a-556719b197c9 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:47.500578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-0a0a38fb-e4e1-4c7e-9d4a-556719b197c9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:41:47.500578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:47.500578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:47.500578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:47.500578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:47.500578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:47.500578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:47.500578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:47.500578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:47.500578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:47.500578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:47.500578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:47.500578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:47.500578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:47.500578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:47.500578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:47.501638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:47.501638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:47.501638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:47.501638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:47.501638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:47.501638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:47.501638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:47.501638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:47.501638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:47.501638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:47.501638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:47.501638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:47.501638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:47.501638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:47.501638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:47.501638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:47.501638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:47.501638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:47.502568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:47.502568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:47.502568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:47.502568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:47.502568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:47.502568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:47.502568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:47.502568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:47.502568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:41:47.502568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:47.502568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 289/590] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:47.503205 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a38fb-e4e1-4c7e-9d4a-556719b197c9 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:47.513102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be88b0-dc2c-4a46-8444-91375eca40d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:47.513760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be88b0-dc2c-4a46-8444-91375eca40d1 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:47.514047 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be88b0-dc2c-4a46-8444-91375eca40d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:47.514324 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be88b0-dc2c-4a46-8444-91375eca40d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:47.521730 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be88b0-dc2c-4a46-8444-91375eca40d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:47.523201 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be88b0-dc2c-4a46-8444-91375eca40d1 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:47.537971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-65be88b0-dc2c-4a46-8444-91375eca40d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:47.537971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:47.537971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:47.537971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:47.537971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:47.537971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:47.537971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:47.537971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:47.537971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:47.537971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:47.537971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:47.537971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:47.537971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:41:47.537971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:41:47.537971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:41:47.538887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:41:47.538887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:47.538887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:47.538887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:47.538887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:47.538887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:47.538887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:47.538887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:47.538887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:47.538887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:47.538887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:47.538887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:47.538887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:47.538887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:47.538887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:47.538887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:47.538887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:47.540656 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:41:47.540656 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:41:47.540656 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:41:47.540656 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:41:47.540656 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:41:47.540656 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:41:47.540656 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:47.540656 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:47.540656 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 302/591] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:47.540656 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be88b0-dc2c-4a46-8444-91375eca40d1 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:47.597012 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:47.638630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:47.644295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a38fb-e4e1-4c7e-9d4a-556719b197c9 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:47.658848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be88b0-dc2c-4a46-8444-91375eca40d1 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:47.683143 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302eeab-cb42-4d2c-8244-29e7ec439e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:47.683856 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302eeab-cb42-4d2c-8244-29e7ec439e54 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:47.684210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302eeab-cb42-4d2c-8244-29e7ec439e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:47.684799 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302eeab-cb42-4d2c-8244-29e7ec439e54 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:47.685409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302eeab-cb42-4d2c-8244-29e7ec439e54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:47.685808 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302eeab-cb42-4d2c-8244-29e7ec439e54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:47.687316 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302eeab-cb42-4d2c-8244-29e7ec439e54 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:47.705509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 290/592] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:47.705509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302eeab-cb42-4d2c-8244-29e7ec439e54 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:47.719098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c11870-61b6-4abb-9c2d-4840ff0025d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:47.720007 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c11870-61b6-4abb-9c2d-4840ff0025d4 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:47.720906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c11870-61b6-4abb-9c2d-4840ff0025d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:47.721330 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c11870-61b6-4abb-9c2d-4840ff0025d4 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:47.722568 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c11870-61b6-4abb-9c2d-4840ff0025d4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:47.723075 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c11870-61b6-4abb-9c2d-4840ff0025d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:47.726190 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c11870-61b6-4abb-9c2d-4840ff0025d4 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:47.751018 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 303/593] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 3 12:41:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:47.752592 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c11870-61b6-4abb-9c2d-4840ff0025d4 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:47.827948 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302eeab-cb42-4d2c-8244-29e7ec439e54 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:47.855642 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:47.865101 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c11870-61b6-4abb-9c2d-4840ff0025d4 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:47.865754 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a4042-b1f4-4e9a-bb93-c577655d6898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:47.868628 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a4042-b1f4-4e9a-bb93-c577655d6898 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:47.868628 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a4042-b1f4-4e9a-bb93-c577655d6898 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:47.868628 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a4042-b1f4-4e9a-bb93-c577655d6898 None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:47.868628 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a4042-b1f4-4e9a-bb93-c577655d6898 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:47.868628 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a4042-b1f4-4e9a-bb93-c577655d6898 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:47.869717 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a4042-b1f4-4e9a-bb93-c577655d6898 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:47.886489 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 291/594] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:41:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:47.886489 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a4042-b1f4-4e9a-bb93-c577655d6898 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:47.907591 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb2db6-0d2d-4840-8e2e-1e29873339ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:47.908241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb2db6-0d2d-4840-8e2e-1e29873339ec None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:47.908527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb2db6-0d2d-4840-8e2e-1e29873339ec None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:47.908807 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb2db6-0d2d-4840-8e2e-1e29873339ec None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:47.917841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb2db6-0d2d-4840-8e2e-1e29873339ec None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:47.919482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb2db6-0d2d-4840-8e2e-1e29873339ec None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:47.931614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-e0bb2db6-0d2d-4840-8e2e-1e29873339ec None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 12:41:47.931614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:47.931614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:47.931614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:47.931614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:47.931614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:47.931614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:47.931614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:47.931614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:47.931614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:47.931614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:47.931614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:47.931614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:47.931614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:47.931614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:47.931614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:47.932747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:47.932747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:47.932747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:47.932747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:47.932747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:47.932747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:47.932747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:47.932747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:47.932747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:47.932747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:47.932747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:47.932747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:47.932747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:47.932747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:47.932747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:47.932747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:47.932747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:47.932747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:47.933695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:47.933695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:47.933695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:47.933695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:47.933695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:47.933695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:47.933695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:47.933695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:47.933695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 12:41:47.933695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:47.933695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 304/595] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:41:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:47.934276 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99d178-e367-44dc-880b-1109c92bb78a None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:47.934810 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99d178-e367-44dc-880b-1109c92bb78a None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:47.934810 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99d178-e367-44dc-880b-1109c92bb78a None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:47.936160 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 305/596] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:47.938460 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99d178-e367-44dc-880b-1109c92bb78a None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:47.944276 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:48.013799 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a4042-b1f4-4e9a-bb93-c577655d6898 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:48.044825 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99d178-e367-44dc-880b-1109c92bb78a None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:48.050591 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f98fe9-669d-4f87-944c-275f971de237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:48.051501 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f98fe9-669d-4f87-944c-275f971de237 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:48.053070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f98fe9-669d-4f87-944c-275f971de237 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:48.053506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f98fe9-669d-4f87-944c-275f971de237 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:48.067772 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f98fe9-669d-4f87-944c-275f971de237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:48.069951 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f98fe9-669d-4f87-944c-275f971de237 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:48.081506 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73740bb4-5f5c-41a6-980b-bb5f4eb5ea3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:48.082116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73740bb4-5f5c-41a6-980b-bb5f4eb5ea3f None admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:48.082401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73740bb4-5f5c-41a6-980b-bb5f4eb5ea3f None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:48.082678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73740bb4-5f5c-41a6-980b-bb5f4eb5ea3f None admin] PATH_INFO: `/v3/projects/020d395e82f0448f95789a896703ce98/users/bc939818c9224b0ebe2dbaa1eaaec5e5/roles/72fab3a91c004428b7e615dac55116cd` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:48.084257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-d7f98fe9-669d-4f87-944c-275f971de237 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:48.084257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:48.084257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:48.084257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:48.084257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:48.084257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:48.084257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:48.084257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:48.084257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:48.084257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:48.084257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:48.084257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:48.084257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:48.084257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:48.084257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:48.085142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:48.085142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:48.085142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:48.085142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:48.085142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:48.085142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:48.085142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:48.085142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:48.085142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:48.085142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:48.085142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:48.085142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:48.085142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:48.085142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:48.085142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:48.085142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:48.085142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:48.086052 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:48.086052 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:48.086052 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:48.086052 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:48.086052 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 292/597] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:48.086335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f98fe9-669d-4f87-944c-275f971de237 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:48.103711 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73740bb4-5f5c-41a6-980b-bb5f4eb5ea3f None admin] RBAC: Authorizing `identity:create_grant(project_id=020d395e82f0448f95789a896703ce98, user_id=bc939818c9224b0ebe2dbaa1eaaec5e5, role_id=72fab3a91c004428b7e615dac55116cd)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:48.105225 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73740bb4-5f5c-41a6-980b-bb5f4eb5ea3f None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:48.128389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:48.180524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 306/598] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:41:47 2022] PUT /identity/v3/projects/020d395e82f0448f95789a896703ce98/users/bc939818c9224b0ebe2dbaa1eaaec5e5/roles/72fab3a91c004428b7e615dac55116cd => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:41:48.181822 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d2169-7684-45a4-a82a-d44bff0e6bf0 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:48.182114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d2169-7684-45a4-a82a-d44bff0e6bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:48.182394 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d2169-7684-45a4-a82a-d44bff0e6bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:48.205589 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f98fe9-669d-4f87-944c-275f971de237 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:48.210669 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-af4d2169-7684-45a4-a82a-d44bff0e6bf0 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:48.212031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-af4d2169-7684-45a4-a82a-d44bff0e6bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:48.251951 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c138338-63f3-4141-9c9d-1ddc45b76a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:48.253008 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c138338-63f3-4141-9c9d-1ddc45b76a3a None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:48.253477 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c138338-63f3-4141-9c9d-1ddc45b76a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:48.253937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c138338-63f3-4141-9c9d-1ddc45b76a3a None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:48.255196 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c138338-63f3-4141-9c9d-1ddc45b76a3a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:48.256454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c138338-63f3-4141-9c9d-1ddc45b76a3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:48.258352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c138338-63f3-4141-9c9d-1ddc45b76a3a None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:48.284491 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:48.285021 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 293/599] 10.222.0.64 () {56 vars in 1139 bytes} [Wed Aug 3 12:41:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:48.286044 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c138338-63f3-4141-9c9d-1ddc45b76a3a None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:48.322802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 307/600] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:48.322802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d2169-7684-45a4-a82a-d44bff0e6bf0 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:48.426158 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c138338-63f3-4141-9c9d-1ddc45b76a3a None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:48.439144 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:48.445184 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d2169-7684-45a4-a82a-d44bff0e6bf0 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:48.462313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0721d-e796-4a7d-a52b-21b5e693d336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:48.465088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0721d-e796-4a7d-a52b-21b5e693d336 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:48.465088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0721d-e796-4a7d-a52b-21b5e693d336 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:48.465088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0721d-e796-4a7d-a52b-21b5e693d336 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:48.466131 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0721d-e796-4a7d-a52b-21b5e693d336 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:48.466612 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0721d-e796-4a7d-a52b-21b5e693d336 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:48.468222 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0721d-e796-4a7d-a52b-21b5e693d336 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:48.481907 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 294/601] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:48.483222 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0721d-e796-4a7d-a52b-21b5e693d336 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:48.492252 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531bdfe-ba50-44e1-82b7-cc6e56289b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:48.492915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531bdfe-ba50-44e1-82b7-cc6e56289b6b None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:48.493204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531bdfe-ba50-44e1-82b7-cc6e56289b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:48.493489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531bdfe-ba50-44e1-82b7-cc6e56289b6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:48.507215 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531bdfe-ba50-44e1-82b7-cc6e56289b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:48.508941 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531bdfe-ba50-44e1-82b7-cc6e56289b6b None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:48.529722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-7531bdfe-ba50-44e1-82b7-cc6e56289b6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:48.529722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:48.529722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:48.529722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:48.529722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:48.529722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:48.529722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:48.529722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:48.529722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:48.529722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:48.529722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:48.529722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:48.529722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:48.529722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:48.529722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:48.530673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:48.530673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:48.530673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:48.530673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:48.530673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:48.530673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:48.530673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:48.530673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:48.530673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:48.530673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:48.530673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:48.530673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:48.530673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:48.530673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:48.530673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:48.530673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:48.530673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:48.535621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:48.535621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:48.535621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:48.535621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:48.535621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 308/602] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:48.535621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531bdfe-ba50-44e1-82b7-cc6e56289b6b None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:48.576108 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:48.618939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0721d-e796-4a7d-a52b-21b5e693d336 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:48.647676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531bdfe-ba50-44e1-82b7-cc6e56289b6b None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:48.665668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5d700-d71d-4c13-9cca-91741e8191c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:48.666980 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5d700-d71d-4c13-9cca-91741e8191c0 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:48.667417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5d700-d71d-4c13-9cca-91741e8191c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:48.667876 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5d700-d71d-4c13-9cca-91741e8191c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:48.682682 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5d700-d71d-4c13-9cca-91741e8191c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:48.683235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583e764-2f59-4a65-8acb-d169e1d56519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:48.683944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583e764-2f59-4a65-8acb-d169e1d56519 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:48.684311 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583e764-2f59-4a65-8acb-d169e1d56519 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:48.684654 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583e764-2f59-4a65-8acb-d169e1d56519 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:48.690422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-69b5d700-d71d-4c13-9cca-91741e8191c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:48.690422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:48.690422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:48.690422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:48.690422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:48.690422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:48.690422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:48.690422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:48.690422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:48.690422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:48.690422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:48.690422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:48.690422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:48.690422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:48.690422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:48.690422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:48.691379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:48.691379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:48.691379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:48.691379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:48.691379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:48.691379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:48.691379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:48.691379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:48.691379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:48.691379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:48.691379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:48.691379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:48.691379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:48.691379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:48.691379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:48.691379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:48.692202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:48.692202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:48.692202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:48.692202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:48.692202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:48.692202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:48.692202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:48.692202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:48.692202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:48.692202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:48.692202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:48.692202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:48.694344 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583e764-2f59-4a65-8acb-d169e1d56519 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:48.695185 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 295/603] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:41:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:48.696137 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5d700-d71d-4c13-9cca-91741e8191c0 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:48.696307 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583e764-2f59-4a65-8acb-d169e1d56519 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:48.711341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-9583e764-2f59-4a65-8acb-d169e1d56519 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:48.711341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:48.711341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:48.711341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:48.711341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:48.711341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:48.711341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:48.711341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:48.711341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:48.711341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:48.711341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:48.711341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:48.711341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:41:48.711341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:41:48.711341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:41:48.712363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:41:48.712363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:48.712363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:48.712363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:48.712363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:48.712363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:48.712363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:48.712363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:48.712363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:48.712363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:48.712363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:48.712363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:48.712363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:48.712363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:48.712363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:48.712363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:48.712363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:48.713237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:41:48.713237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:41:48.713237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:41:48.713237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:41:48.713237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:41:48.713237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:41:48.713237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:48.713237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:48.713237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 309/604] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:48.718114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583e764-2f59-4a65-8acb-d169e1d56519 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:48.720804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:48.809997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5d700-d71d-4c13-9cca-91741e8191c0 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:48.819385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:48.825407 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583e764-2f59-4a65-8acb-d169e1d56519 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:48.847691 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47bd83-4c18-4a2d-bdcf-9c0b712615e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:48.848892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47bd83-4c18-4a2d-bdcf-9c0b712615e8 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:48.849944 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47bd83-4c18-4a2d-bdcf-9c0b712615e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:48.850406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47bd83-4c18-4a2d-bdcf-9c0b712615e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:48.851318 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47bd83-4c18-4a2d-bdcf-9c0b712615e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:48.851751 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47bd83-4c18-4a2d-bdcf-9c0b712615e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:48.853249 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47bd83-4c18-4a2d-bdcf-9c0b712615e8 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:48.863341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0763d98-2fce-40bf-8881-a5b243ebbfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:48.864234 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0763d98-2fce-40bf-8881-a5b243ebbfbb None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:48.864355 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0763d98-2fce-40bf-8881-a5b243ebbfbb None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:48.864585 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0763d98-2fce-40bf-8881-a5b243ebbfbb None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:48.865375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0763d98-2fce-40bf-8881-a5b243ebbfbb None admin] RBAC: Adding query filter params (name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:48.865686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0763d98-2fce-40bf-8881-a5b243ebbfbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:48.867222 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0763d98-2fce-40bf-8881-a5b243ebbfbb None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:48.874966 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 296/605] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:48.876206 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47bd83-4c18-4a2d-bdcf-9c0b712615e8 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:48.881097 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 310/606] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 3 12:41:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:48.881418 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0763d98-2fce-40bf-8881-a5b243ebbfbb None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:48.966938 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:48.991801 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47bd83-4c18-4a2d-bdcf-9c0b712615e8 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:48.994610 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0763d98-2fce-40bf-8881-a5b243ebbfbb None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:49.028776 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4465f-3d24-4841-95dc-1bb6bc70208c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:49.029453 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4465f-3d24-4841-95dc-1bb6bc70208c None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:49.029741 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4465f-3d24-4841-95dc-1bb6bc70208c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:49.030011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4465f-3d24-4841-95dc-1bb6bc70208c None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:49.030862 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4465f-3d24-4841-95dc-1bb6bc70208c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:49.031171 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4465f-3d24-4841-95dc-1bb6bc70208c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:49.031674 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43547981-2b63-45f0-87d5-cfccb14ae72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:49.032493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43547981-2b63-45f0-87d5-cfccb14ae72e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:49.032607 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4465f-3d24-4841-95dc-1bb6bc70208c None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:49.033019 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43547981-2b63-45f0-87d5-cfccb14ae72e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:49.033438 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43547981-2b63-45f0-87d5-cfccb14ae72e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:49.041685 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43547981-2b63-45f0-87d5-cfccb14ae72e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:49.043422 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43547981-2b63-45f0-87d5-cfccb14ae72e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:49.046151 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 297/607] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:41:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:49.047028 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4465f-3d24-4841-95dc-1bb6bc70208c None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:49.056117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-43547981-2b63-45f0-87d5-cfccb14ae72e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:49.056117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:49.056117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:49.056117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:49.056117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:49.056117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:49.056117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:49.056117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:49.056117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:49.056117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:49.056117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:49.056117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:49.056117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:41:49.056117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:41:49.056117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:41:49.057193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:41:49.057193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:49.057193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:49.057193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:49.057193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:49.057193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:49.057193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:49.057193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:49.057193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:49.057193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:49.057193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:49.057193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:49.057193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:49.057193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:49.057193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:49.057193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:49.057193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:49.058115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:41:49.058115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:41:49.058115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:41:49.058115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:41:49.058115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:41:49.058115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:41:49.058115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:49.058115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:49.060190 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 311/608] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:49.061072 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43547981-2b63-45f0-87d5-cfccb14ae72e None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:49.082278 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:49.166467 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4465f-3d24-4841-95dc-1bb6bc70208c None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:49.174533 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43547981-2b63-45f0-87d5-cfccb14ae72e None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:49.203292 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eea82f-6337-4388-bb7f-a21186a59079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:49.204326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eea82f-6337-4388-bb7f-a21186a59079 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:49.204618 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eea82f-6337-4388-bb7f-a21186a59079 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:49.204899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eea82f-6337-4388-bb7f-a21186a59079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:49.208538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:49.213948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244e0fd-79b1-463e-81a1-a6af61be1929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:49.214825 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244e0fd-79b1-463e-81a1-a6af61be1929 None admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:49.215273 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244e0fd-79b1-463e-81a1-a6af61be1929 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:49.215697 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244e0fd-79b1-463e-81a1-a6af61be1929 None admin] PATH_INFO: `/v3/projects/020d395e82f0448f95789a896703ce98/users/19337279eb414e62b529feb6e7c9b1b7/roles/72fab3a91c004428b7e615dac55116cd` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:49.225994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eea82f-6337-4388-bb7f-a21186a59079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:49.225994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eea82f-6337-4388-bb7f-a21186a59079 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:49.231458 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244e0fd-79b1-463e-81a1-a6af61be1929 None admin] RBAC: Authorizing `identity:create_grant(project_id=020d395e82f0448f95789a896703ce98, user_id=19337279eb414e62b529feb6e7c9b1b7, role_id=72fab3a91c004428b7e615dac55116cd)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:49.233080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244e0fd-79b1-463e-81a1-a6af61be1929 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:49.237879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-47eea82f-6337-4388-bb7f-a21186a59079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:49.237879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:49.237879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:49.237879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:49.237879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:49.237879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:49.237879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:49.237879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:49.237879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:49.237879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:49.237879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:49.237879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:49.237879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:49.237879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:49.237879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:49.238959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:49.238959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:49.238959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:49.238959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:49.238959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:49.238959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:49.238959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:49.238959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:49.238959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:49.238959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:49.238959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:49.238959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:49.238959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:49.238959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:49.238959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:49.238959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:49.238959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:49.240018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:49.240018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:49.240018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:49.240018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:49.240018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 298/609] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:49.244912 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eea82f-6337-4388-bb7f-a21186a59079 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:49.315644 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 312/610] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:41:49 2022] PUT /identity/v3/projects/020d395e82f0448f95789a896703ce98/users/19337279eb414e62b529feb6e7c9b1b7/roles/72fab3a91c004428b7e615dac55116cd => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:41:49.318788 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244e0fd-79b1-463e-81a1-a6af61be1929 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:49.355577 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eea82f-6337-4388-bb7f-a21186a59079 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:49.395272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30043ee-384b-4c37-bf77-be9929e1d168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:49.396761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30043ee-384b-4c37-bf77-be9929e1d168 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:49.397148 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30043ee-384b-4c37-bf77-be9929e1d168 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:49.397531 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30043ee-384b-4c37-bf77-be9929e1d168 None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:49.398475 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30043ee-384b-4c37-bf77-be9929e1d168 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:49.398928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30043ee-384b-4c37-bf77-be9929e1d168 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:49.400608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30043ee-384b-4c37-bf77-be9929e1d168 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:49.416705 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 299/611] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:41:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:49.416919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:49.423500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30043ee-384b-4c37-bf77-be9929e1d168 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:49.460212 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244e0fd-79b1-463e-81a1-a6af61be1929 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:49.510272 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56fb71-e67d-43fc-8d36-f05f93ea5adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:49.511195 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:49.512912 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56fb71-e67d-43fc-8d36-f05f93ea5adb None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:49.513382 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56fb71-e67d-43fc-8d36-f05f93ea5adb None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:49.513791 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56fb71-e67d-43fc-8d36-f05f93ea5adb None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:49.514650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56fb71-e67d-43fc-8d36-f05f93ea5adb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:49.519096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56fb71-e67d-43fc-8d36-f05f93ea5adb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:49.519096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56fb71-e67d-43fc-8d36-f05f93ea5adb None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:49.539651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 313/612] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:49.540804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3120e44-4173-44ab-9a16-9973a4262778 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:49.540916 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3120e44-4173-44ab-9a16-9973a4262778 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:49.541125 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3120e44-4173-44ab-9a16-9973a4262778 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:49.542612 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 314/613] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:49.547763 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3120e44-4173-44ab-9a16-9973a4262778 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:49.579365 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30043ee-384b-4c37-bf77-be9929e1d168 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:49.618689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673cbeb-1f85-4f94-a7ce-6d5c925ef454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:49.619682 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673cbeb-1f85-4f94-a7ce-6d5c925ef454 None admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:49.620136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673cbeb-1f85-4f94-a7ce-6d5c925ef454 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:49.620571 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673cbeb-1f85-4f94-a7ce-6d5c925ef454 None admin] PATH_INFO: `/v3/projects/020d395e82f0448f95789a896703ce98/users/05c4c07ff52c43ebb5056484eac94afa/roles/72fab3a91c004428b7e615dac55116cd` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:49.635816 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673cbeb-1f85-4f94-a7ce-6d5c925ef454 None admin] RBAC: Authorizing `identity:create_grant(project_id=020d395e82f0448f95789a896703ce98, user_id=05c4c07ff52c43ebb5056484eac94afa, role_id=72fab3a91c004428b7e615dac55116cd)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:49.637271 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673cbeb-1f85-4f94-a7ce-6d5c925ef454 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:49.678220 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3120e44-4173-44ab-9a16-9973a4262778 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:49.695533 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 300/614] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:41:49 2022] PUT /identity/v3/projects/020d395e82f0448f95789a896703ce98/users/05c4c07ff52c43ebb5056484eac94afa/roles/72fab3a91c004428b7e615dac55116cd => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:41:49.697068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c6b17-a13d-4393-9448-a607e7cc32fc None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:49.697774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c6b17-a13d-4393-9448-a607e7cc32fc None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:49.698251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c6b17-a13d-4393-9448-a607e7cc32fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:49.733682 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-ce1c6b17-a13d-4393-9448-a607e7cc32fc None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:49.735037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:49.736865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-ce1c6b17-a13d-4393-9448-a607e7cc32fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:49.756207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf802266-497c-4b1b-8906-dca5667b35de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:49.757234 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf802266-497c-4b1b-8906-dca5667b35de None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:49.757762 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf802266-497c-4b1b-8906-dca5667b35de None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:49.758228 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf802266-497c-4b1b-8906-dca5667b35de None admin] PATH_INFO: `/v3/users/swift` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:49.776760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf802266-497c-4b1b-8906-dca5667b35de None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:49.776760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf802266-497c-4b1b-8906-dca5667b35de None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:49.792699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-cf802266-497c-4b1b-8906-dca5667b35de None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:41:49.792699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:49.792699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:49.792699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:49.792699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:49.792699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:49.792699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:49.792699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:49.792699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:49.792699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:49.792699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:49.792699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:49.792699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:49.792699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:49.792699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:49.792699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:49.793726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:49.793726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:49.793726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:49.793726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:49.793726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:49.793726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:49.793726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:49.793726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:49.793726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:49.793726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:49.793726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:49.793726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:49.793726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:49.793726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:49.793726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:49.793726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:49.793726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:49.793726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:49.794665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:49.794665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:49.794665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:49.794665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:49.794665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:49.794665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:49.794665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:49.794665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:49.794665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:41:49.794665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:49.796072 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 315/615] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:41:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:49.803608 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf802266-497c-4b1b-8906-dca5667b35de None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:49.895761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 301/616] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:49.921367 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c6b17-a13d-4393-9448-a607e7cc32fc None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:49.952546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:49.966244 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf802266-497c-4b1b-8906-dca5667b35de None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:50.034296 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c6b17-a13d-4393-9448-a607e7cc32fc None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:50.066388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6529b5-26a4-4cbc-9f45-c4ae730cedb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:50.067083 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6529b5-26a4-4cbc-9f45-c4ae730cedb3 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:50.067363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6529b5-26a4-4cbc-9f45-c4ae730cedb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:50.067662 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6529b5-26a4-4cbc-9f45-c4ae730cedb3 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:50.069091 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6529b5-26a4-4cbc-9f45-c4ae730cedb3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:50.069409 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6529b5-26a4-4cbc-9f45-c4ae730cedb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:50.070851 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6529b5-26a4-4cbc-9f45-c4ae730cedb3 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:50.082261 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f96292-26f9-4b36-81fe-3ad1383cd6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:50.083243 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f96292-26f9-4b36-81fe-3ad1383cd6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:50.084312 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f96292-26f9-4b36-81fe-3ad1383cd6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:50.084837 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f96292-26f9-4b36-81fe-3ad1383cd6e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:50.106120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f96292-26f9-4b36-81fe-3ad1383cd6e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:50.114324 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 316/617] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 3 12:41:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:50.115254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-c3f96292-26f9-4b36-81fe-3ad1383cd6e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:50.115254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:50.115254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:50.115254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:50.115254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:50.115254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:50.115254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:50.115254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:50.115254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:50.115254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:50.115254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:50.115254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:50.115254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:50.115254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:50.115254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:50.115254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:50.116307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:50.116307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:50.116307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:50.116307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:50.116307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:50.116307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:50.116307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:50.116307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:50.116307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:50.116307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:50.116307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:50.116307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:50.116307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:50.116307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:50.116307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:50.116307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:50.117153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:50.117153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:50.117153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:50.117153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:50.117153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:50.117153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:50.117153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:50.117153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:50.117153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:50.117153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:50.117153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:50.117153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:50.120627 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6529b5-26a4-4cbc-9f45-c4ae730cedb3 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:50.121890 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 302/618] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:41:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:50.126607 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f96292-26f9-4b36-81fe-3ad1383cd6e7 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:50.223882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:50.286032 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f96292-26f9-4b36-81fe-3ad1383cd6e7 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:50.296251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:50.319308 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6529b5-26a4-4cbc-9f45-c4ae730cedb3 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:50.323290 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1332e-84a3-48cd-a3a0-1d086bc7924a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:50.324236 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1332e-84a3-48cd-a3a0-1d086bc7924a None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:50.324705 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1332e-84a3-48cd-a3a0-1d086bc7924a None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:50.325165 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1332e-84a3-48cd-a3a0-1d086bc7924a None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:50.326081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1332e-84a3-48cd-a3a0-1d086bc7924a None admin] RBAC: Adding query filter params (name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:50.326585 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1332e-84a3-48cd-a3a0-1d086bc7924a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:50.328228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1332e-84a3-48cd-a3a0-1d086bc7924a None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:50.337677 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 303/619] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 3 12:41:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:50.347739 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1332e-84a3-48cd-a3a0-1d086bc7924a None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:50.367065 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f6ead-f7e8-4f0f-b161-7b4a5179cc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:50.367718 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f6ead-f7e8-4f0f-b161-7b4a5179cc0d None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:50.368000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f6ead-f7e8-4f0f-b161-7b4a5179cc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:50.368276 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f6ead-f7e8-4f0f-b161-7b4a5179cc0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:50.388084 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f6ead-f7e8-4f0f-b161-7b4a5179cc0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:50.389542 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f6ead-f7e8-4f0f-b161-7b4a5179cc0d None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:50.414155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-5a2f6ead-f7e8-4f0f-b161-7b4a5179cc0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:50.414155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:50.414155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:50.414155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:50.414155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:50.414155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:50.414155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:50.414155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:50.414155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:50.414155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:50.414155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:50.414155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:50.414155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:50.414155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:50.414155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:50.415424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:50.415424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:50.415424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:50.415424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:50.415424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:50.415424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:50.415424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:50.415424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:50.415424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:50.415424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:50.415424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:50.415424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:50.415424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:50.415424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:50.415424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:50.415424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:50.415424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:50.416346 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:50.416346 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:50.416346 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:50.416346 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:50.417596 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 317/620] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:50.428259 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f6ead-f7e8-4f0f-b161-7b4a5179cc0d None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:50.497376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1332e-84a3-48cd-a3a0-1d086bc7924a None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:50.535163 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829a685-79f5-4c18-8361-a7ea1177d557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:50.535828 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829a685-79f5-4c18-8361-a7ea1177d557 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:50.536139 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829a685-79f5-4c18-8361-a7ea1177d557 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:50.536358 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829a685-79f5-4c18-8361-a7ea1177d557 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:50.554530 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829a685-79f5-4c18-8361-a7ea1177d557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:50.556045 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829a685-79f5-4c18-8361-a7ea1177d557 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:50.575656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-e829a685-79f5-4c18-8361-a7ea1177d557 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:50.575656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:50.575656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:50.575656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:50.575656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:50.575656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:50.575656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:50.575656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:50.575656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:50.575656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:50.575656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:50.575656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:50.575656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:50.575656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:50.575656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:50.576621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:50.576621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:50.576621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:50.576621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:50.576621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:50.576621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:50.576621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:50.576621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:50.576621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:50.576621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:50.576621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:50.576621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:50.576621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:50.576621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:50.576621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:50.576621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:50.576621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:50.577496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:50.577496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:50.577496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:50.577496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:50.581560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:50.581973 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 304/621] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:50.584239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d6853-c094-470e-86f5-5e2525687330 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:50.584673 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d6853-c094-470e-86f5-5e2525687330 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:50.585090 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d6853-c094-470e-86f5-5e2525687330 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:50.585340 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f6ead-f7e8-4f0f-b161-7b4a5179cc0d None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:50.591026 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 305/622] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:50.592003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d6853-c094-470e-86f5-5e2525687330 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:50.596330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:50.628518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be93b2e-ec1b-4864-b731-c73ec185f496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:50.629150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be93b2e-ec1b-4864-b731-c73ec185f496 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:50.629433 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be93b2e-ec1b-4864-b731-c73ec185f496 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:50.629707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be93b2e-ec1b-4864-b731-c73ec185f496 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:50.630438 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be93b2e-ec1b-4864-b731-c73ec185f496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:50.630798 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be93b2e-ec1b-4864-b731-c73ec185f496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:50.632442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be93b2e-ec1b-4864-b731-c73ec185f496 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:50.649976 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 318/623] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:50.651531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029f61a-8ef9-4c34-8332-e8173401e268 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:50.651824 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029f61a-8ef9-4c34-8332-e8173401e268 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:50.652107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029f61a-8ef9-4c34-8332-e8173401e268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:50.672802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-9029f61a-8ef9-4c34-8332-e8173401e268 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:50.674171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-9029f61a-8ef9-4c34-8332-e8173401e268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:50.727114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d6853-c094-470e-86f5-5e2525687330 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:50.759358 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 319/624] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:50.760395 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029f61a-8ef9-4c34-8332-e8173401e268 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:50.771954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0fc0a-ce2b-447b-9363-ef7e82bc67ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:50.772637 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0fc0a-ce2b-447b-9363-ef7e82bc67ae None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:50.772921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0fc0a-ce2b-447b-9363-ef7e82bc67ae None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:50.773469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0fc0a-ce2b-447b-9363-ef7e82bc67ae None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:50.773940 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0fc0a-ce2b-447b-9363-ef7e82bc67ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:50.774301 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0fc0a-ce2b-447b-9363-ef7e82bc67ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:50.775799 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0fc0a-ce2b-447b-9363-ef7e82bc67ae None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:50.800399 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 306/625] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:50.806923 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0fc0a-ce2b-447b-9363-ef7e82bc67ae None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:50.872401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:50.880430 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:50.891700 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029f61a-8ef9-4c34-8332-e8173401e268 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:50.924633 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0fc0a-ce2b-447b-9363-ef7e82bc67ae None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:50.937239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca508e7b-19b0-4dd8-9157-1b5ac3b84e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:50.938414 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca508e7b-19b0-4dd8-9157-1b5ac3b84e19 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:50.938940 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca508e7b-19b0-4dd8-9157-1b5ac3b84e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:50.939759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca508e7b-19b0-4dd8-9157-1b5ac3b84e19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:50.948819 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca508e7b-19b0-4dd8-9157-1b5ac3b84e19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:50.951019 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca508e7b-19b0-4dd8-9157-1b5ac3b84e19 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:50.961373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b8978-9e48-4c22-927e-e2ffae535e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:50.962030 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b8978-9e48-4c22-927e-e2ffae535e18 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:50.962322 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b8978-9e48-4c22-927e-e2ffae535e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:50.962603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b8978-9e48-4c22-927e-e2ffae535e18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:50.967405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-ca508e7b-19b0-4dd8-9157-1b5ac3b84e19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:50.967405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:50.967405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:50.967405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:50.967405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:50.967405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:50.967405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:50.967405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:50.967405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:50.967405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:50.967405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:50.967405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:50.967405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:41:50.967405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:41:50.967405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:41:50.968766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:41:50.968766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:50.968766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:50.968766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:50.968766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:50.968766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:50.968766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:50.968766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:50.968766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:50.968766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:50.968766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:50.968766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:50.968766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:50.968766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:50.968766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:50.968766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:50.968766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:50.969840 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:41:50.969840 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:41:50.969840 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:41:50.969840 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:41:50.969840 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:41:50.969840 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:41:50.969840 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:50.969840 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:50.972154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 320/626] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:50.973479 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca508e7b-19b0-4dd8-9157-1b5ac3b84e19 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:50.978198 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b8978-9e48-4c22-927e-e2ffae535e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:50.984154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-5e3b8978-9e48-4c22-927e-e2ffae535e18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:50.984154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:50.984154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:50.984154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:50.984154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:50.984154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:50.984154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:50.984154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:50.984154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:50.984154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:50.984154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:50.984154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:50.984154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:50.984154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:50.984154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:50.984154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:50.985256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:50.985256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:50.985256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:50.985256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:50.985256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:50.985256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:50.985256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:50.985256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:50.985256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:50.985256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:50.985256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:50.985256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:50.985256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:50.985256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:50.985256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:50.985256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:50.986084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:50.986084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:50.986084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:50.986084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:50.986084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:50.986084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:50.986084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:50.986084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:50.986084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:50.986084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:50.986084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:50.986084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:50.986709 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 307/627] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:41:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:50.987955 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b8978-9e48-4c22-927e-e2ffae535e18 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:51.098319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b8978-9e48-4c22-927e-e2ffae535e18 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:51.113723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca508e7b-19b0-4dd8-9157-1b5ac3b84e19 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:51.122340 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:51.150355 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4adac4-adeb-4abc-81aa-9b976e4afd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:51.154651 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4adac4-adeb-4abc-81aa-9b976e4afd84 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:51.155414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4adac4-adeb-4abc-81aa-9b976e4afd84 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:51.155840 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4adac4-adeb-4abc-81aa-9b976e4afd84 None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:51.157931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4adac4-adeb-4abc-81aa-9b976e4afd84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:51.158700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4adac4-adeb-4abc-81aa-9b976e4afd84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:51.160700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4adac4-adeb-4abc-81aa-9b976e4afd84 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:51.167025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b1a2a-a277-4eb6-957e-98bba73126bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:51.167893 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b1a2a-a277-4eb6-957e-98bba73126bc None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:51.168278 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b1a2a-a277-4eb6-957e-98bba73126bc None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:51.168663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b1a2a-a277-4eb6-957e-98bba73126bc None admin] PATH_INFO: `/v3/users/glance` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:51.176553 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b1a2a-a277-4eb6-957e-98bba73126bc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:51.178178 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b1a2a-a277-4eb6-957e-98bba73126bc None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:51.178554 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 308/628] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:41:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:51.179813 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4adac4-adeb-4abc-81aa-9b976e4afd84 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:51.192023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-835b1a2a-a277-4eb6-957e-98bba73126bc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 03 12:41:51.192023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:51.192023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:51.192023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:51.192023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:51.192023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:51.192023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:51.192023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:51.192023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:51.192023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:51.192023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:51.192023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:51.192023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:51.192023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:51.192023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:51.192023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:51.193218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:51.193218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:51.193218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:51.193218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:51.193218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:51.193218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:51.193218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:51.193218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:51.193218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:51.193218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:51.193218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:51.193218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:51.193218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:51.193218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:51.193218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:51.193218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:51.193218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:51.193218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:51.194362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:51.194362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:51.194362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:51.194362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:51.194362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:51.194362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:51.194362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:51.194362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:51.194362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 03 12:41:51.194362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:51.200361 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 321/629] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:51.200361 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b1a2a-a277-4eb6-957e-98bba73126bc None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:51.214635 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:51.311762 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b1a2a-a277-4eb6-957e-98bba73126bc None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:51.323286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4adac4-adeb-4abc-81aa-9b976e4afd84 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:51.358370 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053a6f6-d290-4c50-a968-5eb84debd1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:51.359470 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053a6f6-d290-4c50-a968-5eb84debd1e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:51.359917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053a6f6-d290-4c50-a968-5eb84debd1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:51.360334 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053a6f6-d290-4c50-a968-5eb84debd1e6 None admin] PATH_INFO: `/v3/projects/020d395e82f0448f95789a896703ce98/users/5209ec838a4f45d6b746edb27970c93d/roles/72fab3a91c004428b7e615dac55116cd` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:51.360959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b304be-6010-470f-aa11-7c0c724f27e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:51.361706 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b304be-6010-470f-aa11-7c0c724f27e2 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:51.362089 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b304be-6010-470f-aa11-7c0c724f27e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:51.362462 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b304be-6010-470f-aa11-7c0c724f27e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:51.363326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b304be-6010-470f-aa11-7c0c724f27e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:51.363734 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b304be-6010-470f-aa11-7c0c724f27e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:51.365355 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b304be-6010-470f-aa11-7c0c724f27e2 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:51.374930 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 309/630] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 3 12:41:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:51.376036 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b304be-6010-470f-aa11-7c0c724f27e2 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:51.381248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053a6f6-d290-4c50-a968-5eb84debd1e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=020d395e82f0448f95789a896703ce98, user_id=5209ec838a4f45d6b746edb27970c93d, role_id=72fab3a91c004428b7e615dac55116cd)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:51.382966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053a6f6-d290-4c50-a968-5eb84debd1e6 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:51.425054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:51.489567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b304be-6010-470f-aa11-7c0c724f27e2 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:51.490224 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 322/631] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:41:51 2022] PUT /identity/v3/projects/020d395e82f0448f95789a896703ce98/users/5209ec838a4f45d6b746edb27970c93d/roles/72fab3a91c004428b7e615dac55116cd => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:41:51.495388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053a6f6-d290-4c50-a968-5eb84debd1e6 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:51.563194 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2071b7-a5ff-4bc8-90ae-f8a0486f6b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:51.564228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2071b7-a5ff-4bc8-90ae-f8a0486f6b26 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:51.564708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2071b7-a5ff-4bc8-90ae-f8a0486f6b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:51.565196 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2071b7-a5ff-4bc8-90ae-f8a0486f6b26 None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:51.566251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2071b7-a5ff-4bc8-90ae-f8a0486f6b26 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:51.566844 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2071b7-a5ff-4bc8-90ae-f8a0486f6b26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:51.569225 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2071b7-a5ff-4bc8-90ae-f8a0486f6b26 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:51.591195 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 310/632] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 3 12:41:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:51.592911 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37721e0e-559d-48eb-ae60-6669539b695f None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:51.598074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37721e0e-559d-48eb-ae60-6669539b695f None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:51.598528 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37721e0e-559d-48eb-ae60-6669539b695f None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:51.604470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 311/633] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:51.604470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37721e0e-559d-48eb-ae60-6669539b695f None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:51.623101 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:51.672030 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053a6f6-d290-4c50-a968-5eb84debd1e6 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:51.712790 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d7174-d57a-4f04-8e49-997dbd0f507e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:51.713445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d7174-d57a-4f04-8e49-997dbd0f507e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:51.713730 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d7174-d57a-4f04-8e49-997dbd0f507e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:51.714008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d7174-d57a-4f04-8e49-997dbd0f507e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:51.719689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37721e0e-559d-48eb-ae60-6669539b695f None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:51.721309 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:51.728695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d7174-d57a-4f04-8e49-997dbd0f507e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:51.730428 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d7174-d57a-4f04-8e49-997dbd0f507e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:51.746949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-d65d7174-d57a-4f04-8e49-997dbd0f507e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:51.746949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:51.746949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:51.746949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:51.746949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:51.746949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:51.746949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:51.746949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:51.746949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:51.746949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:51.746949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:51.746949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:51.746949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:51.746949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:51.746949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:51.747886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:51.747886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:51.747886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:51.747886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:51.747886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:51.747886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:51.747886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:51.747886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:51.747886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:51.747886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:51.747886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:51.747886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:51.747886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:51.747886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:51.747886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:51.747886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:51.747886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:51.748747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:51.748747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:51.748747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:51.748747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:51.750936 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 323/634] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:51.752562 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08b41b-b4af-4b34-9ce2-3fcb79da7d9b None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:51.753244 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08b41b-b4af-4b34-9ce2-3fcb79da7d9b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:51.753841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08b41b-b4af-4b34-9ce2-3fcb79da7d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:51.756971 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ad227-26e9-4068-a523-8132ce6c697c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:51.757587 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ad227-26e9-4068-a523-8132ce6c697c None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:51.757868 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ad227-26e9-4068-a523-8132ce6c697c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:51.758143 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ad227-26e9-4068-a523-8132ce6c697c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:51.774386 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-cd08b41b-b4af-4b34-9ce2-3fcb79da7d9b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:51.776013 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-cd08b41b-b4af-4b34-9ce2-3fcb79da7d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:51.829908 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ad227-26e9-4068-a523-8132ce6c697c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:51.831535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ad227-26e9-4068-a523-8132ce6c697c None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:51.854828 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 324/635] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:51.856062 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08b41b-b4af-4b34-9ce2-3fcb79da7d9b None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:51.917885 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:51.938493 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 312/636] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:51.943961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ad227-26e9-4068-a523-8132ce6c697c None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:51.943961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:51.985200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08b41b-b4af-4b34-9ce2-3fcb79da7d9b None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:52.021216 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb6829-1408-490c-8a2f-f953f14659f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:52.021843 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb6829-1408-490c-8a2f-f953f14659f1 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:52.022130 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb6829-1408-490c-8a2f-f953f14659f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:52.022417 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb6829-1408-490c-8a2f-f953f14659f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:52.023142 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb6829-1408-490c-8a2f-f953f14659f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:52.023777 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb6829-1408-490c-8a2f-f953f14659f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:52.024824 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb6829-1408-490c-8a2f-f953f14659f1 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:52.036290 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 325/637] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:52.037871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cede825-e508-4944-8c01-5629a91668ce None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:52.038163 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cede825-e508-4944-8c01-5629a91668ce None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:52.038443 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cede825-e508-4944-8c01-5629a91668ce None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:52.040209 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 326/638] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:52.041313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cede825-e508-4944-8c01-5629a91668ce None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:52.055828 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ad227-26e9-4068-a523-8132ce6c697c None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:52.090272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7e196-7a50-4ac3-a178-7a9b1c2909b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:52.091086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7e196-7a50-4ac3-a178-7a9b1c2909b0 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:52.091431 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7e196-7a50-4ac3-a178-7a9b1c2909b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:52.091766 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7e196-7a50-4ac3-a178-7a9b1c2909b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:52.103405 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7e196-7a50-4ac3-a178-7a9b1c2909b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:52.108315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-06e7e196-7a50-4ac3-a178-7a9b1c2909b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:52.108315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:52.108315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:52.108315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:52.108315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:52.108315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:52.108315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:52.108315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:52.108315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:52.108315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:52.108315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:52.108315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:52.108315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:52.108315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:52.108315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:52.108315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:52.109457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:52.109457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:52.109457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:52.109457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:52.109457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:52.109457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:52.109457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:52.109457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:52.109457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:52.109457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:52.109457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:52.109457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:52.109457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:52.109457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:52.109457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:52.109457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:52.110484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:52.110484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:52.110484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:52.110484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:52.110484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:52.110484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:52.110484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:52.110484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:52.110484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:52.110484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:52.110484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:52.110484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:52.111599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 313/639] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:41:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:52.112124 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7e196-7a50-4ac3-a178-7a9b1c2909b0 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:52.150888 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:52.154806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cede825-e508-4944-8c01-5629a91668ce None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:52.185599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:52.193871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c80692-0a44-4f64-8e69-761bf5756e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:52.194607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c80692-0a44-4f64-8e69-761bf5756e69 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:52.194976 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c80692-0a44-4f64-8e69-761bf5756e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:52.196642 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c80692-0a44-4f64-8e69-761bf5756e69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:52.205405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c80692-0a44-4f64-8e69-761bf5756e69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:52.206883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c80692-0a44-4f64-8e69-761bf5756e69 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:52.221322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-f2c80692-0a44-4f64-8e69-761bf5756e69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:52.221322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:52.221322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:52.221322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:52.221322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:52.221322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:52.221322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:52.221322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:52.221322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:52.221322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:52.221322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:52.221322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:52.221322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:52.221322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:52.221322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:52.222208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:52.222208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:52.222208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:52.222208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:52.222208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:52.222208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:52.222208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:52.222208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:52.222208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:52.222208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:52.222208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:52.222208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:52.222208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:52.222208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:52.222208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:52.222208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:52.222208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:52.223169 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:52.223169 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:52.223169 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:52.223169 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:52.223169 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 327/640] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:52.223753 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c30f52-3aa0-4757-ae58-4311e40a4600 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:52.224515 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c30f52-3aa0-4757-ae58-4311e40a4600 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:52.224806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c30f52-3aa0-4757-ae58-4311e40a4600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:52.233428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7e196-7a50-4ac3-a178-7a9b1c2909b0 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:52.242868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-14c30f52-3aa0-4757-ae58-4311e40a4600 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:52.244072 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-14c30f52-3aa0-4757-ae58-4311e40a4600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:52.270152 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703a17c-bb1d-4fc1-845c-79f7264d93ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:52.271131 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703a17c-bb1d-4fc1-845c-79f7264d93ca None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:52.271717 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703a17c-bb1d-4fc1-845c-79f7264d93ca None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:52.272174 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703a17c-bb1d-4fc1-845c-79f7264d93ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:52.280285 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703a17c-bb1d-4fc1-845c-79f7264d93ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:52.282002 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703a17c-bb1d-4fc1-845c-79f7264d93ca None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:52.295338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-3703a17c-bb1d-4fc1-845c-79f7264d93ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:41:52.295338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:52.295338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:52.295338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:52.295338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:52.295338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:52.295338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:52.295338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:52.295338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:52.295338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:52.295338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:52.295338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:52.295338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:52.295338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:52.295338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:52.295338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:52.296389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:52.296389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:52.296389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:52.296389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:52.296389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:52.296389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:52.296389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:52.296389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:52.296389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:52.296389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:52.296389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:52.296389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:52.296389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:52.296389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:52.296389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:52.296389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:52.296389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:52.296389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:52.297506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:52.297506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:52.297506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:52.297506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:52.297506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:52.297506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:52.297506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:52.297506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:52.297506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:41:52.297506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:52.299707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 314/641] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 3 12:41:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:52.300569 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703a17c-bb1d-4fc1-845c-79f7264d93ca None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:52.315352 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 328/642] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:52.316360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c30f52-3aa0-4757-ae58-4311e40a4600 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:52.404161 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:52.413317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703a17c-bb1d-4fc1-845c-79f7264d93ca None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:52.423383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c30f52-3aa0-4757-ae58-4311e40a4600 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:52.438494 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:52.450193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf04f2-44eb-4fb9-8445-864ef569d1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:52.450842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf04f2-44eb-4fb9-8445-864ef569d1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:52.451131 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf04f2-44eb-4fb9-8445-864ef569d1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:52.451410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf04f2-44eb-4fb9-8445-864ef569d1c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:52.452129 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf04f2-44eb-4fb9-8445-864ef569d1c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:52.452437 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf04f2-44eb-4fb9-8445-864ef569d1c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:52.453807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf04f2-44eb-4fb9-8445-864ef569d1c4 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:52.460711 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069db6c-b080-470c-8906-7f7c4c2d1c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:52.461505 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069db6c-b080-470c-8906-7f7c4c2d1c58 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:52.464444 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069db6c-b080-470c-8906-7f7c4c2d1c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:52.464444 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069db6c-b080-470c-8906-7f7c4c2d1c58 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:52.464624 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 315/643] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 3 12:41:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:52.464700 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069db6c-b080-470c-8906-7f7c4c2d1c58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:52.464700 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069db6c-b080-470c-8906-7f7c4c2d1c58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:52.464832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf04f2-44eb-4fb9-8445-864ef569d1c4 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:52.464908 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069db6c-b080-470c-8906-7f7c4c2d1c58 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:52.477215 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 329/644] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:52.477888 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069db6c-b080-470c-8906-7f7c4c2d1c58 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:52.581250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf04f2-44eb-4fb9-8445-864ef569d1c4 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:52.586599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069db6c-b080-470c-8906-7f7c4c2d1c58 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:52.618611 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208d4ca-67a1-4195-a021-435c52d970a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:52.621289 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208d4ca-67a1-4195-a021-435c52d970a1 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:52.621289 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208d4ca-67a1-4195-a021-435c52d970a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:52.621289 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208d4ca-67a1-4195-a021-435c52d970a1 None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:52.621289 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208d4ca-67a1-4195-a021-435c52d970a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:52.621289 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208d4ca-67a1-4195-a021-435c52d970a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:52.621690 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced653f-22bf-4466-9c64-f2052130efbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:52.621690 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced653f-22bf-4466-9c64-f2052130efbb None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:52.621906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced653f-22bf-4466-9c64-f2052130efbb None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:52.622185 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced653f-22bf-4466-9c64-f2052130efbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:52.622290 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208d4ca-67a1-4195-a021-435c52d970a1 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:52.633305 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced653f-22bf-4466-9c64-f2052130efbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:52.638597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-aced653f-22bf-4466-9c64-f2052130efbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:52.638597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:52.638597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:52.638597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:52.638597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:52.638597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:52.638597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:52.638597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:52.638597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:52.638597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:52.638597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:52.638597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:52.638597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:52.638597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:52.638597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:52.638597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:52.639699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:52.639699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:52.639699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:52.639699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:52.639699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:52.639699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:52.639699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:52.639699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:52.639699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:52.639699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:52.639699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:52.639699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:52.639699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:52.639699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:52.639699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:52.639699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:52.640733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:52.640733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:52.640733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:52.640733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:52.640733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:52.640733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:52.640733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:52.640733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:52.640733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:52.640733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:52.640733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:52.640733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:52.640733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 330/645] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:41:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:52.641440 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 316/646] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 3 12:41:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:52.641567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208d4ca-67a1-4195-a021-435c52d970a1 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:52.645145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced653f-22bf-4466-9c64-f2052130efbb None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:52.648453 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:52.754408 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced653f-22bf-4466-9c64-f2052130efbb None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:52.791447 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6b201-1bc5-4502-9450-db385623eab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:52.792106 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6b201-1bc5-4502-9450-db385623eab4 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:52.792392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6b201-1bc5-4502-9450-db385623eab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:52.792670 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6b201-1bc5-4502-9450-db385623eab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:52.804061 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6b201-1bc5-4502-9450-db385623eab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:52.805543 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6b201-1bc5-4502-9450-db385623eab4 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:52.807425 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:52.821806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-68d6b201-1bc5-4502-9450-db385623eab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:52.821806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:52.821806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:52.821806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:52.821806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:52.821806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:52.821806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:52.821806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:52.821806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:52.821806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:52.821806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:52.821806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:52.821806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:52.821806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:52.821806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:52.822904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:52.822904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:52.822904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:52.822904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:52.822904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:52.822904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:52.822904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:52.822904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:52.822904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:52.822904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:52.822904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:52.822904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:52.822904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:52.822904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:52.822904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:52.822904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:52.822904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:52.823768 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:52.823768 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:52.823768 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:52.823768 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:52.823768 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 331/647] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:52.824054 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6b201-1bc5-4502-9450-db385623eab4 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:52.870778 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208d4ca-67a1-4195-a021-435c52d970a1 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:52.883953 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:52.907795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd6e1e-3d84-4e4e-bcf3-1d97a626f4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:52.908664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd6e1e-3d84-4e4e-bcf3-1d97a626f4cf None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:52.909095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd6e1e-3d84-4e4e-bcf3-1d97a626f4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:52.909365 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd6e1e-3d84-4e4e-bcf3-1d97a626f4cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:52.916539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd6e1e-3d84-4e4e-bcf3-1d97a626f4cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:52.918035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd6e1e-3d84-4e4e-bcf3-1d97a626f4cf None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:52.929046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-cadd6e1e-3d84-4e4e-bcf3-1d97a626f4cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:52.929046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:52.929046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:52.929046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:52.929046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:52.929046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:52.929046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:52.929046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:52.929046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:52.929046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:52.929046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:52.929046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:52.929046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:41:52.929046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:41:52.929046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:41:52.929914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:41:52.929914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:52.929914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:52.929914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:52.929914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:52.929914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:52.929914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:52.929914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:52.929914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:52.929914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:52.929914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:52.929914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:52.929914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:52.929914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:52.929914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:52.929914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:52.929914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:52.931276 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:41:52.931276 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:41:52.931276 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:41:52.931276 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:41:52.931276 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:41:52.931276 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:41:52.931276 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:52.931276 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:52.931719 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6b201-1bc5-4502-9450-db385623eab4 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:52.934894 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 317/648] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:52.935733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd6e1e-3d84-4e4e-bcf3-1d97a626f4cf None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:52.966260 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d73f5-3717-43eb-90b0-2809cb2fb4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:52.967015 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d73f5-3717-43eb-90b0-2809cb2fb4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:52.967298 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d73f5-3717-43eb-90b0-2809cb2fb4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:52.967571 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d73f5-3717-43eb-90b0-2809cb2fb4d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:52.968392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d73f5-3717-43eb-90b0-2809cb2fb4d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:52.968696 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d73f5-3717-43eb-90b0-2809cb2fb4d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:52.970047 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d73f5-3717-43eb-90b0-2809cb2fb4d6 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:52.982776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 332/649] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 3 12:41:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:52.982776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d73f5-3717-43eb-90b0-2809cb2fb4d6 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:53.053052 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd6e1e-3d84-4e4e-bcf3-1d97a626f4cf None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:53.054625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:53.088694 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d73f5-3717-43eb-90b0-2809cb2fb4d6 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:53.089237 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd1406-c6e8-4e19-8759-d127df752f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:53.089690 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd1406-c6e8-4e19-8759-d127df752f19 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:53.090320 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd1406-c6e8-4e19-8759-d127df752f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:53.091084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd1406-c6e8-4e19-8759-d127df752f19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:53.107248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:53.125911 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf0b39-d5b4-4d76-aa4e-fdbb94597fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:53.126810 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf0b39-d5b4-4d76-aa4e-fdbb94597fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:53.126922 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf0b39-d5b4-4d76-aa4e-fdbb94597fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:53.127145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf0b39-d5b4-4d76-aa4e-fdbb94597fa9 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:53.127955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf0b39-d5b4-4d76-aa4e-fdbb94597fa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:53.128271 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf0b39-d5b4-4d76-aa4e-fdbb94597fa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:53.129638 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf0b39-d5b4-4d76-aa4e-fdbb94597fa9 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:53.148400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 333/650] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:53.148400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf0b39-d5b4-4d76-aa4e-fdbb94597fa9 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:53.178136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd1406-c6e8-4e19-8759-d127df752f19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:53.179948 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd1406-c6e8-4e19-8759-d127df752f19 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:53.254771 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf0b39-d5b4-4d76-aa4e-fdbb94597fa9 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:53.288750 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 318/651] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:53.289593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd1406-c6e8-4e19-8759-d127df752f19 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:53.293908 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:53.295979 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d3b96-a9b3-42dc-b71e-af1850048300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:53.296611 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d3b96-a9b3-42dc-b71e-af1850048300 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:53.296900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d3b96-a9b3-42dc-b71e-af1850048300 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:53.297183 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d3b96-a9b3-42dc-b71e-af1850048300 None admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:53.297978 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d3b96-a9b3-42dc-b71e-af1850048300 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:53.298293 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d3b96-a9b3-42dc-b71e-af1850048300 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:53.299762 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d3b96-a9b3-42dc-b71e-af1850048300 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:53.315365 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 334/652] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:41:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:53.315365 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d3b96-a9b3-42dc-b71e-af1850048300 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:53.356712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:53.399290 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd1406-c6e8-4e19-8759-d127df752f19 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:53.427841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d3b96-a9b3-42dc-b71e-af1850048300 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:53.439210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444386e-3a40-4157-a998-e8850528c147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:53.439923 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444386e-3a40-4157-a998-e8850528c147 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:53.440207 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444386e-3a40-4157-a998-e8850528c147 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:53.440480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444386e-3a40-4157-a998-e8850528c147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:53.451519 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444386e-3a40-4157-a998-e8850528c147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:53.452968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444386e-3a40-4157-a998-e8850528c147 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:53.464031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9b7b6-5b0c-4cda-acf6-33e54966c889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:53.464677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9b7b6-5b0c-4cda-acf6-33e54966c889 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:53.464963 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9b7b6-5b0c-4cda-acf6-33e54966c889 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:53.465241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9b7b6-5b0c-4cda-acf6-33e54966c889 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:53.467664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-5444386e-3a40-4157-a998-e8850528c147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:53.467664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:53.467664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:53.467664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:53.467664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:53.467664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:53.467664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:53.467664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:53.467664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:53.467664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:53.467664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:53.467664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:53.467664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:53.467664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:53.467664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:53.468538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:53.468538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:53.468538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:53.468538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:53.468538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:53.468538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:53.468538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:53.468538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:53.468538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:53.468538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:53.468538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:53.468538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:53.468538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:53.468538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:53.468538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:53.468538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:53.468538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:53.469423 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:53.469423 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:53.469423 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:53.469423 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:53.469423 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 319/653] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:53.469777 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444386e-3a40-4157-a998-e8850528c147 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:53.478590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9b7b6-5b0c-4cda-acf6-33e54966c889 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:53.480094 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9b7b6-5b0c-4cda-acf6-33e54966c889 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:53.492379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-f4d9b7b6-5b0c-4cda-acf6-33e54966c889 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:41:53.492379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:53.492379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:53.492379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:53.492379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:53.492379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:53.492379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:53.492379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:53.492379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:53.492379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:53.492379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:53.492379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:53.492379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:53.492379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:53.492379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:53.492379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:53.493497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:53.493497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:53.493497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:53.493497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:53.493497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:53.493497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:53.493497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:53.493497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:53.493497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:53.493497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:53.493497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:53.493497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:53.493497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:53.493497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:53.493497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:53.493497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:53.493497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:53.493497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:53.494446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:53.494446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:53.494446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:53.494446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:53.494446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:53.494446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:53.494446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:53.494446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:53.494446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:41:53.494446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:53.494446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 335/654] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:53.494446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9b7b6-5b0c-4cda-acf6-33e54966c889 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:53.532124 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:53.578390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444386e-3a40-4157-a998-e8850528c147 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:53.593789 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:53.600651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9b7b6-5b0c-4cda-acf6-33e54966c889 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:53.612562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69823b2c-eb3d-4848-bab6-063e25bea8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:53.613394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69823b2c-eb3d-4848-bab6-063e25bea8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:53.613679 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69823b2c-eb3d-4848-bab6-063e25bea8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:53.613959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69823b2c-eb3d-4848-bab6-063e25bea8d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:53.625161 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69823b2c-eb3d-4848-bab6-063e25bea8d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:53.626614 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69823b2c-eb3d-4848-bab6-063e25bea8d3 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:53.635739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd468de-9d85-495b-9e59-f4f43f14de3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:53.636352 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd468de-9d85-495b-9e59-f4f43f14de3d None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:53.636634 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd468de-9d85-495b-9e59-f4f43f14de3d None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:53.636907 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd468de-9d85-495b-9e59-f4f43f14de3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:53.637698 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd468de-9d85-495b-9e59-f4f43f14de3d None admin] RBAC: Adding query filter params (role.id=72fab3a91c004428b7e615dac55116cd, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=74b99f03a7c14a2e89384dcca532dc61) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:53.638014 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd468de-9d85-495b-9e59-f4f43f14de3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:53.639461 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd468de-9d85-495b-9e59-f4f43f14de3d None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:53.640506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-69823b2c-eb3d-4848-bab6-063e25bea8d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:53.640506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:53.640506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:53.640506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:53.640506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:53.640506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:53.640506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:53.640506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:53.640506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:53.640506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:53.640506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:53.640506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:53.640506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:53.640506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:53.640506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:53.641449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:53.641449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:53.641449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:53.641449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:53.641449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:53.641449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:53.641449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:53.641449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:53.641449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:53.641449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:53.641449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:53.641449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:53.641449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:53.641449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:53.641449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:53.641449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:53.641449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:53.642332 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:53.642332 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:53.642332 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:53.642332 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:53.642332 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 320/655] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:53.642650 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69823b2c-eb3d-4848-bab6-063e25bea8d3 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:53.657449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 336/656] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:41:53 2022] GET /identity/v3/role_assignments?user.id=74b99f03a7c14a2e89384dcca532dc61&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=72fab3a91c004428b7e615dac55116cd => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:53.657449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd468de-9d85-495b-9e59-f4f43f14de3d None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:53.762797 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69823b2c-eb3d-4848-bab6-063e25bea8d3 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:53.766596 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd468de-9d85-495b-9e59-f4f43f14de3d None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:53.770630 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:53.804873 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0ed57-1b3b-4f17-8533-683479549fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:53.805500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0ed57-1b3b-4f17-8533-683479549fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:53.805787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0ed57-1b3b-4f17-8533-683479549fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:53.806070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0ed57-1b3b-4f17-8533-683479549fb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:53.806794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0ed57-1b3b-4f17-8533-683479549fb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:53.807108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0ed57-1b3b-4f17-8533-683479549fb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:53.809162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0ed57-1b3b-4f17-8533-683479549fb0 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:53.810685 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7bccbe-189c-4535-9233-18f87694042e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:53.810685 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bccbe-189c-4535-9233-18f87694042e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:53.810685 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bccbe-189c-4535-9233-18f87694042e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:53.810985 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bccbe-189c-4535-9233-18f87694042e None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:53.811976 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7bccbe-189c-4535-9233-18f87694042e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:53.812290 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7bccbe-189c-4535-9233-18f87694042e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:53.813732 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7bccbe-189c-4535-9233-18f87694042e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:53.822782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 321/657] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:53.822782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74e7be-b5f8-42a8-a538-59948a9fd925 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:53.823033 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74e7be-b5f8-42a8-a538-59948a9fd925 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:53.823286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74e7be-b5f8-42a8-a538-59948a9fd925 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:53.824678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 322/658] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:53.825262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74e7be-b5f8-42a8-a538-59948a9fd925 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:53.835496 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 337/659] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Aug 3 12:41:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:53.835496 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdaf65c-1e51-4b9d-8654-ef52aa1d0f80 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:53.835496 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdaf65c-1e51-4b9d-8654-ef52aa1d0f80 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:53.835496 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdaf65c-1e51-4b9d-8654-ef52aa1d0f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:53.853971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-8cdaf65c-1e51-4b9d-8654-ef52aa1d0f80 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:53.855212 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-8cdaf65c-1e51-4b9d-8654-ef52aa1d0f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:53.869997 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:53.930957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 338/660] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:53.931818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdaf65c-1e51-4b9d-8654-ef52aa1d0f80 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:53.962106 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74e7be-b5f8-42a8-a538-59948a9fd925 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:53.998981 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816a7e1-4a6c-43ff-9406-e2650f6b1a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:53.999608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816a7e1-4a6c-43ff-9406-e2650f6b1a90 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:53.999893 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816a7e1-4a6c-43ff-9406-e2650f6b1a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:54.000247 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816a7e1-4a6c-43ff-9406-e2650f6b1a90 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:54.000866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816a7e1-4a6c-43ff-9406-e2650f6b1a90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:54.001176 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816a7e1-4a6c-43ff-9406-e2650f6b1a90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:54.002560 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816a7e1-4a6c-43ff-9406-e2650f6b1a90 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:54.015234 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 323/661] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:54.020159 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816a7e1-4a6c-43ff-9406-e2650f6b1a90 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:54.043065 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdaf65c-1e51-4b9d-8654-ef52aa1d0f80 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:54.048535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:54.081532 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e42e05-20af-49a5-ba40-72e50fa671ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:54.082398 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e42e05-20af-49a5-ba40-72e50fa671ef None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:54.082690 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e42e05-20af-49a5-ba40-72e50fa671ef None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:54.083004 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e42e05-20af-49a5-ba40-72e50fa671ef None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:54.091426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e42e05-20af-49a5-ba40-72e50fa671ef None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:54.092781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e42e05-20af-49a5-ba40-72e50fa671ef None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:54.105689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-b0e42e05-20af-49a5-ba40-72e50fa671ef None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 12:41:54.105689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:54.105689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:54.105689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:54.105689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:54.105689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:54.105689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:54.105689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:54.105689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:54.105689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:54.105689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:54.105689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:54.105689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:54.105689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:54.105689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:54.105689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:54.111709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:54.111709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:54.111709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:54.111709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:54.111709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:54.111709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:54.111709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:54.111709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:54.111709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:54.111709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:54.111709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:54.111709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:54.111709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:54.111709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:54.111709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:54.111709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:54.111709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:54.111709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:54.112881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:54.112881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:54.112881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:54.112881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:54.112881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:54.112881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:54.112881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:54.112881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:54.112881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 12:41:54.112881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:54.112881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 339/662] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:41:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:54.112881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e42e05-20af-49a5-ba40-72e50fa671ef None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:54.123934 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:54.140126 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816a7e1-4a6c-43ff-9406-e2650f6b1a90 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:54.180636 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c7584-5963-4a9d-bd24-0a24a187e736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:54.181257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c7584-5963-4a9d-bd24-0a24a187e736 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:54.181539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c7584-5963-4a9d-bd24-0a24a187e736 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:54.181820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c7584-5963-4a9d-bd24-0a24a187e736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:54.226655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e42e05-20af-49a5-ba40-72e50fa671ef None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:54.254660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c7584-5963-4a9d-bd24-0a24a187e736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:54.256727 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c7584-5963-4a9d-bd24-0a24a187e736 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:54.262882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d720dc-1a27-4074-b85f-11e7b6da3446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:54.263565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d720dc-1a27-4074-b85f-11e7b6da3446 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:54.263858 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d720dc-1a27-4074-b85f-11e7b6da3446 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:54.264138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d720dc-1a27-4074-b85f-11e7b6da3446 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:54.274229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d720dc-1a27-4074-b85f-11e7b6da3446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:54.280031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-f3d720dc-1a27-4074-b85f-11e7b6da3446 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:54.280031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:54.280031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:54.280031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:54.280031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:54.280031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:54.280031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:54.280031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:54.280031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:54.280031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:54.280031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:54.280031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:54.280031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:54.280031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:54.280031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:54.280031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:54.281229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:54.281229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:54.281229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:54.281229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:54.281229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:54.281229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:54.281229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:54.281229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:54.281229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:54.281229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:54.281229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:54.281229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:54.281229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:54.281229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:54.281229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:54.281229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:54.282397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:54.282397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:54.282397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:54.282397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:54.282397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:54.282397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:54.282397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:54.282397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:54.282397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:54.282397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:54.282397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:54.282397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:54.285932 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 340/663] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:41:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:54.287290 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d720dc-1a27-4074-b85f-11e7b6da3446 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:54.290088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:54.355620 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:54.372386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 324/664] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:54.372386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c7584-5963-4a9d-bd24-0a24a187e736 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:54.396322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d720dc-1a27-4074-b85f-11e7b6da3446 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:54.433114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c063d-02a2-4245-b084-51c2fc2a23ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:54.433825 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c063d-02a2-4245-b084-51c2fc2a23ba None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:54.434119 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c063d-02a2-4245-b084-51c2fc2a23ba None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:54.434401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c063d-02a2-4245-b084-51c2fc2a23ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:54.441356 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c063d-02a2-4245-b084-51c2fc2a23ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:54.442863 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c063d-02a2-4245-b084-51c2fc2a23ba None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:54.454651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-1e2c063d-02a2-4245-b084-51c2fc2a23ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:54.454651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:54.454651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:54.454651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:54.454651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:54.454651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:54.454651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:54.454651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:54.454651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:54.454651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:54.454651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:54.454651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:54.454651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:41:54.454651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:41:54.454651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:41:54.455569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:41:54.455569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:54.455569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:54.455569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:54.455569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:54.455569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:54.455569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:54.455569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:54.455569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:54.455569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:54.455569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:54.455569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:54.455569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:54.455569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:54.455569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:54.455569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:54.455569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:54.456500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:41:54.456500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:41:54.456500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:41:54.456500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:41:54.456500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:41:54.456500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:41:54.456500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:54.456500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:54.456500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 341/665] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:54.456975 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c063d-02a2-4245-b084-51c2fc2a23ba None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:54.483693 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c7584-5963-4a9d-bd24-0a24a187e736 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:54.509914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:54.520585 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94345d8d-c106-4dd0-a7a4-b0fd9aa2f0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:54.521208 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94345d8d-c106-4dd0-a7a4-b0fd9aa2f0fd None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:54.521494 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94345d8d-c106-4dd0-a7a4-b0fd9aa2f0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:54.521772 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94345d8d-c106-4dd0-a7a4-b0fd9aa2f0fd None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:54.522567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94345d8d-c106-4dd0-a7a4-b0fd9aa2f0fd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:54.522924 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94345d8d-c106-4dd0-a7a4-b0fd9aa2f0fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:54.524342 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94345d8d-c106-4dd0-a7a4-b0fd9aa2f0fd None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:54.542509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 325/666] 10.222.0.64 () {56 vars in 1139 bytes} [Wed Aug 3 12:41:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:54.543349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94345d8d-c106-4dd0-a7a4-b0fd9aa2f0fd None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:54.577617 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c063d-02a2-4245-b084-51c2fc2a23ba None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:54.605308 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:54.613840 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7716cde-9e9d-4de5-96bf-6462d8059999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:54.615220 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7716cde-9e9d-4de5-96bf-6462d8059999 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:54.615334 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7716cde-9e9d-4de5-96bf-6462d8059999 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:54.615892 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7716cde-9e9d-4de5-96bf-6462d8059999 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:54.616290 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7716cde-9e9d-4de5-96bf-6462d8059999 None admin] RBAC: Adding query filter params (name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:54.616601 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7716cde-9e9d-4de5-96bf-6462d8059999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:54.618307 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7716cde-9e9d-4de5-96bf-6462d8059999 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:54.629346 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 342/667] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 3 12:41:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:54.634524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7716cde-9e9d-4de5-96bf-6462d8059999 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:54.651455 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94345d8d-c106-4dd0-a7a4-b0fd9aa2f0fd None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:54.686273 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78c2f3-2583-4999-9826-73554f9f634e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:54.686942 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78c2f3-2583-4999-9826-73554f9f634e None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:54.687226 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78c2f3-2583-4999-9826-73554f9f634e None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:54.687493 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78c2f3-2583-4999-9826-73554f9f634e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:54.698111 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78c2f3-2583-4999-9826-73554f9f634e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:54.699651 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78c2f3-2583-4999-9826-73554f9f634e None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:54.715597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-da78c2f3-2583-4999-9826-73554f9f634e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:54.715597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:54.715597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:54.715597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:54.715597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:54.715597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:54.715597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:54.715597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:54.715597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:54.715597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:54.715597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:54.715597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:54.715597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:54.715597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:54.715597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:54.716508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:54.716508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:54.716508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:54.716508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:54.716508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:54.716508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:54.716508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:54.716508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:54.716508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:54.716508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:54.716508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:54.716508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:54.716508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:54.716508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:54.716508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:54.716508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:54.716508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:54.717384 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:54.717384 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:54.717384 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:54.717384 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:54.721636 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 326/668] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:54.721896 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78c2f3-2583-4999-9826-73554f9f634e None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:54.741849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7716cde-9e9d-4de5-96bf-6462d8059999 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:54.758884 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:54.777578 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d149820-506a-4175-8fba-a8bb9ef186a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:54.778426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d149820-506a-4175-8fba-a8bb9ef186a1 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:54.778682 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d149820-506a-4175-8fba-a8bb9ef186a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:54.778929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d149820-506a-4175-8fba-a8bb9ef186a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:54.779795 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d149820-506a-4175-8fba-a8bb9ef186a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:54.780022 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d149820-506a-4175-8fba-a8bb9ef186a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:54.781425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d149820-506a-4175-8fba-a8bb9ef186a1 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:54.795139 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 343/669] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:41:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:54.796060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d149820-506a-4175-8fba-a8bb9ef186a1 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:54.830657 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78c2f3-2583-4999-9826-73554f9f634e None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:54.851911 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:54.869920 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19c8fd-8a53-48bc-980e-4a5d095509d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:54.870978 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19c8fd-8a53-48bc-980e-4a5d095509d9 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:54.871463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19c8fd-8a53-48bc-980e-4a5d095509d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:54.871950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19c8fd-8a53-48bc-980e-4a5d095509d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:54.904037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d149820-506a-4175-8fba-a8bb9ef186a1 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:54.940353 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28e53a-edbf-403a-96af-0822316d614b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:54.940989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28e53a-edbf-403a-96af-0822316d614b None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:54.941329 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28e53a-edbf-403a-96af-0822316d614b None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:54.941548 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28e53a-edbf-403a-96af-0822316d614b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:54.949166 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19c8fd-8a53-48bc-980e-4a5d095509d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:54.950654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19c8fd-8a53-48bc-980e-4a5d095509d9 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:54.953098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28e53a-edbf-403a-96af-0822316d614b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:54.954542 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28e53a-edbf-403a-96af-0822316d614b None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:54.969034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-1a28e53a-edbf-403a-96af-0822316d614b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:54.969034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:54.969034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:54.969034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:54.969034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:54.969034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:54.969034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:54.969034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:54.969034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:54.969034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:54.969034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:54.969034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:54.969034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:54.969034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:54.969034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:54.969920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:54.969920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:54.969920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:54.969920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:54.969920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:54.969920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:54.969920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:54.969920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:54.969920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:54.969920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:54.969920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:54.969920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:54.969920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:54.969920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:54.969920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:54.969920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:54.969920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:54.970827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:54.970827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:54.970827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:54.970827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:54.970827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 344/670] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:54.971108 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28e53a-edbf-403a-96af-0822316d614b None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:54.989956 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:55.063872 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 327/671] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:55.063872 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19c8fd-8a53-48bc-980e-4a5d095509d9 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:55.083291 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28e53a-edbf-403a-96af-0822316d614b None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:55.084826 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:55.117146 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493884a-69c1-47fa-9e8e-8a1ccd627084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:55.117793 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493884a-69c1-47fa-9e8e-8a1ccd627084 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:55.118026 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493884a-69c1-47fa-9e8e-8a1ccd627084 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:55.118301 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493884a-69c1-47fa-9e8e-8a1ccd627084 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:55.119016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493884a-69c1-47fa-9e8e-8a1ccd627084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:55.119321 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493884a-69c1-47fa-9e8e-8a1ccd627084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:55.120800 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493884a-69c1-47fa-9e8e-8a1ccd627084 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:55.137399 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 345/672] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:55.137399 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493884a-69c1-47fa-9e8e-8a1ccd627084 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:55.180571 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19c8fd-8a53-48bc-980e-4a5d095509d9 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:55.216135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136d748-5c12-4220-90fb-9e020a9012ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:55.216844 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136d748-5c12-4220-90fb-9e020a9012ff None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:55.217127 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136d748-5c12-4220-90fb-9e020a9012ff None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:55.217407 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136d748-5c12-4220-90fb-9e020a9012ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:55.218200 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136d748-5c12-4220-90fb-9e020a9012ff None admin] RBAC: Adding query filter params (role.id=72fab3a91c004428b7e615dac55116cd, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=bc939818c9224b0ebe2dbaa1eaaec5e5) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:55.218517 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136d748-5c12-4220-90fb-9e020a9012ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:55.220039 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136d748-5c12-4220-90fb-9e020a9012ff None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:55.223405 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:55.234774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 328/673] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:41:55 2022] GET /identity/v3/role_assignments?user.id=bc939818c9224b0ebe2dbaa1eaaec5e5&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=72fab3a91c004428b7e615dac55116cd => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:55.234774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136d748-5c12-4220-90fb-9e020a9012ff None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:55.266862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493884a-69c1-47fa-9e8e-8a1ccd627084 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:55.316461 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfbae6-4752-42e4-9faa-a5cfac99bdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:55.317240 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfbae6-4752-42e4-9faa-a5cfac99bdf5 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:55.317563 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfbae6-4752-42e4-9faa-a5cfac99bdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:55.317848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfbae6-4752-42e4-9faa-a5cfac99bdf5 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:55.318586 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfbae6-4752-42e4-9faa-a5cfac99bdf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:55.319136 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfbae6-4752-42e4-9faa-a5cfac99bdf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:55.320755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfbae6-4752-42e4-9faa-a5cfac99bdf5 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:55.334892 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 346/674] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:55.335816 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfbae6-4752-42e4-9faa-a5cfac99bdf5 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:55.366370 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:55.380063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136d748-5c12-4220-90fb-9e020a9012ff None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:55.419833 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32315c-a1e1-49f8-a50d-ebd6778bed98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:55.420551 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32315c-a1e1-49f8-a50d-ebd6778bed98 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:55.420977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32315c-a1e1-49f8-a50d-ebd6778bed98 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:55.421391 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32315c-a1e1-49f8-a50d-ebd6778bed98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:55.435319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32315c-a1e1-49f8-a50d-ebd6778bed98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:55.437018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32315c-a1e1-49f8-a50d-ebd6778bed98 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:55.452795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-fb32315c-a1e1-49f8-a50d-ebd6778bed98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:55.452795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:55.452795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:55.452795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:55.452795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:55.452795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:55.452795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:55.452795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:55.452795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:55.452795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:55.452795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:55.452795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:55.452795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:55.452795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:55.452795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:55.453902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:55.453902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:55.453902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:55.453902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:55.453902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:55.453902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:55.453902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:55.453902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:55.453902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:55.453902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:55.453902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:55.453902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:55.453902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:55.453902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:55.453902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:55.453902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:55.453902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:55.455001 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:55.455001 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:55.455001 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:55.455001 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:55.456005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 329/675] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:55.458716 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32315c-a1e1-49f8-a50d-ebd6778bed98 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:55.461515 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfbae6-4752-42e4-9faa-a5cfac99bdf5 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:55.500582 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007728c-077a-4c45-9a49-f219ffe0295a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:55.501351 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007728c-077a-4c45-9a49-f219ffe0295a None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:55.501630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007728c-077a-4c45-9a49-f219ffe0295a None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:55.501982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007728c-077a-4c45-9a49-f219ffe0295a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:55.509890 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007728c-077a-4c45-9a49-f219ffe0295a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:55.511544 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007728c-077a-4c45-9a49-f219ffe0295a None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:55.525138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-9007728c-077a-4c45-9a49-f219ffe0295a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:55.525138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:55.525138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:55.525138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:55.525138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:55.525138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:55.525138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:55.525138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:55.525138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:55.525138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:55.525138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:55.525138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:55.525138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:41:55.525138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:41:55.525138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:41:55.526060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:41:55.526060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:55.526060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:55.526060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:55.526060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:55.526060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:55.526060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:55.526060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:55.526060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:55.526060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:55.526060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:55.526060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:55.526060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:55.526060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:55.526060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:55.526060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:55.526060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:55.527472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:41:55.527472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:41:55.527472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:41:55.527472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:41:55.527472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:41:55.527472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:41:55.527472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:55.527472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:55.527472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 347/676] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:55.528222 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:55.528319 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007728c-077a-4c45-9a49-f219ffe0295a None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:55.589978 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32315c-a1e1-49f8-a50d-ebd6778bed98 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:55.635378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:55.638621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78776d-1366-4e76-b917-41e05a11c158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:55.639308 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78776d-1366-4e76-b917-41e05a11c158 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:55.639870 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78776d-1366-4e76-b917-41e05a11c158 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:55.640166 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78776d-1366-4e76-b917-41e05a11c158 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:55.652508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78776d-1366-4e76-b917-41e05a11c158 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:55.654715 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78776d-1366-4e76-b917-41e05a11c158 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:55.656763 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007728c-077a-4c45-9a49-f219ffe0295a None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:55.671510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-fd78776d-1366-4e76-b917-41e05a11c158 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:41:55.671510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:55.671510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:55.671510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:55.671510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:55.671510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:55.671510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:55.671510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:55.671510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:55.671510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:55.671510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:55.671510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:55.671510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:55.671510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:55.671510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:55.671510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:55.672496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:55.672496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:55.672496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:55.672496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:55.672496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:55.672496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:55.672496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:55.672496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:55.672496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:55.672496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:55.672496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:55.672496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:55.672496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:55.672496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:55.672496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:55.672496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:55.672496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:55.672496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:55.673865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:55.673865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:55.673865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:55.673865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:55.673865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:55.673865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:55.673865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:55.673865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:55.673865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:41:55.673865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:55.673865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 330/677] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:41:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:55.673865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78776d-1366-4e76-b917-41e05a11c158 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:55.701994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e90a09-f6ad-4752-8605-ce500107ed8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:55.703049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e90a09-f6ad-4752-8605-ce500107ed8a None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:55.703541 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e90a09-f6ad-4752-8605-ce500107ed8a None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:55.704040 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e90a09-f6ad-4752-8605-ce500107ed8a None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:55.704947 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e90a09-f6ad-4752-8605-ce500107ed8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:55.705472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e90a09-f6ad-4752-8605-ce500107ed8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:55.707256 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e90a09-f6ad-4752-8605-ce500107ed8a None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:55.721103 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 348/678] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:55.722355 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e90a09-f6ad-4752-8605-ce500107ed8a None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:55.807557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78776d-1366-4e76-b917-41e05a11c158 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:55.821245 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:55.835957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e90a09-f6ad-4752-8605-ce500107ed8a None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:55.843275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2eee83-b2f9-42c5-bcc1-4c6cb8d192ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:55.844296 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2eee83-b2f9-42c5-bcc1-4c6cb8d192ac None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:55.844917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2eee83-b2f9-42c5-bcc1-4c6cb8d192ac None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:55.845205 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2eee83-b2f9-42c5-bcc1-4c6cb8d192ac None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:55.845987 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2eee83-b2f9-42c5-bcc1-4c6cb8d192ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:55.846778 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2eee83-b2f9-42c5-bcc1-4c6cb8d192ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:55.848623 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2eee83-b2f9-42c5-bcc1-4c6cb8d192ac None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:55.861223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 331/679] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:41:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:55.862043 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2eee83-b2f9-42c5-bcc1-4c6cb8d192ac None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:55.878373 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6b83a-caad-46c2-99a7-60d7fedb5757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:55.879041 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6b83a-caad-46c2-99a7-60d7fedb5757 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:55.879329 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6b83a-caad-46c2-99a7-60d7fedb5757 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:55.879610 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6b83a-caad-46c2-99a7-60d7fedb5757 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:55.880958 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6b83a-caad-46c2-99a7-60d7fedb5757 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:55.881271 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6b83a-caad-46c2-99a7-60d7fedb5757 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:55.882712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6b83a-caad-46c2-99a7-60d7fedb5757 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:55.900540 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:55.908530 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 349/680] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 3 12:41:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:55.908530 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666207bb-f7ad-4c07-90e3-9d5f6e431f05 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:55.908530 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666207bb-f7ad-4c07-90e3-9d5f6e431f05 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:55.908530 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666207bb-f7ad-4c07-90e3-9d5f6e431f05 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:55.908530 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 350/681] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:55.911663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666207bb-f7ad-4c07-90e3-9d5f6e431f05 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:55.977632 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2eee83-b2f9-42c5-bcc1-4c6cb8d192ac None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:56.012991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5107a-4a4e-4ef4-be48-a694fd71f6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:56.013642 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5107a-4a4e-4ef4-be48-a694fd71f6da None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:56.013930 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5107a-4a4e-4ef4-be48-a694fd71f6da None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:56.014213 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5107a-4a4e-4ef4-be48-a694fd71f6da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:56.021324 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666207bb-f7ad-4c07-90e3-9d5f6e431f05 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:56.021945 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5107a-4a4e-4ef4-be48-a694fd71f6da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:56.023435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5107a-4a4e-4ef4-be48-a694fd71f6da None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:56.034963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-9cb5107a-4a4e-4ef4-be48-a694fd71f6da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:56.034963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:56.034963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:56.034963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:56.034963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:56.034963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:56.034963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:56.034963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:56.034963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:56.034963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:56.034963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:56.034963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:56.034963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:41:56.034963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:41:56.034963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:41:56.035954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:41:56.035954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:56.035954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:56.035954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:56.035954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:56.035954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:56.035954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:56.035954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:56.035954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:56.035954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:56.035954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:56.035954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:56.035954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:56.035954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:56.035954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:56.035954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:56.035954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:56.036895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:41:56.036895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:41:56.036895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:41:56.036895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:41:56.036895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:41:56.036895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:41:56.036895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:56.036895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:56.036895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 332/682] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:56.036895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5107a-4a4e-4ef4-be48-a694fd71f6da None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:56.066601 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d01e79-1d3e-4617-916b-c1c9057a290d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:56.067277 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d01e79-1d3e-4617-916b-c1c9057a290d None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:56.068083 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d01e79-1d3e-4617-916b-c1c9057a290d None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:56.068418 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d01e79-1d3e-4617-916b-c1c9057a290d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:56.069214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d01e79-1d3e-4617-916b-c1c9057a290d None admin] RBAC: Adding query filter params (role.id=72fab3a91c004428b7e615dac55116cd, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=19337279eb414e62b529feb6e7c9b1b7) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:56.069580 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d01e79-1d3e-4617-916b-c1c9057a290d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:56.071084 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d01e79-1d3e-4617-916b-c1c9057a290d None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:56.074241 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:56.086770 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 351/683] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:41:55 2022] GET /identity/v3/role_assignments?user.id=19337279eb414e62b529feb6e7c9b1b7&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=72fab3a91c004428b7e615dac55116cd => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:56.086770 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a76b4-76e0-4e27-8f4e-3b8c427cf005 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:56.086770 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a76b4-76e0-4e27-8f4e-3b8c427cf005 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:56.086770 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a76b4-76e0-4e27-8f4e-3b8c427cf005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:56.105375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-696a76b4-76e0-4e27-8f4e-3b8c427cf005 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:56.106774 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-696a76b4-76e0-4e27-8f4e-3b8c427cf005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:56.170496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5107a-4a4e-4ef4-be48-a694fd71f6da None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:56.183623 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:56.199295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 352/684] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:56.200344 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a76b4-76e0-4e27-8f4e-3b8c427cf005 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:56.218871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39533742-9177-4092-ae61-773b1edccbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:56.219515 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39533742-9177-4092-ae61-773b1edccbed None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:56.222764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39533742-9177-4092-ae61-773b1edccbed None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:56.222764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39533742-9177-4092-ae61-773b1edccbed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:56.298051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39533742-9177-4092-ae61-773b1edccbed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:56.299547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39533742-9177-4092-ae61-773b1edccbed None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:56.312438 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a76b4-76e0-4e27-8f4e-3b8c427cf005 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:56.339213 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:56.359067 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8710ad-92d9-40a6-b9ec-60a277065368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:56.360043 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8710ad-92d9-40a6-b9ec-60a277065368 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:56.360549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8710ad-92d9-40a6-b9ec-60a277065368 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:56.361068 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8710ad-92d9-40a6-b9ec-60a277065368 None admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:56.363677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8710ad-92d9-40a6-b9ec-60a277065368 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:56.370957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8710ad-92d9-40a6-b9ec-60a277065368 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:56.370957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8710ad-92d9-40a6-b9ec-60a277065368 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:56.379004 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 353/685] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:41:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:56.379901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8710ad-92d9-40a6-b9ec-60a277065368 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:56.417476 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 333/686] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:56.418275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39533742-9177-4092-ae61-773b1edccbed None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:56.455202 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:56.500031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8710ad-92d9-40a6-b9ec-60a277065368 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:56.531939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39533742-9177-4092-ae61-773b1edccbed None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:56.558653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a219915-0d4b-4db5-9de7-14c1beb106f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:56.559747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a219915-0d4b-4db5-9de7-14c1beb106f7 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:56.560104 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a219915-0d4b-4db5-9de7-14c1beb106f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:56.560642 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a219915-0d4b-4db5-9de7-14c1beb106f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:56.567817 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:56.572823 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538960a8-b96e-48b9-b105-de1170ecaa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:56.573582 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538960a8-b96e-48b9-b105-de1170ecaa1d None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:56.573937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538960a8-b96e-48b9-b105-de1170ecaa1d None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:56.574337 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538960a8-b96e-48b9-b105-de1170ecaa1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:56.583026 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538960a8-b96e-48b9-b105-de1170ecaa1d None admin] RBAC: Adding query filter params (role.id=72fab3a91c004428b7e615dac55116cd, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=05c4c07ff52c43ebb5056484eac94afa) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:56.583026 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538960a8-b96e-48b9-b105-de1170ecaa1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:56.583204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a219915-0d4b-4db5-9de7-14c1beb106f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:56.583278 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538960a8-b96e-48b9-b105-de1170ecaa1d None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:56.583345 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a219915-0d4b-4db5-9de7-14c1beb106f7 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:56.583429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 334/687] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:41:56 2022] GET /identity/v3/role_assignments?user.id=05c4c07ff52c43ebb5056484eac94afa&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=72fab3a91c004428b7e615dac55116cd => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:56.584445 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538960a8-b96e-48b9-b105-de1170ecaa1d None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:56.608213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-7a219915-0d4b-4db5-9de7-14c1beb106f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:56.608213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:56.608213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:56.608213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:56.608213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:56.608213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:56.608213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:56.608213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:56.608213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:56.608213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:56.608213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:56.608213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:56.608213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:56.608213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:56.608213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:56.609189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:56.609189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:56.609189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:56.609189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:56.609189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:56.609189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:56.609189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:56.609189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:56.609189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:56.609189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:56.609189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:56.609189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:56.609189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:56.609189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:56.609189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:56.609189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:56.609189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:56.610073 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:56.610073 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:56.610073 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:56.610073 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:56.610073 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 354/688] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:56.616096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a219915-0d4b-4db5-9de7-14c1beb106f7 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:56.779152 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538960a8-b96e-48b9-b105-de1170ecaa1d None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:56.822615 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a219915-0d4b-4db5-9de7-14c1beb106f7 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:56.833406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:56.836466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329dbc3-c157-498c-b202-0f58dec4c38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:56.837145 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329dbc3-c157-498c-b202-0f58dec4c38d None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:56.837437 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329dbc3-c157-498c-b202-0f58dec4c38d None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:56.837716 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329dbc3-c157-498c-b202-0f58dec4c38d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:56.855721 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329dbc3-c157-498c-b202-0f58dec4c38d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:56.857534 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329dbc3-c157-498c-b202-0f58dec4c38d None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:56.863104 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131f298-9ebe-4dd8-86d5-0820577bd8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:56.863729 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131f298-9ebe-4dd8-86d5-0820577bd8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:56.864008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131f298-9ebe-4dd8-86d5-0820577bd8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:56.865037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131f298-9ebe-4dd8-86d5-0820577bd8a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:56.865798 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131f298-9ebe-4dd8-86d5-0820577bd8a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:56.866109 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131f298-9ebe-4dd8-86d5-0820577bd8a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:56.868097 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131f298-9ebe-4dd8-86d5-0820577bd8a7 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:56.877411 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-0329dbc3-c157-498c-b202-0f58dec4c38d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:56.877411 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:56.877411 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:56.877411 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:56.877411 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:56.877411 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:56.877411 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:56.877411 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:56.877411 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:56.877411 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:56.877411 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:56.877411 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:56.877411 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:56.877411 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:56.877411 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:56.878403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:56.878403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:56.878403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:56.878403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:56.878403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:56.878403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:56.878403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:56.878403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:56.878403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:56.878403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:56.878403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:56.878403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:56.878403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:56.878403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:56.878403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:56.878403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:56.878403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:56.879663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:56.879663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:56.879663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:56.879663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:56.879954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 335/689] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:56.886324 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 355/690] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:56.891128 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329dbc3-c157-498c-b202-0f58dec4c38d None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:56.892465 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131f298-9ebe-4dd8-86d5-0820577bd8a7 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:56.948254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:57.002008 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329dbc3-c157-498c-b202-0f58dec4c38d None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:57.041534 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fffb4f-7f98-485a-9628-31d96481662b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:57.042513 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fffb4f-7f98-485a-9628-31d96481662b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:57.043846 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fffb4f-7f98-485a-9628-31d96481662b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:57.044995 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fffb4f-7f98-485a-9628-31d96481662b None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:57.046081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fffb4f-7f98-485a-9628-31d96481662b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:57.048601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fffb4f-7f98-485a-9628-31d96481662b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:57.050773 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fffb4f-7f98-485a-9628-31d96481662b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:57.053189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131f298-9ebe-4dd8-86d5-0820577bd8a7 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:57.076811 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 336/691] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:57.084321 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fffb4f-7f98-485a-9628-31d96481662b None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:57.114781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7dcfa-2ed3-440f-aac4-9bda6ac68b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:57.115206 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7dcfa-2ed3-440f-aac4-9bda6ac68b52 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:57.115496 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7dcfa-2ed3-440f-aac4-9bda6ac68b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:57.115779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7dcfa-2ed3-440f-aac4-9bda6ac68b52 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:57.116486 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7dcfa-2ed3-440f-aac4-9bda6ac68b52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:57.117924 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7dcfa-2ed3-440f-aac4-9bda6ac68b52 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:57.199187 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fffb4f-7f98-485a-9628-31d96481662b None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:57.210570 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:57.237461 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b81fb8-6a68-4fc1-b47d-a98c81f3bca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:57.239284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b81fb8-6a68-4fc1-b47d-a98c81f3bca6 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:57.239629 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b81fb8-6a68-4fc1-b47d-a98c81f3bca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:57.240114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b81fb8-6a68-4fc1-b47d-a98c81f3bca6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:57.244387 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 356/692] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 3 12:41:56 2022] POST /identity/v3/users => generated 254 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:41:57.248241 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b81fb8-6a68-4fc1-b47d-a98c81f3bca6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:57.250095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b81fb8-6a68-4fc1-b47d-a98c81f3bca6 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:57.263369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-16b81fb8-6a68-4fc1-b47d-a98c81f3bca6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:57.263369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:57.263369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:57.263369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:57.263369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:57.263369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:57.263369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:57.263369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:57.263369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:57.263369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:57.263369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:57.263369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:57.263369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:41:57.263369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:41:57.263369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:41:57.264446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:41:57.264446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:57.264446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:57.264446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:57.264446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:57.264446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:57.264446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:57.264446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:57.264446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:57.264446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:57.264446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:57.264446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:57.264446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:57.264446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:57.264446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:57.264446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:57.264446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:57.265362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:41:57.265362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:41:57.265362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:41:57.265362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:41:57.265362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:41:57.265362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:41:57.265362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:57.265362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:57.268007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 337/693] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:57.273990 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7dcfa-2ed3-440f-aac4-9bda6ac68b52 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:57.309728 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:57.412540 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7dcfa-2ed3-440f-aac4-9bda6ac68b52 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:57.464397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118162b0-16d6-4781-b9b0-92ce7402068f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:57.465457 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118162b0-16d6-4781-b9b0-92ce7402068f None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:57.465994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118162b0-16d6-4781-b9b0-92ce7402068f None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:57.466556 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118162b0-16d6-4781-b9b0-92ce7402068f None admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:57.467626 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118162b0-16d6-4781-b9b0-92ce7402068f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:57.468168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118162b0-16d6-4781-b9b0-92ce7402068f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:57.469929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118162b0-16d6-4781-b9b0-92ce7402068f None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:57.484125 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 357/694] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:41:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:57.491848 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b81fb8-6a68-4fc1-b47d-a98c81f3bca6 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:57.586459 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1042f-44c0-424f-bf2f-ccc2ba55d5d3 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:57.587426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1042f-44c0-424f-bf2f-ccc2ba55d5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:57.588310 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1042f-44c0-424f-bf2f-ccc2ba55d5d3 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:57.590331 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 358/695] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:41:57.596935 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea31ae-a6f5-4927-89f8-ac5d4c1520bf None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:57.597580 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea31ae-a6f5-4927-89f8-ac5d4c1520bf None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:57.598128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea31ae-a6f5-4927-89f8-ac5d4c1520bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:57.614854 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b81fb8-6a68-4fc1-b47d-a98c81f3bca6 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:57.626430 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-26ea31ae-a6f5-4927-89f8-ac5d4c1520bf None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:57.628078 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-26ea31ae-a6f5-4927-89f8-ac5d4c1520bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:57.656229 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df8528-f72b-434d-b417-922b50b84a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:57.656858 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df8528-f72b-434d-b417-922b50b84a39 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:57.657159 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df8528-f72b-434d-b417-922b50b84a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:57.657439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df8528-f72b-434d-b417-922b50b84a39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:57.658224 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df8528-f72b-434d-b417-922b50b84a39 None admin] RBAC: Adding query filter params (role.id=72fab3a91c004428b7e615dac55116cd, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=5209ec838a4f45d6b746edb27970c93d) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:57.658546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df8528-f72b-434d-b417-922b50b84a39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:57.660225 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df8528-f72b-434d-b417-922b50b84a39 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:57.668109 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 338/696] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:41:57 2022] GET /identity/v3/role_assignments?user.id=5209ec838a4f45d6b746edb27970c93d&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=72fab3a91c004428b7e615dac55116cd => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:57.707149 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 359/697] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:57.732262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df8528-f72b-434d-b417-922b50b84a39 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:57.775385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:57.854166 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df8528-f72b-434d-b417-922b50b84a39 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:57.903730 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d5228-7aae-4b83-a8b6-cd42468134a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:57.904394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d5228-7aae-4b83-a8b6-cd42468134a5 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:57.904677 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d5228-7aae-4b83-a8b6-cd42468134a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:57.904954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d5228-7aae-4b83-a8b6-cd42468134a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:57.916304 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d5228-7aae-4b83-a8b6-cd42468134a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:57.921349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-348d5228-7aae-4b83-a8b6-cd42468134a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:41:57.921349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:57.921349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:57.921349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:57.921349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:57.921349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:57.921349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:57.921349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:57.921349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:57.921349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:57.921349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:57.921349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:57.921349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:57.921349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:57.921349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:57.921349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:57.922295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:57.922295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:57.922295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:57.922295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:57.922295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:57.922295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:57.922295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:57.922295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:57.922295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:57.922295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:57.922295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:57.922295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:57.922295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:57.922295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:57.922295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:57.922295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:57.923167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:57.923167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:57.923167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:57.923167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:57.923167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:57.923167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:57.923167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:57.923167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:57.923167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:57.923167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:57.923167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:41:57.923167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:57.923167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 339/698] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:41:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:57.930692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea31ae-a6f5-4927-89f8-ac5d4c1520bf None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:57.947084 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:58.044302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea31ae-a6f5-4927-89f8-ac5d4c1520bf None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:58.084369 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d07ac-23ae-4086-86f1-aa6aab725602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:58.084999 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d07ac-23ae-4086-86f1-aa6aab725602 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:58.085283 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d07ac-23ae-4086-86f1-aa6aab725602 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:58.085565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d07ac-23ae-4086-86f1-aa6aab725602 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:58.086294 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d07ac-23ae-4086-86f1-aa6aab725602 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:58.086602 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d07ac-23ae-4086-86f1-aa6aab725602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:58.088013 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d07ac-23ae-4086-86f1-aa6aab725602 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:58.099163 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 360/699] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:58.104625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d5228-7aae-4b83-a8b6-cd42468134a5 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:58.209300 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:58.218636 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d5228-7aae-4b83-a8b6-cd42468134a5 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:58.255181 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167ff52-c375-4db4-9a4b-9dea6b0f9dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:58.255819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167ff52-c375-4db4-9a4b-9dea6b0f9dad None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:58.256098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167ff52-c375-4db4-9a4b-9dea6b0f9dad None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:58.256374 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167ff52-c375-4db4-9a4b-9dea6b0f9dad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:58.267251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167ff52-c375-4db4-9a4b-9dea6b0f9dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:58.268717 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167ff52-c375-4db4-9a4b-9dea6b0f9dad None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:58.284790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-5167ff52-c375-4db4-9a4b-9dea6b0f9dad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:58.284790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:58.284790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:58.284790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:58.284790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:58.284790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:58.284790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:58.284790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:58.284790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:58.284790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:58.284790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:58.284790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:58.284790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:58.284790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:58.284790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:58.285711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:58.285711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:58.285711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:58.285711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:58.285711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:58.285711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:58.285711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:58.285711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:58.285711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:58.285711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:58.285711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:58.285711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:58.285711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:58.285711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:58.285711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:58.285711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:58.285711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:58.288389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:58.288389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:58.288389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:58.288389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:58.288389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 340/700] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:58.292606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d07ac-23ae-4086-86f1-aa6aab725602 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:58.345178 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6551b48-ee79-4506-9b01-a43fa1387a89 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:58.345521 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6551b48-ee79-4506-9b01-a43fa1387a89 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:58.345729 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6551b48-ee79-4506-9b01-a43fa1387a89 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:58.347375 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 341/701] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:41:58.356583 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d080b-6d82-417d-a729-de0de5863f1f None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:58.356826 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d080b-6d82-417d-a729-de0de5863f1f None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:58.357075 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d080b-6d82-417d-a729-de0de5863f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:58.386849 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-eb8d080b-6d82-417d-a729-de0de5863f1f None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:58.389597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-eb8d080b-6d82-417d-a729-de0de5863f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:58.399084 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:58.447252 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d07ac-23ae-4086-86f1-aa6aab725602 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:58.507706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21b8e0-9dfe-4a3d-be73-591d4d5bc7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:58.508719 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21b8e0-9dfe-4a3d-be73-591d4d5bc7be None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:58.509339 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21b8e0-9dfe-4a3d-be73-591d4d5bc7be None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:58.511062 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21b8e0-9dfe-4a3d-be73-591d4d5bc7be None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:58.512567 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21b8e0-9dfe-4a3d-be73-591d4d5bc7be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:58.513249 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21b8e0-9dfe-4a3d-be73-591d4d5bc7be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:58.515298 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21b8e0-9dfe-4a3d-be73-591d4d5bc7be None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:58.529352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 342/702] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:58.536739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 361/703] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:58.542513 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d080b-6d82-417d-a729-de0de5863f1f None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:58.556925 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21b8e0-9dfe-4a3d-be73-591d4d5bc7be None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:58.649417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:58.682759 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d080b-6d82-417d-a729-de0de5863f1f None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:58.713197 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15df7cd-6972-43e4-a476-83eee1b584d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:58.713837 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15df7cd-6972-43e4-a476-83eee1b584d7 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:58.714116 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15df7cd-6972-43e4-a476-83eee1b584d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:58.714389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15df7cd-6972-43e4-a476-83eee1b584d7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:58.722033 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15df7cd-6972-43e4-a476-83eee1b584d7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:58.725717 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15df7cd-6972-43e4-a476-83eee1b584d7 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:58.735975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-c15df7cd-6972-43e4-a476-83eee1b584d7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:41:58.735975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:58.735975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:58.735975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:58.735975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:58.735975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:58.735975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:58.735975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:58.735975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:58.735975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:58.735975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:58.735975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:58.735975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:58.735975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:58.735975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:58.735975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:58.736977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:58.736977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:58.736977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:58.736977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:58.736977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:58.736977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:58.736977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:58.736977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:58.736977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:58.736977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:58.736977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:58.736977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:58.736977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:58.736977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:58.736977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:58.736977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:58.736977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:58.736977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:58.738035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:58.738035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:58.738035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:58.738035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:58.738035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:58.738035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:58.738035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:58.738035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:58.738035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:41:58.738035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:58.738035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 343/704] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 3 12:41:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:58.742883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15df7cd-6972-43e4-a476-83eee1b584d7 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:58.781597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21b8e0-9dfe-4a3d-be73-591d4d5bc7be None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:58.846604 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15df7cd-6972-43e4-a476-83eee1b584d7 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:58.875453 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb122c-aeb6-4c1d-8f20-48b2aa876c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:58.876117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb122c-aeb6-4c1d-8f20-48b2aa876c5e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:58.876404 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb122c-aeb6-4c1d-8f20-48b2aa876c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:58.876684 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb122c-aeb6-4c1d-8f20-48b2aa876c5e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:58.877330 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb122c-aeb6-4c1d-8f20-48b2aa876c5e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:58.878831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb122c-aeb6-4c1d-8f20-48b2aa876c5e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:58.882189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee69aa-7f51-4808-a927-738335dba543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:58.882854 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee69aa-7f51-4808-a927-738335dba543 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:58.883115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:58.884054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee69aa-7f51-4808-a927-738335dba543 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:58.884341 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee69aa-7f51-4808-a927-738335dba543 None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:58.885143 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee69aa-7f51-4808-a927-738335dba543 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:58.885452 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee69aa-7f51-4808-a927-738335dba543 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:58.886899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee69aa-7f51-4808-a927-738335dba543 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:58.888848 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:58.904295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-ecbb122c-aeb6-4c1d-8f20-48b2aa876c5e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:41:58.904295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:58.904295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:41:58.904295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:41:58.904295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:41:58.904295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:41:58.904295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:41:58.904295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:41:58.904295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:41:58.904295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:58.904295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:41:58.904295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:58.904295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:58.904295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:58.904295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:58.904295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:58.905507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:58.905507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:58.905507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:58.905507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:58.905507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:58.905507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:58.905507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:58.905507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:41:58.905507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:41:58.905507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:41:58.905507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:41:58.905507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:58.905507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:58.905507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:58.905507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:58.905507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:58.906371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:58.906371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:58.906371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:58.906371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:58.906371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:58.906371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:58.906371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:58.906371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:58.906371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:58.906371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:58.906371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:58.906371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:41:58.906371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:41:58.906371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:41:58.906371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:58.906371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 362/705] 10.222.0.64 () {56 vars in 1129 bytes} [Wed Aug 3 12:41:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:58.907492 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 344/706] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 3 12:41:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:58.912277 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb122c-aeb6-4c1d-8f20-48b2aa876c5e None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:58.912410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee69aa-7f51-4808-a927-738335dba543 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:59.029197 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee69aa-7f51-4808-a927-738335dba543 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:59.057137 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb122c-aeb6-4c1d-8f20-48b2aa876c5e None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:59.087564 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295099b6-56a1-40fc-9582-3da0c8b92a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:59.088319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295099b6-56a1-40fc-9582-3da0c8b92a3c None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:59.088726 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295099b6-56a1-40fc-9582-3da0c8b92a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:59.089004 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295099b6-56a1-40fc-9582-3da0c8b92a3c None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:59.089748 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295099b6-56a1-40fc-9582-3da0c8b92a3c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:59.090060 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295099b6-56a1-40fc-9582-3da0c8b92a3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:59.091573 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295099b6-56a1-40fc-9582-3da0c8b92a3c None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:59.096795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 345/707] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 3 12:41:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:59.101591 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7cc09-a48c-4a17-be0d-968ba5030fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:59.102304 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7cc09-a48c-4a17-be0d-968ba5030fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:59.102591 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7cc09-a48c-4a17-be0d-968ba5030fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:59.102907 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7cc09-a48c-4a17-be0d-968ba5030fc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:59.104446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295099b6-56a1-40fc-9582-3da0c8b92a3c None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:59.189908 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:59.215547 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:59.220690 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7cc09-a48c-4a17-be0d-968ba5030fc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:59.222479 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7cc09-a48c-4a17-be0d-968ba5030fc4 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:59.239603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295099b6-56a1-40fc-9582-3da0c8b92a3c None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:59.279529 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e3522-89d2-48f0-9e5a-1bb63a0cd7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:59.280979 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e3522-89d2-48f0-9e5a-1bb63a0cd7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:59.281548 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e3522-89d2-48f0-9e5a-1bb63a0cd7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:59.282034 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e3522-89d2-48f0-9e5a-1bb63a0cd7d4 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:59.282958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e3522-89d2-48f0-9e5a-1bb63a0cd7d4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:59.283467 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e3522-89d2-48f0-9e5a-1bb63a0cd7d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:59.285235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e3522-89d2-48f0-9e5a-1bb63a0cd7d4 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:59.294171 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 346/708] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 3 12:41:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:59.295922 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039007de-da34-46cc-a4f5-0f971d870f5f None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:59.296512 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039007de-da34-46cc-a4f5-0f971d870f5f None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:59.297027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039007de-da34-46cc-a4f5-0f971d870f5f None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:59.303523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 347/709] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:41:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:59.305332 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b93984-3ae3-491c-b7e7-a8870b289f7b None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:59.305830 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b93984-3ae3-491c-b7e7-a8870b289f7b None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:59.306309 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b93984-3ae3-491c-b7e7-a8870b289f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:59.327460 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-b9b93984-3ae3-491c-b7e7-a8870b289f7b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:59.329213 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b9b93984-3ae3-491c-b7e7-a8870b289f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:59.356845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 363/710] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:41:59.362811 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7cc09-a48c-4a17-be0d-968ba5030fc4 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:59.490424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7cc09-a48c-4a17-be0d-968ba5030fc4 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:59.493360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:59.507391 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 348/711] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:41:59.527970 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cb62f-3326-4182-af26-19612f754713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:59.528628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cb62f-3326-4182-af26-19612f754713 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:59.528915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cb62f-3326-4182-af26-19612f754713 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:59.529200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cb62f-3326-4182-af26-19612f754713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:59.534906 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b93984-3ae3-491c-b7e7-a8870b289f7b None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:59.541054 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cb62f-3326-4182-af26-19612f754713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:59.543137 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cb62f-3326-4182-af26-19612f754713 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:59.560778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-fc8cb62f-3326-4182-af26-19612f754713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:59.560778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:59.560778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:59.560778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:59.560778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:59.560778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:59.560778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:59.560778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:59.560778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:59.560778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:59.560778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:59.560778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:59.560778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:59.560778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:59.560778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:59.561712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:59.561712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:59.561712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:59.561712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:59.561712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:59.561712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:59.561712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:59.561712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:59.561712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:59.561712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:59.561712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:59.561712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:59.561712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:59.561712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:59.561712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:59.561712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:59.561712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:59.562589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:59.562589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:59.562589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:59.562589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:41:59.562589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 364/712] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:59.568646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cb62f-3326-4182-af26-19612f754713 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:59.599759 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:59.656759 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b93984-3ae3-491c-b7e7-a8870b289f7b None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:59.686636 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cb62f-3326-4182-af26-19612f754713 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:59.694924 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad1980-5a97-4de0-9cf6-3c6903420853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:59.695922 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad1980-5a97-4de0-9cf6-3c6903420853 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:59.696407 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad1980-5a97-4de0-9cf6-3c6903420853 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:59.696894 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad1980-5a97-4de0-9cf6-3c6903420853 None admin] PATH_INFO: `/v3/services/network` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:59.697835 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad1980-5a97-4de0-9cf6-3c6903420853 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:59.699540 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad1980-5a97-4de0-9cf6-3c6903420853 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:59.714478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-bfad1980-5a97-4de0-9cf6-3c6903420853 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:41:59.714478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:59.714478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:41:59.714478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:41:59.714478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:41:59.714478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:41:59.714478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:41:59.714478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:41:59.714478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:41:59.714478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:59.714478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:41:59.714478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:59.714478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:59.714478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:59.714478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:59.714478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:59.714478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:59.715542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:59.715542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:59.715542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:59.715542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:59.715542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:59.715542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:59.715542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:41:59.715542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:41:59.715542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:41:59.715542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:41:59.715542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:59.715542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:59.715542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:59.715542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:59.715542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:59.715542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:59.716354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:59.716354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:59.716354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:59.716354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:59.716354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:59.716354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:59.716354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:59.716354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:59.716354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:59.716354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:59.716354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:41:59.716354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:41:59.716354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:41:59.716354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:41:59.719465 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 349/713] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:59 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:59.723700 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad2da6-35d3-41c8-b336-26a8c2ee3f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:59.724325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad2da6-35d3-41c8-b336-26a8c2ee3f3f None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:59.724613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad2da6-35d3-41c8-b336-26a8c2ee3f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:59.724892 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad2da6-35d3-41c8-b336-26a8c2ee3f3f None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:59.725895 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad2da6-35d3-41c8-b336-26a8c2ee3f3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:59.726209 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad2da6-35d3-41c8-b336-26a8c2ee3f3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:59.726956 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad1980-5a97-4de0-9cf6-3c6903420853 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:59.727696 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad2da6-35d3-41c8-b336-26a8c2ee3f3f None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:59.879438 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 365/714] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:59.885136 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad2da6-35d3-41c8-b336-26a8c2ee3f3f None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:59.906667 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:59.966656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad1980-5a97-4de0-9cf6-3c6903420853 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:59.986235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:00.009344 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d723bc2-1b53-4833-b4a0-39f5655f6f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:00.010369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d723bc2-1b53-4833-b4a0-39f5655f6f54 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:00.011027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d723bc2-1b53-4833-b4a0-39f5655f6f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:00.011509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d723bc2-1b53-4833-b4a0-39f5655f6f54 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:00.012463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d723bc2-1b53-4833-b4a0-39f5655f6f54 None admin] RBAC: Adding query filter params (name=network) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:00.012972 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d723bc2-1b53-4833-b4a0-39f5655f6f54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:00.014606 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d723bc2-1b53-4833-b4a0-39f5655f6f54 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:00.021888 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 350/715] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 3 12:41:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:00.027760 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d723bc2-1b53-4833-b4a0-39f5655f6f54 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:00.088407 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad2da6-35d3-41c8-b336-26a8c2ee3f3f None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:00.125905 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28f1bd-e191-46e1-9329-9a4d4a9aea5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:00.126561 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28f1bd-e191-46e1-9329-9a4d4a9aea5c None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:00.126890 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28f1bd-e191-46e1-9329-9a4d4a9aea5c None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:00.127268 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28f1bd-e191-46e1-9329-9a4d4a9aea5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:00.135418 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28f1bd-e191-46e1-9329-9a4d4a9aea5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:00.136806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28f1bd-e191-46e1-9329-9a4d4a9aea5c None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:00.152765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-2e28f1bd-e191-46e1-9329-9a4d4a9aea5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:00.152765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:00.152765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:00.152765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:00.152765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:00.152765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:00.152765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:00.152765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:00.152765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:00.152765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:00.152765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:00.152765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:00.152765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:42:00.152765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:42:00.152765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:42:00.153706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:42:00.153706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:00.153706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:00.153706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:00.153706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:00.153706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:00.153706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:00.153706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:00.153706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:00.153706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:00.153706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:00.153706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:00.153706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:00.153706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:00.153706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:00.153706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:00.153706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:00.154599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:42:00.154599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:42:00.154599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:42:00.154599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:42:00.154599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:42:00.154599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:42:00.154599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:00.154599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:00.155577 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 366/716] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:00.156636 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c34483-bdab-42e7-8525-306a226b4085 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:00.156932 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c34483-bdab-42e7-8525-306a226b4085 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:00.157219 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c34483-bdab-42e7-8525-306a226b4085 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:00.158763 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 367/717] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:00.159626 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d723bc2-1b53-4833-b4a0-39f5655f6f54 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:00.165112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ae8a2-32b6-425d-9bcb-146ac9f43ecb None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:00.165404 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ae8a2-32b6-425d-9bcb-146ac9f43ecb None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:00.165683 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ae8a2-32b6-425d-9bcb-146ac9f43ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:00.186790 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-e89ae8a2-32b6-425d-9bcb-146ac9f43ecb None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:00.187984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e89ae8a2-32b6-425d-9bcb-146ac9f43ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:00.206692 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa208e9-f05e-4633-92b3-778ed90fb7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:00.207945 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa208e9-f05e-4633-92b3-778ed90fb7b4 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:00.208425 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa208e9-f05e-4633-92b3-778ed90fb7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:00.209157 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa208e9-f05e-4633-92b3-778ed90fb7b4 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:00.210521 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa208e9-f05e-4633-92b3-778ed90fb7b4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:00.211073 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa208e9-f05e-4633-92b3-778ed90fb7b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:00.213220 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa208e9-f05e-4633-92b3-778ed90fb7b4 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:00.226941 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 351/718] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 3 12:42:00 2022] GET /identity/v3/services?type=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:00.226941 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa208e9-f05e-4633-92b3-778ed90fb7b4 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:00.310291 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:00.317622 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:00.320713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 368/719] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:42:00.401675 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ae8a2-32b6-425d-9bcb-146ac9f43ecb None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:00.412765 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa208e9-f05e-4633-92b3-778ed90fb7b4 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:00.464909 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b9d8e-4233-4b63-8d29-3e7b3d604b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:00.465537 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b9d8e-4233-4b63-8d29-3e7b3d604b4c None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:00.465821 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b9d8e-4233-4b63-8d29-3e7b3d604b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:00.466097 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b9d8e-4233-4b63-8d29-3e7b3d604b4c None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:00.466904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b9d8e-4233-4b63-8d29-3e7b3d604b4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:00.467219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b9d8e-4233-4b63-8d29-3e7b3d604b4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:00.468657 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b9d8e-4233-4b63-8d29-3e7b3d604b4c None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:00.484548 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 352/720] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:42:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:00.485880 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1c328-6a1f-49f1-933a-5507a156aba2 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:00.486170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1c328-6a1f-49f1-933a-5507a156aba2 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:00.486461 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1c328-6a1f-49f1-933a-5507a156aba2 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:00.487957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 353/721] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:00.493295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1c328-6a1f-49f1-933a-5507a156aba2 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:00.529037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ae8a2-32b6-425d-9bcb-146ac9f43ecb None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:00.574947 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a995611-ca4c-4fe0-8061-fcb496fdbc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:00.576093 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a995611-ca4c-4fe0-8061-fcb496fdbc67 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:00.576382 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a995611-ca4c-4fe0-8061-fcb496fdbc67 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:00.576975 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a995611-ca4c-4fe0-8061-fcb496fdbc67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:00.591069 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a995611-ca4c-4fe0-8061-fcb496fdbc67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:42:00.597820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-7a995611-ca4c-4fe0-8061-fcb496fdbc67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:42:00.597820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:00.597820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:00.597820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:00.597820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:00.597820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:00.597820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:00.597820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:00.597820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:00.597820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:00.597820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:00.597820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:00.597820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:42:00.597820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:42:00.597820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:42:00.597820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:42:00.598832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:42:00.598832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:42:00.598832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:42:00.598832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:42:00.598832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:00.598832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:00.598832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:00.598832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:00.598832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:00.598832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:00.598832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:00.598832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:00.598832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:00.598832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:00.598832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:00.598832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:00.599663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:00.599663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:00.599663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:00.599663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:00.599663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:42:00.599663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:42:00.599663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:42:00.599663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:42:00.599663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:42:00.599663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:42:00.599663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:42:00.599663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:00.600310 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 369/722] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:42:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:00.602047 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fce0e-4b0c-4272-baa4-742cf4f51686 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:00.602340 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fce0e-4b0c-4272-baa4-742cf4f51686 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:00.602622 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fce0e-4b0c-4272-baa4-742cf4f51686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:00.610630 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1c328-6a1f-49f1-933a-5507a156aba2 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:00.618377 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:00.624592 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-683fce0e-4b0c-4272-baa4-742cf4f51686 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:00.626458 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-683fce0e-4b0c-4272-baa4-742cf4f51686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:00.654282 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab45f6-759a-4590-9536-1cadd5008674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:00.655386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab45f6-759a-4590-9536-1cadd5008674 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:00.655737 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab45f6-759a-4590-9536-1cadd5008674 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:00.656282 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab45f6-759a-4590-9536-1cadd5008674 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:00.657093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab45f6-759a-4590-9536-1cadd5008674 None admin] RBAC: Adding query filter params (role.id=a6d209169b77456f9f1cc3ff53646cfc, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=bc939818c9224b0ebe2dbaa1eaaec5e5) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:00.657648 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab45f6-759a-4590-9536-1cadd5008674 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:00.659920 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab45f6-759a-4590-9536-1cadd5008674 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:00.668604 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 354/723] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:42:00 2022] GET /identity/v3/role_assignments?user.id=bc939818c9224b0ebe2dbaa1eaaec5e5&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=a6d209169b77456f9f1cc3ff53646cfc => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:00.669453 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab45f6-759a-4590-9536-1cadd5008674 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:00.721001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:00.772199 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 370/724] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:42:00.792620 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab45f6-759a-4590-9536-1cadd5008674 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:00.811814 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fce0e-4b0c-4272-baa4-742cf4f51686 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:00.832837 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7b86a-a064-47b9-8af6-b90abe6199f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:00.833744 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7b86a-a064-47b9-8af6-b90abe6199f7 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:00.834707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7b86a-a064-47b9-8af6-b90abe6199f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:00.835190 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7b86a-a064-47b9-8af6-b90abe6199f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:00.836525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b7b86a-a064-47b9-8af6-b90abe6199f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:00.837011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b7b86a-a064-47b9-8af6-b90abe6199f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:00.838720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b7b86a-a064-47b9-8af6-b90abe6199f7 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:00.849477 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 355/725] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 3 12:42:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:00.854870 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7b86a-a064-47b9-8af6-b90abe6199f7 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:00.890427 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:00.984662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7b86a-a064-47b9-8af6-b90abe6199f7 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:01.004312 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fce0e-4b0c-4272-baa4-742cf4f51686 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:01.025349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93498eb5-5fa7-4219-ae35-9b8cea66ef05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:01.026001 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93498eb5-5fa7-4219-ae35-9b8cea66ef05 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:01.026285 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93498eb5-5fa7-4219-ae35-9b8cea66ef05 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:01.026564 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93498eb5-5fa7-4219-ae35-9b8cea66ef05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:01.040043 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93498eb5-5fa7-4219-ae35-9b8cea66ef05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:01.041509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93498eb5-5fa7-4219-ae35-9b8cea66ef05 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:01.064240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-93498eb5-5fa7-4219-ae35-9b8cea66ef05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:01.064240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:01.064240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:01.064240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:01.064240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:01.064240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:01.064240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:01.064240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:01.064240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:01.064240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:01.064240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:01.064240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:01.064240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:01.064240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:01.064240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:01.065275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:01.065275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:01.065275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:01.065275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:01.065275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:01.065275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:01.065275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:01.065275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:01.065275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:01.065275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:01.065275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:01.065275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:01.065275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:01.065275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:01.065275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:01.065275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:01.065275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:01.066163 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:01.066163 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:01.066163 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:01.066163 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:01.066396 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 356/726] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:01.075702 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93498eb5-5fa7-4219-ae35-9b8cea66ef05 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:01.083040 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8550ed0-bdae-4337-9f2d-599033db717a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:01.083674 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8550ed0-bdae-4337-9f2d-599033db717a None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:01.083955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8550ed0-bdae-4337-9f2d-599033db717a None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:01.084229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8550ed0-bdae-4337-9f2d-599033db717a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:01.105286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8550ed0-bdae-4337-9f2d-599033db717a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:42:01.110859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-e8550ed0-bdae-4337-9f2d-599033db717a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:42:01.110859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:01.110859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:01.110859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:01.110859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:01.110859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:01.110859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:01.110859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:01.110859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:01.110859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:01.110859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:01.110859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:01.110859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:42:01.110859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:42:01.110859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:42:01.110859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:42:01.111802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:42:01.111802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:42:01.111802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:42:01.111802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:42:01.111802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:01.111802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:01.111802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:01.111802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:01.111802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:01.111802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:01.111802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:01.111802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:01.111802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:01.111802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:01.111802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:01.111802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:01.112636 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:01.112636 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:01.112636 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:01.112636 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:01.112636 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:42:01.112636 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:42:01.112636 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:42:01.112636 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:42:01.112636 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:42:01.112636 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:42:01.112636 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:42:01.112636 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:01.116737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 371/727] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:42:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:01.123038 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8550ed0-bdae-4337-9f2d-599033db717a None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:01.214472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:01.227036 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:01.261851 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93498eb5-5fa7-4219-ae35-9b8cea66ef05 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:01.305249 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8550ed0-bdae-4337-9f2d-599033db717a None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:01.327521 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d11147-5f5d-4cc9-90c2-d18592729ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:01.328139 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d11147-5f5d-4cc9-90c2-d18592729ecf None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:01.328414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d11147-5f5d-4cc9-90c2-d18592729ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:01.328691 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d11147-5f5d-4cc9-90c2-d18592729ecf None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:01.329406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d11147-5f5d-4cc9-90c2-d18592729ecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:01.329706 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d11147-5f5d-4cc9-90c2-d18592729ecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:01.338316 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d11147-5f5d-4cc9-90c2-d18592729ecf None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:01.343764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 357/728] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:01.351714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d11147-5f5d-4cc9-90c2-d18592729ecf None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:01.360377 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2400c8-d482-4071-b379-df786380e9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:01.361259 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2400c8-d482-4071-b379-df786380e9db None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:01.361717 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2400c8-d482-4071-b379-df786380e9db None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:01.362181 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2400c8-d482-4071-b379-df786380e9db None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:01.363124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2400c8-d482-4071-b379-df786380e9db None admin] RBAC: Adding query filter params (name=admin) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:01.363648 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2400c8-d482-4071-b379-df786380e9db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:01.365817 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2400c8-d482-4071-b379-df786380e9db None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:01.374899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 372/729] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:42:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:01.383632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2400c8-d482-4071-b379-df786380e9db None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:01.510553 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d11147-5f5d-4cc9-90c2-d18592729ecf None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:01.585673 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45064ac-4293-44b5-82bd-3aa893b5a3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:01.586251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45064ac-4293-44b5-82bd-3aa893b5a3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:01.586536 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45064ac-4293-44b5-82bd-3aa893b5a3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:01.586834 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45064ac-4293-44b5-82bd-3aa893b5a3c8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:01.592918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2400c8-d482-4071-b379-df786380e9db None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:01.606018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45064ac-4293-44b5-82bd-3aa893b5a3c8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:01.607521 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45064ac-4293-44b5-82bd-3aa893b5a3c8 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:01.619065 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:01.623837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:01.631859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-c45064ac-4293-44b5-82bd-3aa893b5a3c8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:42:01.631859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:01.631859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:01.631859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:01.631859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:01.631859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:01.631859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:01.631859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:01.631859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:01.631859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:01.631859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:01.631859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:01.631859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:42:01.631859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:42:01.631859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:42:01.631859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:42:01.639188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:01.639188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:01.639188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:42:01.639188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:01.639188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:42:01.639188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:01.639188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:01.639188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:01.639188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:01.639188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:01.639188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:01.639188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:01.639188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:01.639188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:01.639188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:01.639188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:01.639188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:01.639188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:01.640147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:01.640147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:01.640147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:42:01.640147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:42:01.640147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:42:01.640147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:42:01.640147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:42:01.640147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:42:01.640147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:42:01.640147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:01.640147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 358/730] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 3 12:42:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:01.640147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45064ac-4293-44b5-82bd-3aa893b5a3c8 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:01.667229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab0c97-c61c-4055-b666-ffc08d383585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:01.667880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab0c97-c61c-4055-b666-ffc08d383585 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:01.668159 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab0c97-c61c-4055-b666-ffc08d383585 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:01.668435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab0c97-c61c-4055-b666-ffc08d383585 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:01.688508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab0c97-c61c-4055-b666-ffc08d383585 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:01.690334 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab0c97-c61c-4055-b666-ffc08d383585 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:01.718050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-65ab0c97-c61c-4055-b666-ffc08d383585 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:01.718050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:01.718050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:01.718050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:01.718050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:01.718050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:01.718050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:01.718050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:01.718050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:01.718050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:01.718050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:01.718050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:01.718050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:01.718050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:01.718050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:01.719049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:01.719049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:01.719049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:01.719049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:01.719049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:01.719049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:01.719049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:01.719049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:01.719049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:01.719049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:01.719049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:01.719049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:01.719049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:01.719049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:01.719049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:01.719049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:01.719049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:01.719943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:01.719943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:01.719943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:01.719943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:01.721204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 373/731] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:01.728575 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab0c97-c61c-4055-b666-ffc08d383585 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:01.804766 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45064ac-4293-44b5-82bd-3aa893b5a3c8 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:01.845648 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab0c97-c61c-4055-b666-ffc08d383585 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:01.849759 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9fcae-ecdd-4383-ab90-3427b63ef1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:01.850388 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9fcae-ecdd-4383-ab90-3427b63ef1f3 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:01.850674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9fcae-ecdd-4383-ab90-3427b63ef1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:01.850989 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9fcae-ecdd-4383-ab90-3427b63ef1f3 None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:01.851789 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9fcae-ecdd-4383-ab90-3427b63ef1f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:01.852103 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9fcae-ecdd-4383-ab90-3427b63ef1f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:01.854035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9fcae-ecdd-4383-ab90-3427b63ef1f3 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:01.878028 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 359/732] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 3 12:42:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:01.879298 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf4688-d169-4905-8eb3-c89c1b449fc9 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:01.880125 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf4688-d169-4905-8eb3-c89c1b449fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:01.880407 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf4688-d169-4905-8eb3-c89c1b449fc9 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:01.885689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 360/733] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:01.886564 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf4688-d169-4905-8eb3-c89c1b449fc9 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:01.887323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86d982-77df-4087-8c11-ad78190bec21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:01.887960 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86d982-77df-4087-8c11-ad78190bec21 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:01.888300 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86d982-77df-4087-8c11-ad78190bec21 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:01.888590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86d982-77df-4087-8c11-ad78190bec21 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:01.889424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86d982-77df-4087-8c11-ad78190bec21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:01.889736 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86d982-77df-4087-8c11-ad78190bec21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:01.891619 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86d982-77df-4087-8c11-ad78190bec21 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:01.911467 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 374/734] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:01.912776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78750a9b-7d79-4c5f-85a6-93b11f47a7bf None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:01.913069 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78750a9b-7d79-4c5f-85a6-93b11f47a7bf None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:01.913357 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78750a9b-7d79-4c5f-85a6-93b11f47a7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:01.932913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-78750a9b-7d79-4c5f-85a6-93b11f47a7bf None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:01.934133 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-78750a9b-7d79-4c5f-85a6-93b11f47a7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:01.953530 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:01.956745 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:02.000932 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf4688-d169-4905-8eb3-c89c1b449fc9 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:02.005456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 375/735] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:42:02.006405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78750a9b-7d79-4c5f-85a6-93b11f47a7bf None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:02.041351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf16af9-2f59-4425-9dc7-d3538c879f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:02.042238 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf16af9-2f59-4425-9dc7-d3538c879f34 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:02.042842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf16af9-2f59-4425-9dc7-d3538c879f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:02.043768 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf16af9-2f59-4425-9dc7-d3538c879f34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:02.121914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf16af9-2f59-4425-9dc7-d3538c879f34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:02.124447 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf16af9-2f59-4425-9dc7-d3538c879f34 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:02.133274 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78750a9b-7d79-4c5f-85a6-93b11f47a7bf None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:02.181897 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dec2b-5e15-49d8-9caa-b75d1b12b29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:02.182963 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dec2b-5e15-49d8-9caa-b75d1b12b29e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:02.183477 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dec2b-5e15-49d8-9caa-b75d1b12b29e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:02.183953 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dec2b-5e15-49d8-9caa-b75d1b12b29e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:02.192786 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2dec2b-5e15-49d8-9caa-b75d1b12b29e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:02.194468 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2dec2b-5e15-49d8-9caa-b75d1b12b29e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:02.196321 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:02.206955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-7f2dec2b-5e15-49d8-9caa-b75d1b12b29e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:42:02.206955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:02.206955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:02.206955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:02.206955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:02.206955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:02.206955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:02.206955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:02.206955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:02.206955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:02.206955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:02.206955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:02.206955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:42:02.206955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:42:02.206955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:42:02.206955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:42:02.213449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:02.213449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:02.213449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:42:02.213449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:02.213449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:42:02.213449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:02.213449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:02.213449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:02.213449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:02.213449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:02.213449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:02.213449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:02.213449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:02.213449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:02.213449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:02.213449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:02.213449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:02.213449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:02.214390 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:02.214390 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:02.214390 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:42:02.214390 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:42:02.214390 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:42:02.214390 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:42:02.214390 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:42:02.214390 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:42:02.214390 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:42:02.214390 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:02.214390 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 376/736] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:42:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:02.214390 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dec2b-5e15-49d8-9caa-b75d1b12b29e None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:02.229380 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:02.247620 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 361/737] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:42:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:42:02.248858 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf16af9-2f59-4425-9dc7-d3538c879f34 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:02.337705 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dec2b-5e15-49d8-9caa-b75d1b12b29e None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:02.356849 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf16af9-2f59-4425-9dc7-d3538c879f34 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:02.380216 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1daaa1f-06eb-45d4-a066-5adeef8ccdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:02.381331 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daaa1f-06eb-45d4-a066-5adeef8ccdb4 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:02.381621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daaa1f-06eb-45d4-a066-5adeef8ccdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:02.381899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daaa1f-06eb-45d4-a066-5adeef8ccdb4 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:02.382599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1daaa1f-06eb-45d4-a066-5adeef8ccdb4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:02.384477 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1daaa1f-06eb-45d4-a066-5adeef8ccdb4 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:02.397364 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cba1b-c27e-4067-aab1-1bc2dbe64059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:02.400331 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cba1b-c27e-4067-aab1-1bc2dbe64059 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:02.400331 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cba1b-c27e-4067-aab1-1bc2dbe64059 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:02.400331 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cba1b-c27e-4067-aab1-1bc2dbe64059 None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:02.400331 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5cba1b-c27e-4067-aab1-1bc2dbe64059 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:02.400331 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5cba1b-c27e-4067-aab1-1bc2dbe64059 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:02.401246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5cba1b-c27e-4067-aab1-1bc2dbe64059 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:02.419328 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 362/738] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 3 12:42:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:02.420054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cba1b-c27e-4067-aab1-1bc2dbe64059 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:02.443983 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:02.489975 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 377/739] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 3 12:42:02 2022] POST /identity/v3/services => generated 251 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:42:02.491103 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1daaa1f-06eb-45d4-a066-5adeef8ccdb4 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:02.544450 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cba1b-c27e-4067-aab1-1bc2dbe64059 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:02.595292 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83f157-7df3-4cef-850a-d5c7907eb87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:02.596267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83f157-7df3-4cef-850a-d5c7907eb87d None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:02.596859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83f157-7df3-4cef-850a-d5c7907eb87d None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:02.597317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83f157-7df3-4cef-850a-d5c7907eb87d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:02.610206 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83f157-7df3-4cef-850a-d5c7907eb87d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:02.612069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83f157-7df3-4cef-850a-d5c7907eb87d None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:02.621070 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:02.642546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-fe83f157-7df3-4cef-850a-d5c7907eb87d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:02.642546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:02.642546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:02.642546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:02.642546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:02.642546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:02.642546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:02.642546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:02.642546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:02.642546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:02.642546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:02.642546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:02.642546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:02.642546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:02.642546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:02.645348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:02.645348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:02.645348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:02.645348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:02.645348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:02.645348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:02.645348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:02.645348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:02.645348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:02.645348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:02.645348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:02.645348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:02.645348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:02.645348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:02.645348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:02.645348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:02.645348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:02.646437 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:02.646437 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:02.646437 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:02.646437 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:02.650683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 363/740] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:02.652304 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea6cb3-e298-4182-a68b-062f95c53e0f None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:02.652922 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea6cb3-e298-4182-a68b-062f95c53e0f None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:02.653345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea6cb3-e298-4182-a68b-062f95c53e0f None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:02.653824 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1daaa1f-06eb-45d4-a066-5adeef8ccdb4 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:02.659663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 364/741] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:02.661343 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea6cb3-e298-4182-a68b-062f95c53e0f None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:02.710010 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e537a-4662-434c-af0d-d197b0e4f3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:02.710637 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e537a-4662-434c-af0d-d197b0e4f3eb None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:02.710990 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e537a-4662-434c-af0d-d197b0e4f3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:02.711270 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e537a-4662-434c-af0d-d197b0e4f3eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:02.749677 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:02.792301 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea6cb3-e298-4182-a68b-062f95c53e0f None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:02.804800 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e537a-4662-434c-af0d-d197b0e4f3eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:02.806566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e537a-4662-434c-af0d-d197b0e4f3eb None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:02.829217 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5a15f-aa8c-4779-b9d7-cbd51d58f984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:02.829574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5a15f-aa8c-4779-b9d7-cbd51d58f984 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:02.829820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5a15f-aa8c-4779-b9d7-cbd51d58f984 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:02.830095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5a15f-aa8c-4779-b9d7-cbd51d58f984 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:02.830817 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5a15f-aa8c-4779-b9d7-cbd51d58f984 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:02.831132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5a15f-aa8c-4779-b9d7-cbd51d58f984 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:02.832665 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5a15f-aa8c-4779-b9d7-cbd51d58f984 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:02.845668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 365/742] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:02.850365 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7f6c1-ae36-442e-a2c8-fc8ba7f5b813 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:02.850365 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7f6c1-ae36-442e-a2c8-fc8ba7f5b813 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:02.850365 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7f6c1-ae36-442e-a2c8-fc8ba7f5b813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:02.867588 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-92a7f6c1-ae36-442e-a2c8-fc8ba7f5b813 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:02.868802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-92a7f6c1-ae36-442e-a2c8-fc8ba7f5b813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:02.893571 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:02.926861 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 378/743] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:42:02 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:42:02.928127 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e537a-4662-434c-af0d-d197b0e4f3eb None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:02.942219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 366/744] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:42:02.951851 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7f6c1-ae36-442e-a2c8-fc8ba7f5b813 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:03.028689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:03.038800 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e537a-4662-434c-af0d-d197b0e4f3eb None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:03.076364 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be6ecf-9579-40f7-871d-3f4a956410c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:03.077016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be6ecf-9579-40f7-871d-3f4a956410c0 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:03.077294 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be6ecf-9579-40f7-871d-3f4a956410c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:03.077574 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be6ecf-9579-40f7-871d-3f4a956410c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:03.085263 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7f6c1-ae36-442e-a2c8-fc8ba7f5b813 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:03.085396 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be6ecf-9579-40f7-871d-3f4a956410c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:03.086718 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be6ecf-9579-40f7-871d-3f4a956410c0 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:03.099639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-a9be6ecf-9579-40f7-871d-3f4a956410c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:03.099639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:03.099639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:03.099639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:03.099639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:03.099639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:03.099639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:03.099639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:03.099639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:03.099639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:03.099639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:03.099639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:03.099639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:42:03.099639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:42:03.099639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:42:03.100549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:42:03.100549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:03.100549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:03.100549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:03.100549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:03.100549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:03.100549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:03.100549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:03.100549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:03.100549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:03.100549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:03.100549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:03.100549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:03.100549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:03.100549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:03.100549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:03.100549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:03.101420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:42:03.101420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:42:03.101420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:42:03.101420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:42:03.101420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:42:03.101420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:42:03.101420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:03.101420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:03.101420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 379/745] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:42:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:03.101894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be6ecf-9579-40f7-871d-3f4a956410c0 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:03.126947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a45a4-f5a0-4347-8f07-e3aa1b428f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:03.127598 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a45a4-f5a0-4347-8f07-e3aa1b428f9d None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:03.127882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a45a4-f5a0-4347-8f07-e3aa1b428f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:03.128160 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a45a4-f5a0-4347-8f07-e3aa1b428f9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:03.138007 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:03.138601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a45a4-f5a0-4347-8f07-e3aa1b428f9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:03.143405 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a45a4-f5a0-4347-8f07-e3aa1b428f9d None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:03.162392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-1b7a45a4-f5a0-4347-8f07-e3aa1b428f9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:03.162392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:03.162392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:03.162392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:03.162392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:03.162392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:03.162392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:03.162392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:03.162392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:03.162392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:03.162392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:03.162392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:03.162392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:03.162392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:03.162392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:03.163562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:03.163562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:03.163562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:03.163562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:03.163562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:03.163562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:03.163562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:03.163562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:03.163562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:03.163562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:03.163562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:03.163562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:03.163562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:03.163562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:03.163562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:03.163562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:03.163562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:03.169648 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:03.169648 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:03.169648 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:03.169648 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:03.169648 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 367/746] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:03.169648 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee7620-ed35-45eb-9b7f-87afe0abc18a None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:03.169648 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee7620-ed35-45eb-9b7f-87afe0abc18a None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:03.169648 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee7620-ed35-45eb-9b7f-87afe0abc18a None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:03.169648 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 368/747] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:03.170166 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee7620-ed35-45eb-9b7f-87afe0abc18a None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:03.217311 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be6ecf-9579-40f7-871d-3f4a956410c0 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:03.252361 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ec94b-012f-4bbd-82d4-d66784755da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:03.252984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ec94b-012f-4bbd-82d4-d66784755da4 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:03.253269 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ec94b-012f-4bbd-82d4-d66784755da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:03.253547 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ec94b-012f-4bbd-82d4-d66784755da4 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:03.254254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ec94b-012f-4bbd-82d4-d66784755da4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:03.255703 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ec94b-012f-4bbd-82d4-d66784755da4 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:03.275687 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee7620-ed35-45eb-9b7f-87afe0abc18a None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:03.282702 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:03.309433 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b90fdb-2b0b-40fa-bedd-34d120409869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:03.310050 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b90fdb-2b0b-40fa-bedd-34d120409869 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:03.310338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b90fdb-2b0b-40fa-bedd-34d120409869 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:03.310617 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b90fdb-2b0b-40fa-bedd-34d120409869 None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:03.311505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b90fdb-2b0b-40fa-bedd-34d120409869 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:03.315406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b90fdb-2b0b-40fa-bedd-34d120409869 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:03.315406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b90fdb-2b0b-40fa-bedd-34d120409869 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:03.325476 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 369/748] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:42:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:03.326269 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b90fdb-2b0b-40fa-bedd-34d120409869 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:03.340790 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 380/749] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 3 12:42:03 2022] POST /identity/v3/services => generated 240 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:42:03.342022 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274c2c1-ef55-40ec-ab6a-8d2429e2b775 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:03.342306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274c2c1-ef55-40ec-ab6a-8d2429e2b775 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:03.342587 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274c2c1-ef55-40ec-ab6a-8d2429e2b775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:03.364062 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-3274c2c1-ef55-40ec-ab6a-8d2429e2b775 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:03.365303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-3274c2c1-ef55-40ec-ab6a-8d2429e2b775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:03.463121 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 381/750] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:03.464174 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274c2c1-ef55-40ec-ab6a-8d2429e2b775 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:03.470210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b90fdb-2b0b-40fa-bedd-34d120409869 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:03.503970 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:03.515905 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303084a9-034c-436e-aa79-42c35dc87463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:03.516790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303084a9-034c-436e-aa79-42c35dc87463 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:03.517270 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303084a9-034c-436e-aa79-42c35dc87463 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:03.517894 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303084a9-034c-436e-aa79-42c35dc87463 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:03.519570 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303084a9-034c-436e-aa79-42c35dc87463 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:03.520594 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303084a9-034c-436e-aa79-42c35dc87463 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:03.522143 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303084a9-034c-436e-aa79-42c35dc87463 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:03.540760 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 370/751] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:03.541430 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303084a9-034c-436e-aa79-42c35dc87463 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:03.583126 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:03.599603 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274c2c1-ef55-40ec-ab6a-8d2429e2b775 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:03.636183 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f122701-1345-42f7-8fa2-4f2e9f97c716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:03.636811 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f122701-1345-42f7-8fa2-4f2e9f97c716 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:03.637156 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f122701-1345-42f7-8fa2-4f2e9f97c716 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:03.637439 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f122701-1345-42f7-8fa2-4f2e9f97c716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:03.638299 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f122701-1345-42f7-8fa2-4f2e9f97c716 None admin] RBAC: Adding query filter params (role.id=72fab3a91c004428b7e615dac55116cd, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=b9d70abf4f754530a3cf6efa7a782736) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:03.638619 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f122701-1345-42f7-8fa2-4f2e9f97c716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:03.640079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f122701-1345-42f7-8fa2-4f2e9f97c716 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:03.646348 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 382/752] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:42:03 2022] GET /identity/v3/role_assignments?user.id=b9d70abf4f754530a3cf6efa7a782736&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=72fab3a91c004428b7e615dac55116cd => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:03.647168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f122701-1345-42f7-8fa2-4f2e9f97c716 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:03.686395 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303084a9-034c-436e-aa79-42c35dc87463 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:03.726717 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5b07a-d369-4d57-957b-af219deefd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:03.727428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5b07a-d369-4d57-957b-af219deefd39 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:03.727713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5b07a-d369-4d57-957b-af219deefd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:03.727993 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5b07a-d369-4d57-957b-af219deefd39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:03.741207 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade5b07a-d369-4d57-957b-af219deefd39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:42:03.746439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-ade5b07a-d369-4d57-957b-af219deefd39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:42:03.746439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:03.746439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:03.746439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:03.746439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:03.746439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:03.746439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:03.746439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:03.746439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:03.746439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:03.746439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:03.746439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:03.746439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:42:03.746439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:42:03.746439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:42:03.746439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:42:03.747532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:42:03.747532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:42:03.747532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:42:03.747532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:42:03.747532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:03.747532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:03.747532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:03.747532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:03.747532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:03.747532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:03.747532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:03.747532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:03.747532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:03.747532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:03.747532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:03.747532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:03.748390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:03.748390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:03.748390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:03.748390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:03.748390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:42:03.748390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:42:03.748390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:42:03.748390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:42:03.748390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:42:03.748390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:42:03.748390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:42:03.748390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:03.748390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 371/753] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:42:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:03.754055 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5b07a-d369-4d57-957b-af219deefd39 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:03.775928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:03.800318 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f122701-1345-42f7-8fa2-4f2e9f97c716 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:03.851865 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743488f-a460-479c-9b6e-1c0435a89857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:03.853156 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743488f-a460-479c-9b6e-1c0435a89857 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:03.854115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743488f-a460-479c-9b6e-1c0435a89857 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:03.854995 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743488f-a460-479c-9b6e-1c0435a89857 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:03.858093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:03.867098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743488f-a460-479c-9b6e-1c0435a89857 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:03.869576 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743488f-a460-479c-9b6e-1c0435a89857 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:03.875286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5b07a-d369-4d57-957b-af219deefd39 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:03.885045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-1743488f-a460-479c-9b6e-1c0435a89857 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:03.885045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:03.885045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:03.885045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:03.885045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:03.885045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:03.885045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:03.885045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:03.885045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:03.885045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:03.885045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:03.885045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:03.885045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:42:03.885045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:42:03.885045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:42:03.885989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:42:03.885989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:03.885989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:03.885989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:03.885989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:03.885989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:03.885989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:03.885989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:03.885989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:03.885989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:03.885989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:03.885989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:03.885989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:03.885989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:03.885989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:03.885989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:03.885989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:03.886919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:42:03.886919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:42:03.886919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:42:03.886919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:42:03.886919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:42:03.886919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:42:03.886919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:03.886919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:03.895156 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 383/754] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:42:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:03.895156 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743488f-a460-479c-9b6e-1c0435a89857 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:03.940173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce62822-888a-4764-9b83-89517993539b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:03.940807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce62822-888a-4764-9b83-89517993539b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:03.941089 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce62822-888a-4764-9b83-89517993539b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:03.941368 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce62822-888a-4764-9b83-89517993539b None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:03.942650 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce62822-888a-4764-9b83-89517993539b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:03.943011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce62822-888a-4764-9b83-89517993539b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:03.944419 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce62822-888a-4764-9b83-89517993539b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:03.956197 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 372/755] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:42:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:03.961890 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce62822-888a-4764-9b83-89517993539b None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:04.112886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743488f-a460-479c-9b6e-1c0435a89857 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:04.114910 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce62822-888a-4764-9b83-89517993539b None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:04.168708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb15bd-d651-473d-b2db-a4c9406b9000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:04.169337 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb15bd-d651-473d-b2db-a4c9406b9000 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:04.169621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb15bd-d651-473d-b2db-a4c9406b9000 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:04.169898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb15bd-d651-473d-b2db-a4c9406b9000 None admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:04.170662 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb15bd-d651-473d-b2db-a4c9406b9000 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:04.170998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb15bd-d651-473d-b2db-a4c9406b9000 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:04.172426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb15bd-d651-473d-b2db-a4c9406b9000 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:04.192226 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee7305-9df7-4c2c-a63e-9b3350a1a03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:04.192883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee7305-9df7-4c2c-a63e-9b3350a1a03a None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:04.193169 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee7305-9df7-4c2c-a63e-9b3350a1a03a None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:04.193446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee7305-9df7-4c2c-a63e-9b3350a1a03a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:04.199935 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 384/756] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:42:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:04.205550 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb15bd-d651-473d-b2db-a4c9406b9000 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:04.209304 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:04.220985 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee7305-9df7-4c2c-a63e-9b3350a1a03a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:04.222464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee7305-9df7-4c2c-a63e-9b3350a1a03a None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:04.237076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:04.246330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-35ee7305-9df7-4c2c-a63e-9b3350a1a03a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:04.246330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:04.246330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:04.246330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:04.246330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:04.246330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:04.246330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:04.246330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:04.246330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:04.246330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:04.246330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:04.246330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:04.246330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:04.246330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:04.246330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:04.247383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:04.247383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:04.247383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:04.247383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:04.247383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:04.247383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:04.247383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:04.247383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:04.247383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:04.247383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:04.247383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:04.247383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:04.247383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:04.247383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:04.247383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:04.247383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:04.247383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:04.248674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:04.248674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:04.248674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:04.248674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:04.248674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 373/757] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:04.253338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee7305-9df7-4c2c-a63e-9b3350a1a03a None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:04.392139 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb15bd-d651-473d-b2db-a4c9406b9000 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:04.444027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee7305-9df7-4c2c-a63e-9b3350a1a03a None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:04.467447 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77fc46-eeb8-465c-b678-9a4cd407ca68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:04.468082 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77fc46-eeb8-465c-b678-9a4cd407ca68 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:04.468366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77fc46-eeb8-465c-b678-9a4cd407ca68 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:04.468646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77fc46-eeb8-465c-b678-9a4cd407ca68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:04.469447 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77fc46-eeb8-465c-b678-9a4cd407ca68 None admin] RBAC: Adding query filter params (role.id=a6d209169b77456f9f1cc3ff53646cfc, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=5209ec838a4f45d6b746edb27970c93d) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:04.469789 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77fc46-eeb8-465c-b678-9a4cd407ca68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:04.471384 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77fc46-eeb8-465c-b678-9a4cd407ca68 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:04.484022 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 385/758] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:42:04 2022] GET /identity/v3/role_assignments?user.id=5209ec838a4f45d6b746edb27970c93d&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=a6d209169b77456f9f1cc3ff53646cfc => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:04.498588 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f9ae3-3c40-4d81-bf20-6a9c74432aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:04.499285 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f9ae3-3c40-4d81-bf20-6a9c74432aac None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:04.499532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f9ae3-3c40-4d81-bf20-6a9c74432aac None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:04.499810 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f9ae3-3c40-4d81-bf20-6a9c74432aac None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:04.500534 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f9ae3-3c40-4d81-bf20-6a9c74432aac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:04.500844 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f9ae3-3c40-4d81-bf20-6a9c74432aac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:04.502254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f9ae3-3c40-4d81-bf20-6a9c74432aac None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:04.525462 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 374/759] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:04.531031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77fc46-eeb8-465c-b678-9a4cd407ca68 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:04.667870 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:04.703181 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77fc46-eeb8-465c-b678-9a4cd407ca68 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:04.746334 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b267b-3c60-4632-9054-c582d35341c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:04.747020 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b267b-3c60-4632-9054-c582d35341c9 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:04.747309 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b267b-3c60-4632-9054-c582d35341c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:04.747592 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b267b-3c60-4632-9054-c582d35341c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:04.755921 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b267b-3c60-4632-9054-c582d35341c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:04.757366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b267b-3c60-4632-9054-c582d35341c9 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:04.776239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-3e2b267b-3c60-4632-9054-c582d35341c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:42:04.776239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:04.776239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:04.776239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:04.776239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:04.776239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:04.776239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:04.776239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:04.776239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:04.776239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:04.776239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:04.776239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:04.776239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:42:04.776239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:42:04.776239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:42:04.776239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:42:04.777235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:04.777235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:04.777235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:42:04.777235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:04.777235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:42:04.777235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:04.777235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:04.777235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:04.777235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:04.777235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:04.777235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:04.777235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:04.777235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:04.777235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:04.777235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:04.777235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:04.777235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:04.777235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:04.778147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:04.778147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:04.778147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:42:04.778147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:42:04.778147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:42:04.778147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:42:04.778147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:42:04.778147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:42:04.778147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:42:04.778147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:04.778147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 386/760] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 3 12:42:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:04.786345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f9ae3-3c40-4d81-bf20-6a9c74432aac None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:04.870105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d5978-29c5-4862-98ac-139e803db4c8 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:04.870426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d5978-29c5-4862-98ac-139e803db4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:04.870676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d5978-29c5-4862-98ac-139e803db4c8 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:04.872298 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 387/761] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:42:04.877075 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea9a89-23bf-492e-a3a6-a9922aa8e339 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:04.877374 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea9a89-23bf-492e-a3a6-a9922aa8e339 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:04.877655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea9a89-23bf-492e-a3a6-a9922aa8e339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:04.897027 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-43ea9a89-23bf-492e-a3a6-a9922aa8e339 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:04.898228 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-43ea9a89-23bf-492e-a3a6-a9922aa8e339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:04.911261 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:05.015526 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f9ae3-3c40-4d81-bf20-6a9c74432aac None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:05.033161 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 388/762] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:05.067257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea9a89-23bf-492e-a3a6-a9922aa8e339 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:05.107136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c531bf-e716-4ddb-8d5c-71c6678aa119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:05.108217 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c531bf-e716-4ddb-8d5c-71c6678aa119 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:05.108724 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c531bf-e716-4ddb-8d5c-71c6678aa119 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:05.109224 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c531bf-e716-4ddb-8d5c-71c6678aa119 None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:05.110789 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c531bf-e716-4ddb-8d5c-71c6678aa119 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:05.111358 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c531bf-e716-4ddb-8d5c-71c6678aa119 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:05.114148 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c531bf-e716-4ddb-8d5c-71c6678aa119 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:05.128466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:05.163002 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 375/763] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 3 12:42:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:05.164119 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c531bf-e716-4ddb-8d5c-71c6678aa119 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:05.220444 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea9a89-23bf-492e-a3a6-a9922aa8e339 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:05.300174 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b7481-6626-48f7-9687-723e0df157b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:05.300767 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b7481-6626-48f7-9687-723e0df157b6 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:05.301055 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b7481-6626-48f7-9687-723e0df157b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:05.301894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b7481-6626-48f7-9687-723e0df157b6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:05.302554 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b7481-6626-48f7-9687-723e0df157b6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:05.303963 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b7481-6626-48f7-9687-723e0df157b6 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:05.321915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-486b7481-6626-48f7-9687-723e0df157b6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:42:05.321915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:05.321915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:42:05.321915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:42:05.321915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:42:05.321915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:42:05.321915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:42:05.321915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:05.321915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:42:05.321915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:05.321915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:05.321915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:05.321915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:05.321915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:05.321915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:05.321915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:05.322884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:05.322884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:05.322884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:05.322884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:05.322884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:05.322884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:05.322884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:05.322884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:42:05.322884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:42:05.322884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:42:05.322884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:42:05.322884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:05.322884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:05.322884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:05.322884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:05.322884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:05.323708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:05.323708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:05.323708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:05.323708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:05.323708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:05.323708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:05.323708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:05.323708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:05.323708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:05.323708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:05.323708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:05.323708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:42:05.323708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:05.323708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:42:05.323708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:05.324480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 389/764] 10.222.0.64 () {56 vars in 1129 bytes} [Wed Aug 3 12:42:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:05.331572 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b7481-6626-48f7-9687-723e0df157b6 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:05.362914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c531bf-e716-4ddb-8d5c-71c6678aa119 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:05.403202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:05.461340 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bc6bc-2ade-4207-bb7f-64bcb4412f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:05.462437 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bc6bc-2ade-4207-bb7f-64bcb4412f9c None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:05.462981 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bc6bc-2ade-4207-bb7f-64bcb4412f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:05.463489 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bc6bc-2ade-4207-bb7f-64bcb4412f9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:05.466822 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b7481-6626-48f7-9687-723e0df157b6 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:05.491242 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:05.504179 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bc6bc-2ade-4207-bb7f-64bcb4412f9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:05.506217 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bc6bc-2ade-4207-bb7f-64bcb4412f9c None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:05.507835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be277f-bacd-4690-a748-c924801a7b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:05.508457 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be277f-bacd-4690-a748-c924801a7b35 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:05.508740 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be277f-bacd-4690-a748-c924801a7b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:05.509016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be277f-bacd-4690-a748-c924801a7b35 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:05.509707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be277f-bacd-4690-a748-c924801a7b35 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:05.510015 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be277f-bacd-4690-a748-c924801a7b35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:05.511398 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be277f-bacd-4690-a748-c924801a7b35 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:05.523750 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 390/765] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 3 12:42:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:05.538477 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be277f-bacd-4690-a748-c924801a7b35 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:05.538708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-120bc6bc-2ade-4207-bb7f-64bcb4412f9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:05.538708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:05.538708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:05.538708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:05.538708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:05.538708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:05.538708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:05.538708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:05.538708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:05.538708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:05.538708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:05.538708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:05.538708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:05.538708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:05.538708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:05.540953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:05.540953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:05.540953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:05.540953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:05.540953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:05.540953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:05.540953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:05.540953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:05.540953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:05.540953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:05.540953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:05.540953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:05.540953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:05.540953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:05.540953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:05.540953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:05.540953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:05.543082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:05.543082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:05.543082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:05.543082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:05.543082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 376/766] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:05.549642 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bc6bc-2ade-4207-bb7f-64bcb4412f9c None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:05.735367 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be277f-bacd-4690-a748-c924801a7b35 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:05.759272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bc6bc-2ade-4207-bb7f-64bcb4412f9c None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:05.795331 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beb4bb-5b82-4597-a806-3424901d99c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:05.796283 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb4bb-5b82-4597-a806-3424901d99c3 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:05.796769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb4bb-5b82-4597-a806-3424901d99c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:05.797253 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb4bb-5b82-4597-a806-3424901d99c3 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:05.798132 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6beb4bb-5b82-4597-a806-3424901d99c3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:05.798630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6beb4bb-5b82-4597-a806-3424901d99c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:05.800190 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6beb4bb-5b82-4597-a806-3424901d99c3 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:05.806782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 391/767] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 3 12:42:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:05.816408 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beb4bb-5b82-4597-a806-3424901d99c3 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:05.857290 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b12c25-3fe1-48e9-b0a8-461010aa6555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:05.858348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b12c25-3fe1-48e9-b0a8-461010aa6555 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:05.858882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b12c25-3fe1-48e9-b0a8-461010aa6555 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:05.859361 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b12c25-3fe1-48e9-b0a8-461010aa6555 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:05.860667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b12c25-3fe1-48e9-b0a8-461010aa6555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:05.861230 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b12c25-3fe1-48e9-b0a8-461010aa6555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:05.863807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b12c25-3fe1-48e9-b0a8-461010aa6555 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:05.909204 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 377/768] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:05.917094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b12c25-3fe1-48e9-b0a8-461010aa6555 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:05.995195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:06.009104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:06.113498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beb4bb-5b82-4597-a806-3424901d99c3 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:06.162035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b12c25-3fe1-48e9-b0a8-461010aa6555 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:06.177172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a961374-6096-4555-a1d0-d044621d5e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:06.178061 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a961374-6096-4555-a1d0-d044621d5e41 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:06.178355 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a961374-6096-4555-a1d0-d044621d5e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:06.178631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a961374-6096-4555-a1d0-d044621d5e41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:06.179678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a961374-6096-4555-a1d0-d044621d5e41 None admin] RBAC: Adding query filter params (interface=public, service_id=a396bf8a62594b64b29bf9b5417a621b, region_id=RegionOne) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:06.179994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a961374-6096-4555-a1d0-d044621d5e41 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:06.182154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a961374-6096-4555-a1d0-d044621d5e41 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:06.191131 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 392/769] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 3 12:42:05 2022] GET /identity/v3/endpoints?service_id=a396bf8a62594b64b29bf9b5417a621b&interface=public®ion_id=RegionOne => generated 194 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:06.197074 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a961374-6096-4555-a1d0-d044621d5e41 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:06.222532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f1a4a-7476-4089-af1b-b0587542e3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:06.223680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f1a4a-7476-4089-af1b-b0587542e3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:06.224195 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f1a4a-7476-4089-af1b-b0587542e3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:06.224693 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f1a4a-7476-4089-af1b-b0587542e3a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:06.239864 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f1a4a-7476-4089-af1b-b0587542e3a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:06.241619 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f1a4a-7476-4089-af1b-b0587542e3a3 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:06.257937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-974f1a4a-7476-4089-af1b-b0587542e3a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:06.257937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:06.257937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:06.257937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:06.257937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:06.257937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:06.257937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:06.257937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:06.257937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:06.257937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:06.257937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:06.257937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:06.257937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:42:06.257937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:42:06.257937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:42:06.258850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:42:06.258850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:06.258850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:06.258850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:06.258850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:06.258850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:06.258850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:06.258850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:06.258850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:06.258850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:06.258850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:06.258850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:06.258850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:06.258850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:06.258850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:06.258850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:06.258850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:06.259761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:42:06.259761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:42:06.259761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:42:06.259761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:42:06.259761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:42:06.259761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:42:06.259761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:06.259761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:06.262113 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 378/770] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:42:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:06.268134 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c535f-1978-462a-b743-8b0154adfb75 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:06.268691 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c535f-1978-462a-b743-8b0154adfb75 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:06.269172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c535f-1978-462a-b743-8b0154adfb75 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:06.271412 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 379/771] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:06.272320 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c535f-1978-462a-b743-8b0154adfb75 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:06.320767 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a961374-6096-4555-a1d0-d044621d5e41 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:06.335037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:06.355749 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4597e4d-5040-4a40-801c-a3c52f4da8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:06.356367 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4597e4d-5040-4a40-801c-a3c52f4da8ac None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:06.356648 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4597e4d-5040-4a40-801c-a3c52f4da8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:06.356921 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4597e4d-5040-4a40-801c-a3c52f4da8ac None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:06.357847 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4597e4d-5040-4a40-801c-a3c52f4da8ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:06.359147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4597e4d-5040-4a40-801c-a3c52f4da8ac None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:06.370858 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 393/772] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 3 12:42:06 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:06.372442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c063788-81cc-408c-8d65-6ddefd27962b None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:06.372736 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c063788-81cc-408c-8d65-6ddefd27962b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:06.373015 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c063788-81cc-408c-8d65-6ddefd27962b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:06.377061 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:06.390313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c535f-1978-462a-b743-8b0154adfb75 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:06.408077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-0c063788-81cc-408c-8d65-6ddefd27962b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:06.409371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-0c063788-81cc-408c-8d65-6ddefd27962b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:06.435709 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b60a62-a659-4b48-8aba-495093b42025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:06.437085 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b60a62-a659-4b48-8aba-495093b42025 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:06.437687 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b60a62-a659-4b48-8aba-495093b42025 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:06.438180 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b60a62-a659-4b48-8aba-495093b42025 None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:06.439262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b60a62-a659-4b48-8aba-495093b42025 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:06.440098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b60a62-a659-4b48-8aba-495093b42025 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:06.441925 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b60a62-a659-4b48-8aba-495093b42025 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:06.469994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 380/773] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:42:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:06.470202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679fa6a-407b-4f11-afc1-da29d9687ded None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:06.470437 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679fa6a-407b-4f11-afc1-da29d9687ded None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:06.470623 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679fa6a-407b-4f11-afc1-da29d9687ded None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:06.473959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 381/774] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:06.475109 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679fa6a-407b-4f11-afc1-da29d9687ded None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:06.536160 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 394/775] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:06.538082 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c8b14-6387-41a9-921a-17d0c1422a3a None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:06.538594 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c8b14-6387-41a9-921a-17d0c1422a3a None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:06.539223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c8b14-6387-41a9-921a-17d0c1422a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:06.560327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-0b0c8b14-6387-41a9-921a-17d0c1422a3a None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:06.561979 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-0b0c8b14-6387-41a9-921a-17d0c1422a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:06.592840 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679fa6a-407b-4f11-afc1-da29d9687ded None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:06.635863 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7ba63-5707-4167-b94f-ba2c738ade5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:06.636603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7ba63-5707-4167-b94f-ba2c738ade5f None admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:06.636889 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7ba63-5707-4167-b94f-ba2c738ade5f None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:06.637195 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7ba63-5707-4167-b94f-ba2c738ade5f None admin] PATH_INFO: `/v3/projects/020d395e82f0448f95789a896703ce98/users/bc939818c9224b0ebe2dbaa1eaaec5e5/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:06.639187 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7ba63-5707-4167-b94f-ba2c738ade5f None admin] RBAC: Authorizing `identity:create_grant(project_id=020d395e82f0448f95789a896703ce98, user_id=bc939818c9224b0ebe2dbaa1eaaec5e5, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:06.640671 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 395/776] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:06.641442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c8b14-6387-41a9-921a-17d0c1422a3a None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:06.642866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7ba63-5707-4167-b94f-ba2c738ade5f None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:06.687287 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:06.718929 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 382/777] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:42:06 2022] PUT /identity/v3/projects/020d395e82f0448f95789a896703ce98/users/bc939818c9224b0ebe2dbaa1eaaec5e5/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:42:06.720200 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7ba63-5707-4167-b94f-ba2c738ade5f None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:06.747124 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:06.754359 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c8b14-6387-41a9-921a-17d0c1422a3a None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:06.794426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a4e15-a77c-4b72-b0a6-734a960647fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:06.795039 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a4e15-a77c-4b72-b0a6-734a960647fc None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:06.795320 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a4e15-a77c-4b72-b0a6-734a960647fc None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:06.795638 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a4e15-a77c-4b72-b0a6-734a960647fc None admin] PATH_INFO: `/v3/services/network` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:06.796288 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a4e15-a77c-4b72-b0a6-734a960647fc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:06.797687 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a4e15-a77c-4b72-b0a6-734a960647fc None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:06.807689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-7b2a4e15-a77c-4b72-b0a6-734a960647fc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:42:06.807689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:06.807689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:42:06.807689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:42:06.807689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:42:06.807689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:42:06.807689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:42:06.807689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:06.807689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:42:06.807689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:06.807689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:06.807689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:06.807689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:06.807689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:06.807689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:06.807689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:06.807689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:06.808743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:06.808743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:06.808743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:06.808743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:06.808743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:06.808743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:06.808743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:42:06.808743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:42:06.808743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:42:06.808743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:42:06.808743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:06.808743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:06.808743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:06.808743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:06.808743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:06.808743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:06.809560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:06.809560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:06.809560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:06.809560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:06.809560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:06.809560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:06.809560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:06.809560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:06.809560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:06.809560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:06.809560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:42:06.809560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:06.809560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:42:06.809560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:06.809560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 396/778] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:42:06 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:06.817304 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a4e15-a77c-4b72-b0a6-734a960647fc None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:06.903659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7ba63-5707-4167-b94f-ba2c738ade5f None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:06.954892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2a6b9-fe30-48c0-ac63-62b356262e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:06.955548 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2a6b9-fe30-48c0-ac63-62b356262e31 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:06.955837 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2a6b9-fe30-48c0-ac63-62b356262e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:06.956128 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2a6b9-fe30-48c0-ac63-62b356262e31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:06.968524 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2a6b9-fe30-48c0-ac63-62b356262e31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:42:06.974210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-4bf2a6b9-fe30-48c0-ac63-62b356262e31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:42:06.974210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:06.974210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:06.974210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:06.974210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:06.974210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:06.974210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:06.974210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:06.974210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:06.974210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:06.974210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:06.974210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:06.974210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:42:06.974210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:42:06.974210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:42:06.974210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:42:06.975193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:42:06.975193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:42:06.975193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:42:06.975193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:42:06.975193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:06.975193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:06.975193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:06.975193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:06.975193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:06.975193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:06.975193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:06.975193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:06.975193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:06.975193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:06.975193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:06.975193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:06.976121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:06.976121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:06.976121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:06.976121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:06.976121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:42:06.976121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:42:06.976121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:42:06.976121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:42:06.976121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:42:06.976121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:42:06.976121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:42:06.976121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:06.976121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 383/779] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:42:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:06.976822 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add259e-59ac-430e-8a8a-f11126c99171 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:06.977596 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add259e-59ac-430e-8a8a-f11126c99171 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:06.977596 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add259e-59ac-430e-8a8a-f11126c99171 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:06.978690 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 384/780] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:06.983622 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add259e-59ac-430e-8a8a-f11126c99171 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:07.009393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a4e15-a77c-4b72-b0a6-734a960647fc None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:07.020354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:07.057950 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7b1c0-fe81-4d82-853f-d895b6732496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:07.058519 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7b1c0-fe81-4d82-853f-d895b6732496 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:07.058842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7b1c0-fe81-4d82-853f-d895b6732496 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:07.059135 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7b1c0-fe81-4d82-853f-d895b6732496 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:07.060129 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7b1c0-fe81-4d82-853f-d895b6732496 None admin] RBAC: Adding query filter params (name=network) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:07.060447 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7b1c0-fe81-4d82-853f-d895b6732496 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:07.061238 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:07.063530 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7b1c0-fe81-4d82-853f-d895b6732496 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:07.072027 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 397/781] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 3 12:42:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:07.077799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978c5b6-a2c3-4541-8962-acc0520f76d6 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:07.078428 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978c5b6-a2c3-4541-8962-acc0520f76d6 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:07.078915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978c5b6-a2c3-4541-8962-acc0520f76d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:07.101786 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add259e-59ac-430e-8a8a-f11126c99171 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:07.103622 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-1978c5b6-a2c3-4541-8962-acc0520f76d6 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:07.109425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-1978c5b6-a2c3-4541-8962-acc0520f76d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:07.149014 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870cfc44-4a6d-4b06-91a0-1e0e30c09308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:07.149918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cfc44-4a6d-4b06-91a0-1e0e30c09308 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:07.150212 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cfc44-4a6d-4b06-91a0-1e0e30c09308 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:07.150492 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cfc44-4a6d-4b06-91a0-1e0e30c09308 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:07.154376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870cfc44-4a6d-4b06-91a0-1e0e30c09308 None admin] RBAC: Adding query filter params (name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:07.154702 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870cfc44-4a6d-4b06-91a0-1e0e30c09308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:07.156182 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870cfc44-4a6d-4b06-91a0-1e0e30c09308 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:07.177701 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 385/782] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 3 12:42:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:07.177701 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870cfc44-4a6d-4b06-91a0-1e0e30c09308 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:07.205324 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 398/783] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:07.206529 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978c5b6-a2c3-4541-8962-acc0520f76d6 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:07.302551 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870cfc44-4a6d-4b06-91a0-1e0e30c09308 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:07.337494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:07.343526 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:07.344129 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978c5b6-a2c3-4541-8962-acc0520f76d6 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:07.349768 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d57ffe-c556-4508-aedc-d409cba0ef8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:07.354152 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d57ffe-c556-4508-aedc-d409cba0ef8a None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:07.354152 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d57ffe-c556-4508-aedc-d409cba0ef8a None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:07.354152 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d57ffe-c556-4508-aedc-d409cba0ef8a None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:07.354152 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d57ffe-c556-4508-aedc-d409cba0ef8a None admin] RBAC: Adding query filter params (type=network) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:07.354152 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d57ffe-c556-4508-aedc-d409cba0ef8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:07.354152 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d57ffe-c556-4508-aedc-d409cba0ef8a None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:07.364931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 386/784] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 3 12:42:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:07.364931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d57ffe-c556-4508-aedc-d409cba0ef8a None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:07.386515 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e92046-15ab-40d8-af62-85a1a4b9337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:07.387536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e92046-15ab-40d8-af62-85a1a4b9337c None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:07.387982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e92046-15ab-40d8-af62-85a1a4b9337c None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:07.393012 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e92046-15ab-40d8-af62-85a1a4b9337c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:07.403199 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e92046-15ab-40d8-af62-85a1a4b9337c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:07.405794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e92046-15ab-40d8-af62-85a1a4b9337c None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:07.423974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-90e92046-15ab-40d8-af62-85a1a4b9337c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:07.423974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:07.423974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:07.423974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:07.423974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:07.423974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:07.423974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:07.423974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:07.423974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:07.423974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:07.423974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:07.423974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:07.423974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:07.423974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:07.423974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:07.424871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:07.424871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:07.424871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:07.424871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:07.424871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:07.424871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:07.424871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:07.424871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:07.424871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:07.424871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:07.424871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:07.424871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:07.424871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:07.424871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:07.424871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:07.424871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:07.424871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:07.425742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:07.425742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:07.425742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:07.425742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:07.433040 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 399/785] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:07.433040 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e92046-15ab-40d8-af62-85a1a4b9337c None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:07.480848 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d57ffe-c556-4508-aedc-d409cba0ef8a None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:07.519551 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc18594-c076-4bde-b958-a0db1d8260af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:07.520613 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc18594-c076-4bde-b958-a0db1d8260af None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:07.521092 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc18594-c076-4bde-b958-a0db1d8260af None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:07.521563 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc18594-c076-4bde-b958-a0db1d8260af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:07.532660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc18594-c076-4bde-b958-a0db1d8260af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:42:07.538313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-7cc18594-c076-4bde-b958-a0db1d8260af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:42:07.538313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:07.538313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:07.538313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:07.538313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:07.538313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:07.538313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:07.538313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:07.538313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:07.538313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:07.538313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:07.538313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:07.538313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:42:07.538313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:42:07.538313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:42:07.538313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:42:07.539283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:42:07.539283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:42:07.539283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:42:07.539283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:42:07.539283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:07.539283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:07.539283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:07.539283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:07.539283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:07.539283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:07.539283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:07.539283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:07.539283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:07.539283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:07.539283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:07.539283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:07.540380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:07.540380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:07.540380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:07.540380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:07.540380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:42:07.540380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:42:07.540380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:42:07.540380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:42:07.540380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:42:07.540380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:42:07.540380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:42:07.540380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:07.540998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e92046-15ab-40d8-af62-85a1a4b9337c None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:07.543141 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 387/786] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:42:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:07.544250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc18594-c076-4bde-b958-a0db1d8260af None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:07.584632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746eace-e441-4a0e-98a0-4e21b306e029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:07.585273 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746eace-e441-4a0e-98a0-4e21b306e029 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:07.585563 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746eace-e441-4a0e-98a0-4e21b306e029 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:07.585820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746eace-e441-4a0e-98a0-4e21b306e029 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:07.586570 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746eace-e441-4a0e-98a0-4e21b306e029 None admin] RBAC: Adding query filter params (interface=public, service_id=895c6de3bbc74b128d645cc37a75fd1a, region_id=RegionOne) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:07.586917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746eace-e441-4a0e-98a0-4e21b306e029 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:07.588347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746eace-e441-4a0e-98a0-4e21b306e029 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:07.597992 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 400/787] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 3 12:42:07 2022] GET /identity/v3/endpoints?service_id=895c6de3bbc74b128d645cc37a75fd1a&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:07.597992 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746eace-e441-4a0e-98a0-4e21b306e029 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:07.609699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:07.625518 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:07.674996 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc18594-c076-4bde-b958-a0db1d8260af None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:07.699439 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746eace-e441-4a0e-98a0-4e21b306e029 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:07.713422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146a799-51ec-4e12-8a71-526f469ee047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:07.714383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146a799-51ec-4e12-8a71-526f469ee047 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:07.715006 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146a799-51ec-4e12-8a71-526f469ee047 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:07.715497 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146a799-51ec-4e12-8a71-526f469ee047 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:07.716460 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146a799-51ec-4e12-8a71-526f469ee047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:07.716961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146a799-51ec-4e12-8a71-526f469ee047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:07.718639 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146a799-51ec-4e12-8a71-526f469ee047 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:07.736464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 388/788] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:07.736901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96688b6-dcec-43e8-adda-4bf748deff7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:07.737519 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96688b6-dcec-43e8-adda-4bf748deff7d None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:07.737807 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96688b6-dcec-43e8-adda-4bf748deff7d None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:07.738085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96688b6-dcec-43e8-adda-4bf748deff7d None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:07.739052 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146a799-51ec-4e12-8a71-526f469ee047 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:07.739376 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96688b6-dcec-43e8-adda-4bf748deff7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:07.739683 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96688b6-dcec-43e8-adda-4bf748deff7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:07.741162 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96688b6-dcec-43e8-adda-4bf748deff7d None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:07.754960 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 401/789] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:42:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:07.755823 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96688b6-dcec-43e8-adda-4bf748deff7d None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:07.835016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:07.850540 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146a799-51ec-4e12-8a71-526f469ee047 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:07.861321 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96688b6-dcec-43e8-adda-4bf748deff7d None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:07.867517 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:07.887516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b134a-9b3a-433d-948c-a921e899f7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:07.888444 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b134a-9b3a-433d-948c-a921e899f7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:07.893929 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b134a-9b3a-433d-948c-a921e899f7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:07.893929 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b134a-9b3a-433d-948c-a921e899f7f0 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:07.893929 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b134a-9b3a-433d-948c-a921e899f7f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:07.893929 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b134a-9b3a-433d-948c-a921e899f7f0 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:07.902974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb336f-017a-44db-92f9-2c520c735f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:07.902974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb336f-017a-44db-92f9-2c520c735f2c None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:07.902974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb336f-017a-44db-92f9-2c520c735f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:07.902974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb336f-017a-44db-92f9-2c520c735f2c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:07.903598 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 389/790] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 3 12:42:07 2022] GET /identity/v3/services => generated 772 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:07.904749 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b134a-9b3a-433d-948c-a921e899f7f0 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:07.907444 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb336f-017a-44db-92f9-2c520c735f2c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:07.908992 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb336f-017a-44db-92f9-2c520c735f2c None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:07.926794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-0bcb336f-017a-44db-92f9-2c520c735f2c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:42:07.926794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:07.926794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:07.926794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:07.926794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:07.926794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:07.926794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:07.926794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:07.926794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:07.926794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:07.926794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:07.926794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:07.926794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:42:07.926794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:42:07.926794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:42:07.926794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:42:07.927799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:07.927799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:07.927799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:42:07.927799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:07.927799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:42:07.927799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:07.927799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:07.927799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:07.927799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:07.927799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:07.927799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:07.927799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:07.927799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:07.927799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:07.927799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:07.927799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:07.927799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:07.927799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:07.928751 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:07.928751 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:07.928751 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:42:07.928751 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:42:07.928751 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:42:07.928751 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:42:07.928751 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:42:07.928751 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:42:07.928751 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:42:07.928751 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:07.931469 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 402/791] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 3 12:42:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:07.942389 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb336f-017a-44db-92f9-2c520c735f2c None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:08.037232 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b134a-9b3a-433d-948c-a921e899f7f0 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:08.078209 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3aaa9-c2ac-457d-90e8-d5f1dd5d56c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:08.079377 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3aaa9-c2ac-457d-90e8-d5f1dd5d56c1 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:08.079377 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3aaa9-c2ac-457d-90e8-d5f1dd5d56c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:08.079586 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3aaa9-c2ac-457d-90e8-d5f1dd5d56c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:08.091994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3aaa9-c2ac-457d-90e8-d5f1dd5d56c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:08.094005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3aaa9-c2ac-457d-90e8-d5f1dd5d56c1 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:08.111098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-84d3aaa9-c2ac-457d-90e8-d5f1dd5d56c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:08.111098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:08.111098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:08.111098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:08.111098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:08.111098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:08.111098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:08.111098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:08.111098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:08.111098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:08.111098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:08.111098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:08.111098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:08.111098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:08.111098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:08.112041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:08.112041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:08.112041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:08.112041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:08.112041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:08.112041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:08.112041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:08.112041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:08.112041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:08.112041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:08.112041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:08.112041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:08.112041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:08.112041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:08.112041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:08.112041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:08.112041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:08.112973 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:08.112973 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:08.112973 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:08.112973 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:08.112973 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 390/792] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:08.119966 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3aaa9-c2ac-457d-90e8-d5f1dd5d56c1 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:08.161299 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb336f-017a-44db-92f9-2c520c735f2c None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:08.178142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:08.202705 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed08b2-6422-44b5-b4c7-70d9c9ff4cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:08.203369 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed08b2-6422-44b5-b4c7-70d9c9ff4cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:08.203647 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed08b2-6422-44b5-b4c7-70d9c9ff4cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:08.203919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed08b2-6422-44b5-b4c7-70d9c9ff4cf9 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:08.204718 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed08b2-6422-44b5-b4c7-70d9c9ff4cf9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:08.205024 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed08b2-6422-44b5-b4c7-70d9c9ff4cf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:08.206448 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed08b2-6422-44b5-b4c7-70d9c9ff4cf9 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:08.208931 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:08.230078 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 403/793] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 3 12:42:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:08.235538 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed08b2-6422-44b5-b4c7-70d9c9ff4cf9 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:08.251220 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3aaa9-c2ac-457d-90e8-d5f1dd5d56c1 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:08.301385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb5b66-8eb0-4941-9775-6a285267a76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:08.302007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb5b66-8eb0-4941-9775-6a285267a76e None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:08.302287 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb5b66-8eb0-4941-9775-6a285267a76e None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:08.302560 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb5b66-8eb0-4941-9775-6a285267a76e None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:08.303280 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb5b66-8eb0-4941-9775-6a285267a76e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:08.303586 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb5b66-8eb0-4941-9775-6a285267a76e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:08.306550 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb5b66-8eb0-4941-9775-6a285267a76e None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:08.330160 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 391/794] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:08.336350 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb5b66-8eb0-4941-9775-6a285267a76e None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:08.400672 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed08b2-6422-44b5-b4c7-70d9c9ff4cf9 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:08.454285 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:08.464856 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb5b66-8eb0-4941-9775-6a285267a76e None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:08.475182 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabaee55-81e9-4d1d-80e5-cb77a6300b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:08.476113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabaee55-81e9-4d1d-80e5-cb77a6300b51 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:08.476249 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabaee55-81e9-4d1d-80e5-cb77a6300b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:08.476476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabaee55-81e9-4d1d-80e5-cb77a6300b51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:08.500809 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabaee55-81e9-4d1d-80e5-cb77a6300b51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:08.502287 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabaee55-81e9-4d1d-80e5-cb77a6300b51 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:08.503615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59168129-fef9-4637-b065-6b724b681f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:08.505463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59168129-fef9-4637-b065-6b724b681f14 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:08.505952 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59168129-fef9-4637-b065-6b724b681f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:08.506420 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59168129-fef9-4637-b065-6b724b681f14 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:08.515215 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59168129-fef9-4637-b065-6b724b681f14 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:08.517004 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59168129-fef9-4637-b065-6b724b681f14 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:08.531088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-59168129-fef9-4637-b065-6b724b681f14 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:42:08.531088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:08.531088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:08.531088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:08.531088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:08.531088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:08.531088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:08.531088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:08.531088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:08.531088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:08.531088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:08.531088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:08.531088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:42:08.531088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:42:08.531088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:42:08.531088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:42:08.532053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:08.532053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:08.532053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:42:08.532053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:08.532053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:42:08.532053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:08.532053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:08.532053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:08.532053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:08.532053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:08.532053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:08.532053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:08.532053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:08.532053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:08.532053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:08.532053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:08.532053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:08.532053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:08.533003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:08.533003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:08.533003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:42:08.533003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:42:08.533003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:42:08.533003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:42:08.533003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:42:08.533003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:42:08.533003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:42:08.533003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:08.533520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-cabaee55-81e9-4d1d-80e5-cb77a6300b51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:08.533520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:08.533520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:08.533520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:08.533520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:08.533520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:08.533520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:08.533520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:08.533520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:08.533520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:08.533520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:08.533520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:08.533520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:08.533520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:08.533520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:08.534282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:08.534282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:08.534282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:08.534282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:08.534282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:08.534282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:08.534282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:08.534282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:08.534282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:08.534282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:08.534282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:08.534282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:08.534282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:08.534282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:08.534282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:08.534282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:08.534282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:08.535188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:08.535188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:08.535188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:08.535188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:08.538314 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 392/795] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:42:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:08.543656 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 404/796] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:08.543796 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59168129-fef9-4637-b065-6b724b681f14 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:08.544297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabaee55-81e9-4d1d-80e5-cb77a6300b51 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:08.621528 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:08.683163 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59168129-fef9-4637-b065-6b724b681f14 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:08.688737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabaee55-81e9-4d1d-80e5-cb77a6300b51 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:08.728540 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b9f49-2aee-4061-bef2-f6bb26dc25ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:08.729303 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b9f49-2aee-4061-bef2-f6bb26dc25ed None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:08.729515 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e54fa-3d31-4ce1-889f-2b89389d9d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:08.729794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b9f49-2aee-4061-bef2-f6bb26dc25ed None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:08.730142 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e54fa-3d31-4ce1-889f-2b89389d9d84 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:08.730252 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b9f49-2aee-4061-bef2-f6bb26dc25ed None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:08.730429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e54fa-3d31-4ce1-889f-2b89389d9d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:08.730712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e54fa-3d31-4ce1-889f-2b89389d9d84 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:08.731264 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b9f49-2aee-4061-bef2-f6bb26dc25ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:08.731536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e54fa-3d31-4ce1-889f-2b89389d9d84 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:08.731744 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b9f49-2aee-4061-bef2-f6bb26dc25ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:08.731848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e54fa-3d31-4ce1-889f-2b89389d9d84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:08.733260 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e54fa-3d31-4ce1-889f-2b89389d9d84 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:08.733391 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b9f49-2aee-4061-bef2-f6bb26dc25ed None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:08.745724 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 393/797] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:08.747327 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7318d-bb09-42ef-b05a-69180dc2a3db None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:08.747708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7318d-bb09-42ef-b05a-69180dc2a3db None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:08.748080 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7318d-bb09-42ef-b05a-69180dc2a3db None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:08.749612 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 394/798] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:08.751564 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7318d-bb09-42ef-b05a-69180dc2a3db None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:08.761458 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 405/799] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 3 12:42:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:08.763016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e54fa-3d31-4ce1-889f-2b89389d9d84 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:08.769176 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:08.861621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7318d-bb09-42ef-b05a-69180dc2a3db None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:08.868673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e54fa-3d31-4ce1-889f-2b89389d9d84 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:08.870207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:08.899064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358fc2f-9924-40f0-baae-cb1577d74018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:08.899707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358fc2f-9924-40f0-baae-cb1577d74018 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:08.899988 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358fc2f-9924-40f0-baae-cb1577d74018 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:08.900264 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358fc2f-9924-40f0-baae-cb1577d74018 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:08.906195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c0010-c879-4cf2-92a9-86da6ab424b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:08.907052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c0010-c879-4cf2-92a9-86da6ab424b3 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:08.907303 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358fc2f-9924-40f0-baae-cb1577d74018 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:08.907634 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c0010-c879-4cf2-92a9-86da6ab424b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:08.908128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c0010-c879-4cf2-92a9-86da6ab424b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:08.908744 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358fc2f-9924-40f0-baae-cb1577d74018 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:08.919869 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c0010-c879-4cf2-92a9-86da6ab424b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:08.920992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-6358fc2f-9924-40f0-baae-cb1577d74018 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:08.920992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:08.920992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:08.920992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:08.920992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:08.920992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:08.920992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:08.920992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:08.920992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:08.920992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:08.920992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:08.920992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:08.920992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:42:08.920992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:42:08.920992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:42:08.922074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:42:08.922074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:08.922074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:08.922074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:08.922074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:08.922074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:08.922074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:08.922074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:08.922074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:08.922074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:08.922074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:08.922074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:08.922074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:08.922074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:08.922074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:08.922074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:08.922074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:08.923211 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:42:08.923211 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:42:08.923211 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:42:08.923211 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:42:08.923211 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:42:08.923211 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:42:08.923211 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:08.923211 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:08.923211 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 395/800] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:42:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:08.923869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cf32d-ae22-41ad-b973-0450cc0ee7ff None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:08.924038 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cf32d-ae22-41ad-b973-0450cc0ee7ff None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:08.924314 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cf32d-ae22-41ad-b973-0450cc0ee7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:08.925092 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c0010-c879-4cf2-92a9-86da6ab424b3 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:08.943604 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-9d1cf32d-ae22-41ad-b973-0450cc0ee7ff None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:08.944096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-f87c0010-c879-4cf2-92a9-86da6ab424b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:08.944096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:08.944096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:08.944096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:08.944096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:08.944096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:08.944096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:08.944096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:08.944096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:08.944096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:08.944096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:08.944096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:08.944096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:08.944096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:08.944096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:08.944948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:08.944948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:08.944948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:08.944948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:08.944948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:08.944948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:08.944948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:08.944948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:08.944948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:08.944948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:08.944948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:08.944948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:08.944948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:08.944948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:08.944948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:08.944948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:08.944948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:08.946131 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:08.946131 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:08.946131 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:08.946131 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:08.946387 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-9d1cf32d-ae22-41ad-b973-0450cc0ee7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:08.951776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 406/801] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:08.951776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c0010-c879-4cf2-92a9-86da6ab424b3 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:09.018230 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 396/802] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:09.019992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6fbae-8547-4856-af50-1b0060aad033 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:09.020488 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6fbae-8547-4856-af50-1b0060aad033 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:09.020966 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6fbae-8547-4856-af50-1b0060aad033 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:09.022402 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 397/803] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:09.023371 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6fbae-8547-4856-af50-1b0060aad033 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:09.028762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:09.068800 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c0010-c879-4cf2-92a9-86da6ab424b3 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:09.104106 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f28a53-5f8c-4af8-9fb3-4f9ba4c01b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:09.104717 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f28a53-5f8c-4af8-9fb3-4f9ba4c01b2f None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:09.104991 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f28a53-5f8c-4af8-9fb3-4f9ba4c01b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:09.105532 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f28a53-5f8c-4af8-9fb3-4f9ba4c01b2f None admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:09.106007 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f28a53-5f8c-4af8-9fb3-4f9ba4c01b2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:09.106317 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f28a53-5f8c-4af8-9fb3-4f9ba4c01b2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:09.107767 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f28a53-5f8c-4af8-9fb3-4f9ba4c01b2f None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:09.125699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 407/804] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:42:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:09.125699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c5424-281c-4bdb-a6c7-4c53465792cb None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:09.125699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c5424-281c-4bdb-a6c7-4c53465792cb None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:09.125699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c5424-281c-4bdb-a6c7-4c53465792cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:09.138192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6fbae-8547-4856-af50-1b0060aad033 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:09.141558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-844c5424-281c-4bdb-a6c7-4c53465792cb None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:09.142776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-844c5424-281c-4bdb-a6c7-4c53465792cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:09.159831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:09.179348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3d59f-b192-42cf-9a44-d83d1ee1ee29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:09.179973 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3d59f-b192-42cf-9a44-d83d1ee1ee29 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:09.180259 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3d59f-b192-42cf-9a44-d83d1ee1ee29 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:09.180545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3d59f-b192-42cf-9a44-d83d1ee1ee29 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:09.181247 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3d59f-b192-42cf-9a44-d83d1ee1ee29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:09.181585 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3d59f-b192-42cf-9a44-d83d1ee1ee29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:09.183000 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3d59f-b192-42cf-9a44-d83d1ee1ee29 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:09.200294 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 398/805] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:09.200294 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3d59f-b192-42cf-9a44-d83d1ee1ee29 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:09.226069 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 408/806] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:09.226711 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c5424-281c-4bdb-a6c7-4c53465792cb None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:09.277167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:09.318099 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3d59f-b192-42cf-9a44-d83d1ee1ee29 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:09.333828 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c5424-281c-4bdb-a6c7-4c53465792cb None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:09.360116 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbebcc9-14eb-4f58-aa50-1631bf828e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:09.360757 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbebcc9-14eb-4f58-aa50-1631bf828e82 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:09.361042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbebcc9-14eb-4f58-aa50-1631bf828e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:09.361309 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbebcc9-14eb-4f58-aa50-1631bf828e82 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:09.361935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbebcc9-14eb-4f58-aa50-1631bf828e82 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:09.363363 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbebcc9-14eb-4f58-aa50-1631bf828e82 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:09.371414 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9299fd9-603e-4f59-ac59-6d207727c11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:09.372090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9299fd9-603e-4f59-ac59-6d207727c11d None admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:09.372380 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9299fd9-603e-4f59-ac59-6d207727c11d None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:09.372661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9299fd9-603e-4f59-ac59-6d207727c11d None admin] PATH_INFO: `/v3/projects/020d395e82f0448f95789a896703ce98/users/b9d70abf4f754530a3cf6efa7a782736/roles/72fab3a91c004428b7e615dac55116cd` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:09.373054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-5cbebcc9-14eb-4f58-aa50-1631bf828e82 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:42:09.373054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:09.373054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:42:09.373054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:42:09.373054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:42:09.373054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:42:09.373054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:42:09.373054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:09.373054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:42:09.373054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:09.373054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:09.373054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:09.373054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:09.373054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:09.373054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:09.373054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:09.373931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:09.373931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:09.373931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:09.373931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:09.373931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:09.373931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:09.373931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:09.373931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:42:09.373931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:42:09.373931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:42:09.373931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:42:09.373931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:09.373931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:09.373931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:09.373931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:09.373931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:09.374795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:09.374795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:09.374795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:09.374795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:09.374795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:09.374795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:09.374795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:09.374795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:09.374795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:09.374795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:09.374795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:09.374795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:42:09.374795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:09.374795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:42:09.374795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:09.374795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 399/807] 10.222.0.64 () {56 vars in 1129 bytes} [Wed Aug 3 12:42:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:09.375655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbebcc9-14eb-4f58-aa50-1631bf828e82 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:09.392299 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9299fd9-603e-4f59-ac59-6d207727c11d None admin] RBAC: Authorizing `identity:create_grant(project_id=020d395e82f0448f95789a896703ce98, user_id=b9d70abf4f754530a3cf6efa7a782736, role_id=72fab3a91c004428b7e615dac55116cd)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:09.393885 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9299fd9-603e-4f59-ac59-6d207727c11d None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:09.396807 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:09.478313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbebcc9-14eb-4f58-aa50-1631bf828e82 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:09.507094 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 409/808] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:42:09 2022] PUT /identity/v3/projects/020d395e82f0448f95789a896703ce98/users/b9d70abf4f754530a3cf6efa7a782736/roles/72fab3a91c004428b7e615dac55116cd => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:42:09.507680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:09.508953 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9299fd9-603e-4f59-ac59-6d207727c11d None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:09.513090 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da6ab0-af6d-4959-8bcf-0aaf1370d728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:09.513933 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da6ab0-af6d-4959-8bcf-0aaf1370d728 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:09.515091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da6ab0-af6d-4959-8bcf-0aaf1370d728 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:09.515091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da6ab0-af6d-4959-8bcf-0aaf1370d728 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:09.523336 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da6ab0-af6d-4959-8bcf-0aaf1370d728 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:09.524809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da6ab0-af6d-4959-8bcf-0aaf1370d728 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:09.538775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-d0da6ab0-af6d-4959-8bcf-0aaf1370d728 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:09.538775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:09.538775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:09.538775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:09.538775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:09.538775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:09.538775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:09.538775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:09.538775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:09.538775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:09.538775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:09.538775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:09.538775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:42:09.538775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:42:09.538775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:42:09.540051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:42:09.540051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:09.540051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:09.540051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:09.540051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:09.540051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:09.540051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:09.540051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:09.540051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:09.540051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:09.540051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:09.540051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:09.540051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:09.540051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:09.540051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:09.540051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:09.540051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:09.541025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:42:09.541025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:42:09.541025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:42:09.541025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:42:09.541025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:42:09.541025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:42:09.541025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:09.541025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:09.544612 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 400/809] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:42:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:09.544612 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da6ab0-af6d-4959-8bcf-0aaf1370d728 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:09.678157 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da6ab0-af6d-4959-8bcf-0aaf1370d728 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:09.691505 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9299fd9-603e-4f59-ac59-6d207727c11d None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:09.721226 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87786b-06ac-4d44-a8ae-497eb8e5bfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:09.722611 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87786b-06ac-4d44-a8ae-497eb8e5bfd9 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:09.723709 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87786b-06ac-4d44-a8ae-497eb8e5bfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:09.724142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87786b-06ac-4d44-a8ae-497eb8e5bfd9 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:09.724845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87786b-06ac-4d44-a8ae-497eb8e5bfd9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:09.725162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87786b-06ac-4d44-a8ae-497eb8e5bfd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:09.726554 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87786b-06ac-4d44-a8ae-497eb8e5bfd9 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:09.731639 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 401/810] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 3 12:42:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:09.734805 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87786b-06ac-4d44-a8ae-497eb8e5bfd9 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:09.737105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07a045-5ac5-4b10-b1bf-ffff5c66cf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:09.737747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07a045-5ac5-4b10-b1bf-ffff5c66cf63 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:09.738029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07a045-5ac5-4b10-b1bf-ffff5c66cf63 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:09.738345 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07a045-5ac5-4b10-b1bf-ffff5c66cf63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:09.749578 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07a045-5ac5-4b10-b1bf-ffff5c66cf63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:42:09.754663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-5e07a045-5ac5-4b10-b1bf-ffff5c66cf63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:42:09.754663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:09.754663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:09.754663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:09.754663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:09.754663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:09.754663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:09.754663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:09.754663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:09.754663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:09.754663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:09.754663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:09.754663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:42:09.754663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:42:09.754663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:42:09.754663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:42:09.755614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:42:09.755614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:42:09.755614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:42:09.755614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:42:09.755614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:09.755614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:09.755614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:09.755614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:09.755614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:09.755614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:09.755614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:09.755614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:09.755614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:09.755614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:09.755614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:09.755614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:09.756442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:09.756442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:09.756442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:09.756442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:09.756442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:42:09.756442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:42:09.756442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:42:09.756442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:42:09.756442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:42:09.756442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:42:09.756442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:42:09.756442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:09.756442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 410/811] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:42:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:09.757153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07a045-5ac5-4b10-b1bf-ffff5c66cf63 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:09.807762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:09.825945 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:09.871120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87786b-06ac-4d44-a8ae-497eb8e5bfd9 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:09.886283 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07a045-5ac5-4b10-b1bf-ffff5c66cf63 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:09.911756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013e626-1721-4afe-802d-2ae470f3c027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:09.912514 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013e626-1721-4afe-802d-2ae470f3c027 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:09.912805 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013e626-1721-4afe-802d-2ae470f3c027 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:09.913083 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013e626-1721-4afe-802d-2ae470f3c027 None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:09.913852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013e626-1721-4afe-802d-2ae470f3c027 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:09.914169 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013e626-1721-4afe-802d-2ae470f3c027 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:09.916083 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013e626-1721-4afe-802d-2ae470f3c027 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:09.929842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 402/812] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:42:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:09.930743 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013e626-1721-4afe-802d-2ae470f3c027 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:09.932483 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca22a66-f357-4b96-be6c-f1a3a3997b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:09.933532 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca22a66-f357-4b96-be6c-f1a3a3997b50 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:09.934021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca22a66-f357-4b96-be6c-f1a3a3997b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:09.935124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca22a66-f357-4b96-be6c-f1a3a3997b50 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:09.935863 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca22a66-f357-4b96-be6c-f1a3a3997b50 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:09.936185 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca22a66-f357-4b96-be6c-f1a3a3997b50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:09.937577 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca22a66-f357-4b96-be6c-f1a3a3997b50 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:09.953407 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 411/813] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Aug 3 12:42:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:09.953407 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca22a66-f357-4b96-be6c-f1a3a3997b50 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:10.055589 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013e626-1721-4afe-802d-2ae470f3c027 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:10.070234 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca22a66-f357-4b96-be6c-f1a3a3997b50 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:10.071269 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:10.089523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:10.105710 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bede7b-0141-4537-a44e-cceb72a6c102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:10.106669 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bede7b-0141-4537-a44e-cceb72a6c102 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:10.107297 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bede7b-0141-4537-a44e-cceb72a6c102 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:10.107407 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63354c37-d541-4cf0-a4ca-c8f49a5bb119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:10.107933 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bede7b-0141-4537-a44e-cceb72a6c102 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:10.108039 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63354c37-d541-4cf0-a4ca-c8f49a5bb119 None admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:10.108320 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63354c37-d541-4cf0-a4ca-c8f49a5bb119 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:10.108609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63354c37-d541-4cf0-a4ca-c8f49a5bb119 None admin] PATH_INFO: `/v3/projects/020d395e82f0448f95789a896703ce98/users/5209ec838a4f45d6b746edb27970c93d/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:10.109267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bede7b-0141-4537-a44e-cceb72a6c102 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:10.109752 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bede7b-0141-4537-a44e-cceb72a6c102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:10.110783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63354c37-d541-4cf0-a4ca-c8f49a5bb119 None admin] RBAC: Authorizing `identity:create_grant(project_id=020d395e82f0448f95789a896703ce98, user_id=5209ec838a4f45d6b746edb27970c93d, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:10.111413 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bede7b-0141-4537-a44e-cceb72a6c102 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:10.112267 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63354c37-d541-4cf0-a4ca-c8f49a5bb119 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:10.123682 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 403/814] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:42:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:10.124549 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bede7b-0141-4537-a44e-cceb72a6c102 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:10.199041 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 412/815] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:42:09 2022] PUT /identity/v3/projects/020d395e82f0448f95789a896703ce98/users/5209ec838a4f45d6b746edb27970c93d/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:42:10.200573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63354c37-d541-4cf0-a4ca-c8f49a5bb119 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:10.254997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bede7b-0141-4537-a44e-cceb72a6c102 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:10.311987 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e6302-0e18-4d7e-ab27-8b2d79c8d3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:10.312632 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e6302-0e18-4d7e-ab27-8b2d79c8d3fe None admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:10.312820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e6302-0e18-4d7e-ab27-8b2d79c8d3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:10.313112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e6302-0e18-4d7e-ab27-8b2d79c8d3fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:10.313839 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e6302-0e18-4d7e-ab27-8b2d79c8d3fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:10.315274 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e6302-0e18-4d7e-ab27-8b2d79c8d3fe None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:10.361056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63354c37-d541-4cf0-a4ca-c8f49a5bb119 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:10.399849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14888b34-7a5e-47a4-9878-ffcd4815eea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:10.400555 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14888b34-7a5e-47a4-9878-ffcd4815eea5 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:10.400865 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14888b34-7a5e-47a4-9878-ffcd4815eea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:10.401186 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14888b34-7a5e-47a4-9878-ffcd4815eea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:10.409329 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 404/816] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:42:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:42:10.410530 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a2959-6ac6-4d22-8043-185610e9cbd4 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:10.410865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a2959-6ac6-4d22-8043-185610e9cbd4 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:10.411149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a2959-6ac6-4d22-8043-185610e9cbd4 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:10.412188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14888b34-7a5e-47a4-9878-ffcd4815eea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:10.412742 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 405/817] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:10.413659 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14888b34-7a5e-47a4-9878-ffcd4815eea5 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:10.418763 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171f18-daea-4772-bf3c-2b0614cd3ea7 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:10.419061 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171f18-daea-4772-bf3c-2b0614cd3ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:10.419339 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171f18-daea-4772-bf3c-2b0614cd3ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:10.431731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-14888b34-7a5e-47a4-9878-ffcd4815eea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:10.431731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:10.431731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:10.431731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:10.431731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:10.431731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:10.431731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:10.431731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:10.431731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:10.431731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:10.431731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:10.431731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:10.431731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:10.431731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:10.431731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:10.432919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:10.432919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:10.432919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:10.432919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:10.432919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:10.432919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:10.432919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:10.432919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:10.432919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:10.432919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:10.432919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:10.432919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:10.432919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:10.432919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:10.432919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:10.432919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:10.432919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:10.433816 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:10.433816 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:10.433816 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:10.433816 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:10.433816 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 413/818] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:10.439124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14888b34-7a5e-47a4-9878-ffcd4815eea5 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:10.442331 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-f9171f18-daea-4772-bf3c-2b0614cd3ea7 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:10.443767 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-f9171f18-daea-4772-bf3c-2b0614cd3ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:10.471648 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:10.477078 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:10.537157 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 406/819] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:10.577434 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14888b34-7a5e-47a4-9878-ffcd4815eea5 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:10.599830 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9171f18-daea-4772-bf3c-2b0614cd3ea7 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:10.625429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadc7a6-2e59-4310-b627-69174e5951cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:10.626058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadc7a6-2e59-4310-b627-69174e5951cd None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:10.626339 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadc7a6-2e59-4310-b627-69174e5951cd None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:10.626613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadc7a6-2e59-4310-b627-69174e5951cd None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:10.628831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadc7a6-2e59-4310-b627-69174e5951cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:10.628831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadc7a6-2e59-4310-b627-69174e5951cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:10.630681 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadc7a6-2e59-4310-b627-69174e5951cd None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:10.647107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 414/820] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:10.652589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadc7a6-2e59-4310-b627-69174e5951cd None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:10.754614 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9171f18-daea-4772-bf3c-2b0614cd3ea7 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:10.766139 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:10.776382 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadc7a6-2e59-4310-b627-69174e5951cd None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:10.802478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f9f6e-635a-4415-bf59-62bc8a104a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:10.803488 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f9f6e-635a-4415-bf59-62bc8a104a81 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:10.803777 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f9f6e-635a-4415-bf59-62bc8a104a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:10.804056 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f9f6e-635a-4415-bf59-62bc8a104a81 None admin] PATH_INFO: `/v3/services/network` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:10.804720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f9f6e-635a-4415-bf59-62bc8a104a81 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:10.808276 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f9f6e-635a-4415-bf59-62bc8a104a81 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:10.816949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c894d20-2f30-430c-a3cc-badec99593bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:10.817888 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c894d20-2f30-430c-a3cc-badec99593bf None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:10.818347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-a86f9f6e-635a-4415-bf59-62bc8a104a81 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:42:10.818347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:10.818347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:42:10.818347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:42:10.818347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:42:10.818347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:42:10.818347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:42:10.818347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:10.818347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:42:10.818347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:10.818347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:10.818347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:10.818347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:10.818347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:10.818347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:10.818347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:10.818347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:10.819422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:10.819422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:10.819422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:10.819422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:10.819422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:10.819422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:10.819422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:42:10.819422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:42:10.819422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:42:10.819422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:42:10.819422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:10.819422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:10.819422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:10.819422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:10.819422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:10.819422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:10.820266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:10.820266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:10.820266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:10.820266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:10.820266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:10.820266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:10.820266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:10.820266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:10.820266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:10.820266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:10.820266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:42:10.820266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:10.820266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:42:10.820266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:10.820266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 407/821] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:42:10 2022] GET /identity/v3/services/network => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:10.821601 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c894d20-2f30-430c-a3cc-badec99593bf None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:10.822113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c894d20-2f30-430c-a3cc-badec99593bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:10.826256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f9f6e-635a-4415-bf59-62bc8a104a81 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:10.831759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c894d20-2f30-430c-a3cc-badec99593bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:10.833212 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c894d20-2f30-430c-a3cc-badec99593bf None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:10.855445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-3c894d20-2f30-430c-a3cc-badec99593bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:42:10.855445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:10.855445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:10.855445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:10.855445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:10.855445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:10.855445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:10.855445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:10.855445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:10.855445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:10.855445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:10.855445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:10.855445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:42:10.855445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:42:10.855445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:42:10.855445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:42:10.856442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:10.856442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:10.856442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:42:10.856442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:10.856442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:42:10.856442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:10.856442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:10.856442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:10.856442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:10.856442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:10.856442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:10.856442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:10.856442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:10.856442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:10.856442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:10.856442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:10.856442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:10.856442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:10.857375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:10.857375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:10.857375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:42:10.857375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:42:10.857375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:42:10.857375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:42:10.857375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:42:10.857375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:42:10.857375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:42:10.857375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:10.857375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 415/822] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 3 12:42:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:10.865220 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c894d20-2f30-430c-a3cc-badec99593bf None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:10.867034 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:11.005584 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c894d20-2f30-430c-a3cc-badec99593bf None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:11.042851 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d999d5d-98b9-4ce2-96d9-dbdb88c3b551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:11.043979 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d999d5d-98b9-4ce2-96d9-dbdb88c3b551 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:11.044482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d999d5d-98b9-4ce2-96d9-dbdb88c3b551 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:11.044963 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d999d5d-98b9-4ce2-96d9-dbdb88c3b551 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:11.045977 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d999d5d-98b9-4ce2-96d9-dbdb88c3b551 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:11.046517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d999d5d-98b9-4ce2-96d9-dbdb88c3b551 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:11.048186 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d999d5d-98b9-4ce2-96d9-dbdb88c3b551 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:11.048904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f9f6e-635a-4415-bf59-62bc8a104a81 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:11.068586 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 416/823] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 3 12:42:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:11.075505 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d999d5d-98b9-4ce2-96d9-dbdb88c3b551 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:11.094479 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915ccb6-590d-4ff1-99be-ca76baaf29be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:11.095053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915ccb6-590d-4ff1-99be-ca76baaf29be None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:11.095340 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915ccb6-590d-4ff1-99be-ca76baaf29be None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:11.095622 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915ccb6-590d-4ff1-99be-ca76baaf29be None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:11.096308 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915ccb6-590d-4ff1-99be-ca76baaf29be None admin] RBAC: Adding query filter params (name=network) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:11.096619 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915ccb6-590d-4ff1-99be-ca76baaf29be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:11.097384 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:11.098530 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915ccb6-590d-4ff1-99be-ca76baaf29be None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:11.106128 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 408/824] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 3 12:42:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:11.111054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915ccb6-590d-4ff1-99be-ca76baaf29be None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:11.251184 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:11.259295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915ccb6-590d-4ff1-99be-ca76baaf29be None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:11.297955 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d257f-3e13-46c1-acd4-191716963413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:11.298803 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d257f-3e13-46c1-acd4-191716963413 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:11.299116 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d257f-3e13-46c1-acd4-191716963413 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:11.299396 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d257f-3e13-46c1-acd4-191716963413 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:11.300234 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d257f-3e13-46c1-acd4-191716963413 None admin] RBAC: Adding query filter params (type=network) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:11.300556 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d257f-3e13-46c1-acd4-191716963413 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:11.302342 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d257f-3e13-46c1-acd4-191716963413 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:11.308036 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 409/825] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 3 12:42:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:11.314067 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d257f-3e13-46c1-acd4-191716963413 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:11.358198 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d999d5d-98b9-4ce2-96d9-dbdb88c3b551 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:11.436132 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbec09e-e3eb-4071-8926-9c7b5a233e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:11.436820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbec09e-e3eb-4071-8926-9c7b5a233e10 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:11.437157 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbec09e-e3eb-4071-8926-9c7b5a233e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:11.437436 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbec09e-e3eb-4071-8926-9c7b5a233e10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:11.490652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d257f-3e13-46c1-acd4-191716963413 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:11.539626 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbec09e-e3eb-4071-8926-9c7b5a233e10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:11.541233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbec09e-e3eb-4071-8926-9c7b5a233e10 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:11.552222 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:11.574976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6056902-397f-4966-9a4f-c88ac6851e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:11.575947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6056902-397f-4966-9a4f-c88ac6851e75 None admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:11.576566 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6056902-397f-4966-9a4f-c88ac6851e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:11.577048 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6056902-397f-4966-9a4f-c88ac6851e75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:11.583035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6056902-397f-4966-9a4f-c88ac6851e75 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:11.583035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6056902-397f-4966-9a4f-c88ac6851e75 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:11.653605 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 417/826] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:42:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:42:11.658765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbec09e-e3eb-4071-8926-9c7b5a233e10 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:11.707656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 410/827] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:42:11 2022] POST /identity/v3/endpoints => generated 337 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:42:11.709064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a4fb3-720b-48ec-a250-fac5996bddf7 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:11.709358 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a4fb3-720b-48ec-a250-fac5996bddf7 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:11.709635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a4fb3-720b-48ec-a250-fac5996bddf7 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:11.711220 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 411/828] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:11.726354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae06507-0ef1-4138-9d80-eb96ecd32318 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:11.726694 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae06507-0ef1-4138-9d80-eb96ecd32318 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:11.726937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae06507-0ef1-4138-9d80-eb96ecd32318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:11.744065 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:11.758143 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-0ae06507-0ef1-4138-9d80-eb96ecd32318 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:11.759410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-0ae06507-0ef1-4138-9d80-eb96ecd32318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:11.824095 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbec09e-e3eb-4071-8926-9c7b5a233e10 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:11.840638 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:11.893349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 412/829] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:11.905831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57a2c9-36bb-4230-a64d-0a21707da863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:11.906458 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57a2c9-36bb-4230-a64d-0a21707da863 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:11.906759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57a2c9-36bb-4230-a64d-0a21707da863 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:11.907049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57a2c9-36bb-4230-a64d-0a21707da863 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:11.922946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57a2c9-36bb-4230-a64d-0a21707da863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:11.924415 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57a2c9-36bb-4230-a64d-0a21707da863 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:11.935100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae06507-0ef1-4138-9d80-eb96ecd32318 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:11.943502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-ff57a2c9-36bb-4230-a64d-0a21707da863 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:11.943502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:11.943502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:11.943502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:11.943502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:11.943502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:11.943502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:11.943502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:11.943502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:11.943502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:11.943502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:11.943502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:11.943502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:11.943502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:11.943502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:11.944400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:11.944400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:11.944400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:11.944400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:11.944400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:11.944400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:11.944400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:11.944400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:11.944400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:11.944400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:11.944400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:11.944400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:11.944400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:11.944400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:11.944400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:11.944400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:11.944400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:11.945297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:11.945297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:11.945297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:11.945297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:11.947813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 418/830] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:11.953889 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57a2c9-36bb-4230-a64d-0a21707da863 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:12.078955 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae06507-0ef1-4138-9d80-eb96ecd32318 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:12.085182 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57a2c9-36bb-4230-a64d-0a21707da863 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:12.109100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:12.119375 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69bc3f-79d2-442d-b0ed-d979e5dd6fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:12.120272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69bc3f-79d2-442d-b0ed-d979e5dd6fcc None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:12.127197 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69bc3f-79d2-442d-b0ed-d979e5dd6fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:12.127197 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69bc3f-79d2-442d-b0ed-d979e5dd6fcc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:12.127392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb25935-0f67-4735-a2aa-1499f2c0c619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:12.127392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb25935-0f67-4735-a2aa-1499f2c0c619 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:12.127392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb25935-0f67-4735-a2aa-1499f2c0c619 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:12.127392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb25935-0f67-4735-a2aa-1499f2c0c619 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:12.127724 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb25935-0f67-4735-a2aa-1499f2c0c619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:12.127724 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb25935-0f67-4735-a2aa-1499f2c0c619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:12.127724 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb25935-0f67-4735-a2aa-1499f2c0c619 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:12.135031 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69bc3f-79d2-442d-b0ed-d979e5dd6fcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:42:12.141167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-fe69bc3f-79d2-442d-b0ed-d979e5dd6fcc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:42:12.141167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:12.141167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:12.141167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:12.141167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:12.141167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:12.141167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:12.141167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:12.141167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:12.141167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:12.141167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:12.141167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:12.141167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:42:12.141167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:42:12.141167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:42:12.141167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:42:12.142173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:42:12.142173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:42:12.142173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:42:12.142173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:42:12.142173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:12.142173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:12.142173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:12.142173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:12.142173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:12.142173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:12.142173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:12.142173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:12.142173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:12.142173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:12.142173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:12.142173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:12.143087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:12.143087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:12.143087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:12.143087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:12.143087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:42:12.143087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:42:12.143087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:42:12.143087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:42:12.143087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:42:12.143087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:42:12.143087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:42:12.143087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:12.145496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 413/832] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:42:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:12.149879 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 419/832] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:12.150008 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69bc3f-79d2-442d-b0ed-d979e5dd6fcc None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:12.156336 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb25935-0f67-4735-a2aa-1499f2c0c619 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:12.186487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:12.283205 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb25935-0f67-4735-a2aa-1499f2c0c619 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:12.292136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69bc3f-79d2-442d-b0ed-d979e5dd6fcc None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:12.329390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916a821-2706-4c5e-a70d-3cad3b9fdec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:12.330068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916a821-2706-4c5e-a70d-3cad3b9fdec7 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:12.330354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916a821-2706-4c5e-a70d-3cad3b9fdec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:12.330632 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916a821-2706-4c5e-a70d-3cad3b9fdec7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:12.331282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7208247-c28b-4af8-bd1c-942945b2ff6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:12.332384 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7208247-c28b-4af8-bd1c-942945b2ff6d None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:12.333168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7208247-c28b-4af8-bd1c-942945b2ff6d None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:12.334071 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7208247-c28b-4af8-bd1c-942945b2ff6d None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:12.335050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7208247-c28b-4af8-bd1c-942945b2ff6d None admin] RBAC: Adding query filter params (name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:12.335568 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7208247-c28b-4af8-bd1c-942945b2ff6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:12.337516 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7208247-c28b-4af8-bd1c-942945b2ff6d None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:12.338049 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916a821-2706-4c5e-a70d-3cad3b9fdec7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:12.339538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916a821-2706-4c5e-a70d-3cad3b9fdec7 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:12.354101 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-a916a821-2706-4c5e-a70d-3cad3b9fdec7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:12.354101 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:12.354101 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:12.354101 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:12.354101 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:12.354101 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:12.354101 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:12.354101 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:12.354101 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:12.354101 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:12.354101 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:12.354101 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:12.354101 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:42:12.354101 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:42:12.354101 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:42:12.355086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:42:12.355086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:12.355086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:12.355086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:12.355086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:12.355086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:12.355086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:12.355086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:12.355086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:12.355086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:12.355086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:12.355086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:12.355086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:12.355086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:12.355086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:12.355086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:12.355086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:12.355963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:42:12.355963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:42:12.355963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:42:12.355963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:42:12.355963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:42:12.355963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:42:12.355963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:12.355963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:12.356889 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 420/834] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 3 12:42:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:12.358447 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 414/834] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:42:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:12.359409 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7208247-c28b-4af8-bd1c-942945b2ff6d None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:12.359661 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916a821-2706-4c5e-a70d-3cad3b9fdec7 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:12.415832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:12.473304 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916a821-2706-4c5e-a70d-3cad3b9fdec7 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:12.474653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:12.494915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7208247-c28b-4af8-bd1c-942945b2ff6d None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:12.510013 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371f5d9-9cc7-44fb-935f-6f77fa8f9a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:12.510382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371f5d9-9cc7-44fb-935f-6f77fa8f9a26 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:12.510676 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371f5d9-9cc7-44fb-935f-6f77fa8f9a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:12.510978 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371f5d9-9cc7-44fb-935f-6f77fa8f9a26 None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:12.511771 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371f5d9-9cc7-44fb-935f-6f77fa8f9a26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:12.512069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371f5d9-9cc7-44fb-935f-6f77fa8f9a26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:12.513682 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371f5d9-9cc7-44fb-935f-6f77fa8f9a26 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:12.527391 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 415/835] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:42:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:12.532915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371f5d9-9cc7-44fb-935f-6f77fa8f9a26 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:12.537881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c836d-125b-4b42-ac47-513c72496d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:12.538839 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c836d-125b-4b42-ac47-513c72496d60 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:12.539287 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c836d-125b-4b42-ac47-513c72496d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:12.539837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c836d-125b-4b42-ac47-513c72496d60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:12.552017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c836d-125b-4b42-ac47-513c72496d60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:12.554691 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c836d-125b-4b42-ac47-513c72496d60 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:12.576385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-a17c836d-125b-4b42-ac47-513c72496d60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:12.576385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:12.576385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:12.576385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:12.576385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:12.576385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:12.576385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:12.576385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:12.576385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:12.576385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:12.576385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:12.576385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:12.576385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:12.576385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:12.576385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:12.577316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:12.577316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:12.577316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:12.577316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:12.577316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:12.577316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:12.577316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:12.577316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:12.577316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:12.577316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:12.577316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:12.577316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:12.577316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:12.577316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:12.577316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:12.577316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:12.577316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:12.578205 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:12.578205 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:12.578205 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:12.578205 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:12.580430 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 421/836] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:12.586410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c836d-125b-4b42-ac47-513c72496d60 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:12.652133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371f5d9-9cc7-44fb-935f-6f77fa8f9a26 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:12.663248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:12.688216 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5de4e-de7a-47e9-b6a5-e3db42841d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:12.688762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5de4e-de7a-47e9-b6a5-e3db42841d89 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:12.689126 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5de4e-de7a-47e9-b6a5-e3db42841d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:12.689376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5de4e-de7a-47e9-b6a5-e3db42841d89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:12.690112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5de4e-de7a-47e9-b6a5-e3db42841d89 None admin] RBAC: Adding query filter params (role.id=a6d209169b77456f9f1cc3ff53646cfc, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=bc939818c9224b0ebe2dbaa1eaaec5e5) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:12.690425 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5de4e-de7a-47e9-b6a5-e3db42841d89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:12.691949 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5de4e-de7a-47e9-b6a5-e3db42841d89 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:12.697502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c836d-125b-4b42-ac47-513c72496d60 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:12.705005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 416/837] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:42:12 2022] GET /identity/v3/role_assignments?user.id=bc939818c9224b0ebe2dbaa1eaaec5e5&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=a6d209169b77456f9f1cc3ff53646cfc => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:12.705005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a6ae9-765f-47a7-b9ec-c7e9396100ad None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:12.705005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a6ae9-765f-47a7-b9ec-c7e9396100ad None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:12.705005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a6ae9-765f-47a7-b9ec-c7e9396100ad None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:12.705005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 417/838] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:12.706726 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47af1b-3a66-41cf-b956-dbeda805e853 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:12.707547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47af1b-3a66-41cf-b956-dbeda805e853 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:12.707835 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47af1b-3a66-41cf-b956-dbeda805e853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:12.731936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-3a47af1b-3a66-41cf-b956-dbeda805e853 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:12.733330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3a47af1b-3a66-41cf-b956-dbeda805e853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:12.757253 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da13ba-71e3-4f2e-bb17-13a3e3d9b834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:12.757967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da13ba-71e3-4f2e-bb17-13a3e3d9b834 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:12.758261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da13ba-71e3-4f2e-bb17-13a3e3d9b834 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:12.758547 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da13ba-71e3-4f2e-bb17-13a3e3d9b834 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:12.759332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da13ba-71e3-4f2e-bb17-13a3e3d9b834 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:12.759646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da13ba-71e3-4f2e-bb17-13a3e3d9b834 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:12.761086 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da13ba-71e3-4f2e-bb17-13a3e3d9b834 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:12.763873 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:12.782151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 422/839] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:12.788490 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da13ba-71e3-4f2e-bb17-13a3e3d9b834 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:12.830770 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 418/840] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:12.830770 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa6aca-991a-45fd-9d01-89147d6db05c None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:12.830770 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa6aca-991a-45fd-9d01-89147d6db05c None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:12.830770 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa6aca-991a-45fd-9d01-89147d6db05c None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:12.830770 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 419/841] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:42:12.833230 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ecdcc-3e35-4643-8c07-7fda410ce77c None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:12.833519 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ecdcc-3e35-4643-8c07-7fda410ce77c None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:12.833797 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ecdcc-3e35-4643-8c07-7fda410ce77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:12.853711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-e70ecdcc-3e35-4643-8c07-7fda410ce77c None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:12.854958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e70ecdcc-3e35-4643-8c07-7fda410ce77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:12.918928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da13ba-71e3-4f2e-bb17-13a3e3d9b834 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:12.931054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 420/842] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:12.931898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ecdcc-3e35-4643-8c07-7fda410ce77c None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:12.965147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f309c15-515e-4bb3-8cde-5cdf11b07be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:12.965570 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:12.966185 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f309c15-515e-4bb3-8cde-5cdf11b07be9 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:12.966617 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f309c15-515e-4bb3-8cde-5cdf11b07be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:12.967087 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f309c15-515e-4bb3-8cde-5cdf11b07be9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:12.975737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f309c15-515e-4bb3-8cde-5cdf11b07be9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:12.977181 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f309c15-515e-4bb3-8cde-5cdf11b07be9 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:12.989489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-9f309c15-515e-4bb3-8cde-5cdf11b07be9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:42:12.989489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:12.989489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:12.989489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:12.989489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:12.989489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:12.989489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:12.989489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:12.989489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:12.989489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:12.989489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:12.989489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:12.989489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:42:12.989489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:42:12.989489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:42:12.989489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:42:12.990655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:12.990655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:12.990655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:42:12.990655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:12.990655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:42:12.990655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:12.990655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:12.990655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:12.990655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:12.990655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:12.990655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:12.990655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:12.990655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:12.990655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:12.990655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:12.990655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:12.990655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:12.990655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:12.991740 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:12.991740 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:12.991740 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:42:12.991740 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:42:12.991740 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:42:12.991740 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:42:12.991740 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:42:12.991740 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:42:12.991740 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:42:12.991740 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:12.991740 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 423/843] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 3 12:42:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:12.992902 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f309c15-515e-4bb3-8cde-5cdf11b07be9 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:13.048829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:13.050465 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ecdcc-3e35-4643-8c07-7fda410ce77c None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:13.087340 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471fbf1-0d6d-4427-b78e-98924916367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:13.087976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471fbf1-0d6d-4427-b78e-98924916367d None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:13.088274 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471fbf1-0d6d-4427-b78e-98924916367d None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:13.088528 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471fbf1-0d6d-4427-b78e-98924916367d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:13.098309 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f309c15-515e-4bb3-8cde-5cdf11b07be9 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:13.099381 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471fbf1-0d6d-4427-b78e-98924916367d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:42:13.105700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-a471fbf1-0d6d-4427-b78e-98924916367d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:42:13.105700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:13.105700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:13.105700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:13.105700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:13.105700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:13.105700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:13.105700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:13.105700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:13.105700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:13.105700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:13.105700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:13.105700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:42:13.105700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:42:13.105700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:42:13.105700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:42:13.106621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:42:13.106621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:42:13.106621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:42:13.106621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:42:13.106621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:13.106621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:13.106621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:13.106621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:13.106621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:13.106621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:13.106621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:13.106621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:13.106621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:13.106621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:13.106621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:13.106621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:13.107515 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:13.107515 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:13.107515 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:13.107515 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:13.107515 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:42:13.107515 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:42:13.107515 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:42:13.107515 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:42:13.107515 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:42:13.107515 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:42:13.107515 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:42:13.107515 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:13.107515 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 421/844] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:42:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:13.108705 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471fbf1-0d6d-4427-b78e-98924916367d None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:13.133264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe77c53-4ec0-4d52-9ca7-26ec15946396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:13.133912 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe77c53-4ec0-4d52-9ca7-26ec15946396 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:13.134200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe77c53-4ec0-4d52-9ca7-26ec15946396 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:13.134479 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe77c53-4ec0-4d52-9ca7-26ec15946396 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:13.135141 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe77c53-4ec0-4d52-9ca7-26ec15946396 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:13.136514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe77c53-4ec0-4d52-9ca7-26ec15946396 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:13.147223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-abe77c53-4ec0-4d52-9ca7-26ec15946396 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:42:13.147223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:13.147223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:42:13.147223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:42:13.147223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:42:13.147223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:42:13.147223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:42:13.147223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:13.147223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:42:13.147223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:13.147223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:13.147223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:13.147223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:13.147223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:13.147223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:13.147223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:13.147223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:13.148223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:13.148223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:13.148223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:13.148223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:13.148223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:13.148223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:13.148223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:42:13.148223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:42:13.148223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:42:13.148223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:42:13.148223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:13.148223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:13.148223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:13.148223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:13.148223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:13.148223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:13.149080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:13.149080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:13.149080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:13.149080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:13.149080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:13.149080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:13.149080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:13.149080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:13.149080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:13.149080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:13.149080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:42:13.149080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:13.149080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:42:13.149080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:13.149080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 424/845] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:42:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:13.149860 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe77c53-4ec0-4d52-9ca7-26ec15946396 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:13.229901 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:13.238818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471fbf1-0d6d-4427-b78e-98924916367d None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:13.260671 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe77c53-4ec0-4d52-9ca7-26ec15946396 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:13.274933 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26375e0-bfa2-4371-a83f-126071cb27e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:13.275565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26375e0-bfa2-4371-a83f-126071cb27e5 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:13.276010 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26375e0-bfa2-4371-a83f-126071cb27e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:13.276299 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26375e0-bfa2-4371-a83f-126071cb27e5 None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:13.277495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26375e0-bfa2-4371-a83f-126071cb27e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:13.277953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26375e0-bfa2-4371-a83f-126071cb27e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:13.279434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26375e0-bfa2-4371-a83f-126071cb27e5 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:13.280419 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:13.301804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 422/846] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 3 12:42:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:13.301983 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77981d-7f25-4130-8d0a-83b7a3cd3b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:13.302077 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26375e0-bfa2-4371-a83f-126071cb27e5 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:13.302179 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77981d-7f25-4130-8d0a-83b7a3cd3b19 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:13.302179 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77981d-7f25-4130-8d0a-83b7a3cd3b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:13.302179 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77981d-7f25-4130-8d0a-83b7a3cd3b19 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:13.302179 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77981d-7f25-4130-8d0a-83b7a3cd3b19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:13.302179 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77981d-7f25-4130-8d0a-83b7a3cd3b19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:13.302179 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77981d-7f25-4130-8d0a-83b7a3cd3b19 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:13.310708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 425/847] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:42:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:13.311575 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77981d-7f25-4130-8d0a-83b7a3cd3b19 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:13.414000 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26375e0-bfa2-4371-a83f-126071cb27e5 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:13.418981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77981d-7f25-4130-8d0a-83b7a3cd3b19 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:13.453910 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39d999-cbc5-48dc-8808-c434ab925eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:13.454537 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39d999-cbc5-48dc-8808-c434ab925eba None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:13.454855 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39d999-cbc5-48dc-8808-c434ab925eba None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:13.455138 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39d999-cbc5-48dc-8808-c434ab925eba None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:13.455826 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39d999-cbc5-48dc-8808-c434ab925eba None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:13.456137 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39d999-cbc5-48dc-8808-c434ab925eba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:13.456735 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db89572-798f-4446-8bad-c0e1ea090048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:13.457448 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db89572-798f-4446-8bad-c0e1ea090048 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:13.457591 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39d999-cbc5-48dc-8808-c434ab925eba None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:13.457846 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db89572-798f-4446-8bad-c0e1ea090048 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:13.458186 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db89572-798f-4446-8bad-c0e1ea090048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:13.462373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 423/848] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:42:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:13.463338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39d999-cbc5-48dc-8808-c434ab925eba None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:13.480862 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:13.517494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:13.537925 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db89572-798f-4446-8bad-c0e1ea090048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:13.539749 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db89572-798f-4446-8bad-c0e1ea090048 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:13.570695 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39d999-cbc5-48dc-8808-c434ab925eba None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:13.606277 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43f2b5-e64a-4a20-916d-e5b69bb99b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:13.607029 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43f2b5-e64a-4a20-916d-e5b69bb99b06 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:13.607375 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43f2b5-e64a-4a20-916d-e5b69bb99b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:13.607729 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43f2b5-e64a-4a20-916d-e5b69bb99b06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:13.619253 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43f2b5-e64a-4a20-916d-e5b69bb99b06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:13.620901 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43f2b5-e64a-4a20-916d-e5b69bb99b06 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:13.637188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-fb43f2b5-e64a-4a20-916d-e5b69bb99b06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:13.637188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:13.637188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:13.637188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:13.637188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:13.637188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:13.637188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:13.637188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:13.637188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:13.637188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:13.637188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:13.637188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:13.637188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:13.637188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:13.637188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:13.638283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:13.638283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:13.638283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:13.638283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:13.638283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:13.638283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:13.638283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:13.638283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:13.638283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:13.638283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:13.638283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:13.638283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:13.638283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:13.638283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:13.638283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:13.638283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:13.638283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:13.639346 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:13.639346 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:13.639346 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:13.639346 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:13.639346 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 424/849] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:13.642723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 426/850] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:42:13 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:42:13.643703 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43f2b5-e64a-4a20-916d-e5b69bb99b06 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:13.647745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db89572-798f-4446-8bad-c0e1ea090048 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:13.710592 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:13.733921 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:13.747778 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43f2b5-e64a-4a20-916d-e5b69bb99b06 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:13.758287 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db89572-798f-4446-8bad-c0e1ea090048 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:13.783531 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a66a94-5eb0-4236-a2c6-7356e0f9dd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:13.784156 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a66a94-5eb0-4236-a2c6-7356e0f9dd85 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:13.784439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a66a94-5eb0-4236-a2c6-7356e0f9dd85 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:13.784718 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a66a94-5eb0-4236-a2c6-7356e0f9dd85 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:13.785933 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a66a94-5eb0-4236-a2c6-7356e0f9dd85 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:13.786247 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a66a94-5eb0-4236-a2c6-7356e0f9dd85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:13.787659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a66a94-5eb0-4236-a2c6-7356e0f9dd85 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:13.802769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 425/851] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:42:13 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:13.802769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a66a94-5eb0-4236-a2c6-7356e0f9dd85 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:13.805781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b54dd-9a80-4b1c-a293-ace148ee3805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:13.806513 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b54dd-9a80-4b1c-a293-ace148ee3805 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:13.806928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b54dd-9a80-4b1c-a293-ace148ee3805 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:13.807291 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b54dd-9a80-4b1c-a293-ace148ee3805 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:13.808114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b54dd-9a80-4b1c-a293-ace148ee3805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:13.808535 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b54dd-9a80-4b1c-a293-ace148ee3805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:13.810132 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b54dd-9a80-4b1c-a293-ace148ee3805 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:13.824397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 427/852] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:13.830152 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b54dd-9a80-4b1c-a293-ace148ee3805 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:13.935635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a66a94-5eb0-4236-a2c6-7356e0f9dd85 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:13.954665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b54dd-9a80-4b1c-a293-ace148ee3805 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:13.970949 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:13.980749 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22e16f-b151-4499-9629-9285b92eb0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:13.981395 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22e16f-b151-4499-9629-9285b92eb0df None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:13.987191 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22e16f-b151-4499-9629-9285b92eb0df None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:13.987191 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22e16f-b151-4499-9629-9285b92eb0df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:13.997965 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d6815-2ab7-496f-831e-b865f79ae736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:13.998344 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22e16f-b151-4499-9629-9285b92eb0df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:13.999536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d6815-2ab7-496f-831e-b865f79ae736 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:13.999536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d6815-2ab7-496f-831e-b865f79ae736 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:13.999536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d6815-2ab7-496f-831e-b865f79ae736 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:13.999824 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22e16f-b151-4499-9629-9285b92eb0df None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:14.008211 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d6815-2ab7-496f-831e-b865f79ae736 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:14.009739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d6815-2ab7-496f-831e-b865f79ae736 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:14.013804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:14.021918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-ec22e16f-b151-4499-9629-9285b92eb0df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:14.021918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:14.021918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:14.021918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:14.021918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:14.021918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:14.021918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:14.021918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:14.021918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:14.021918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:14.021918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:14.021918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:14.021918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:14.021918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:14.021918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:14.027975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:14.027975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:14.027975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:14.027975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:14.027975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:14.027975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:14.027975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:14.027975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:14.027975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:14.027975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:14.027975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:14.027975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:14.027975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:14.027975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:14.027975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:14.027975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:14.027975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:14.028910 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:14.028910 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:14.028910 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:14.028910 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:14.028910 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 426/853] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:14.029207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-750d6815-2ab7-496f-831e-b865f79ae736 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:42:14.029207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:14.029207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:14.029207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:14.029207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:14.029207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:14.029207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:14.029207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:14.029207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:14.029207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:14.029207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:14.029207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:14.029207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:42:14.029207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:42:14.029207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:42:14.029207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:42:14.030214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:14.030214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:14.030214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:42:14.030214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:14.030214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:42:14.030214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:14.030214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:14.030214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:14.030214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:14.030214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:14.030214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:14.030214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:14.030214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:14.030214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:14.030214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:14.030214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:14.030214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:14.030214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:14.031314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:14.031314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:14.031314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:42:14.031314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:42:14.031314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:42:14.031314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:42:14.031314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:42:14.031314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:42:14.031314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:42:14.031314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:14.031314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 428/854] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:42:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:14.031891 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22e16f-b151-4499-9629-9285b92eb0df None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:14.036397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d6815-2ab7-496f-831e-b865f79ae736 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:14.147838 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22e16f-b151-4499-9629-9285b92eb0df None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:14.161272 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d6815-2ab7-496f-831e-b865f79ae736 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:14.186156 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e0e8b-7590-45a0-9172-378c7fc21c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:14.187173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e0e8b-7590-45a0-9172-378c7fc21c38 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:14.187678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e0e8b-7590-45a0-9172-378c7fc21c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:14.188292 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e0e8b-7590-45a0-9172-378c7fc21c38 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:14.189318 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e0e8b-7590-45a0-9172-378c7fc21c38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:14.189824 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e0e8b-7590-45a0-9172-378c7fc21c38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:14.191697 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e0e8b-7590-45a0-9172-378c7fc21c38 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:14.197149 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b88040-7757-4825-8c52-fafc53bde413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:14.197776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b88040-7757-4825-8c52-fafc53bde413 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:14.198058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b88040-7757-4825-8c52-fafc53bde413 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:14.198335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b88040-7757-4825-8c52-fafc53bde413 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:14.199194 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b88040-7757-4825-8c52-fafc53bde413 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:14.199504 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b88040-7757-4825-8c52-fafc53bde413 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:14.201368 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b88040-7757-4825-8c52-fafc53bde413 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:14.207452 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 427/855] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:14.213682 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e0e8b-7590-45a0-9172-378c7fc21c38 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:14.228158 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 429/856] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Aug 3 12:42:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:14.233274 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b88040-7757-4825-8c52-fafc53bde413 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:14.272711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:14.296811 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:14.338418 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e0e8b-7590-45a0-9172-378c7fc21c38 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:14.341325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b88040-7757-4825-8c52-fafc53bde413 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:14.375797 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc76ed-a99a-402a-a730-f4fa966d3861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:14.376813 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc76ed-a99a-402a-a730-f4fa966d3861 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:14.377246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc76ed-a99a-402a-a730-f4fa966d3861 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:14.377669 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc76ed-a99a-402a-a730-f4fa966d3861 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:14.384799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e09a58-0403-4fd7-bced-7e0be4624612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:14.385223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc76ed-a99a-402a-a730-f4fa966d3861 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:14.385421 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e09a58-0403-4fd7-bced-7e0be4624612 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:14.385700 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e09a58-0403-4fd7-bced-7e0be4624612 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:14.385972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e09a58-0403-4fd7-bced-7e0be4624612 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:14.387390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc76ed-a99a-402a-a730-f4fa966d3861 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:14.402756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-42bc76ed-a99a-402a-a730-f4fa966d3861 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:14.402756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:14.402756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:14.402756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:14.402756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:14.402756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:14.402756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:14.402756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:14.402756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:14.402756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:14.402756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:14.402756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:14.402756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:42:14.402756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:42:14.402756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:42:14.404007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:42:14.404007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:14.404007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:14.404007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:14.404007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:14.404007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:14.404007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:14.404007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:14.404007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:14.404007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:14.404007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:14.404007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:14.404007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:14.404007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:14.404007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:14.404007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:14.404007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:14.405100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:42:14.405100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:42:14.405100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:42:14.405100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:42:14.405100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:42:14.405100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:42:14.405100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:14.405100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:14.407379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 428/857] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:42:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:14.418779 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc76ed-a99a-402a-a730-f4fa966d3861 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:14.467491 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e09a58-0403-4fd7-bced-7e0be4624612 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:14.469396 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e09a58-0403-4fd7-bced-7e0be4624612 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:14.527914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc76ed-a99a-402a-a730-f4fa966d3861 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:14.530131 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:14.542997 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:14.573588 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41809257-4809-44bd-883b-2e64f7388cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:14.574560 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41809257-4809-44bd-883b-2e64f7388cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:14.575075 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41809257-4809-44bd-883b-2e64f7388cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:14.575555 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41809257-4809-44bd-883b-2e64f7388cd0 None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:14.576504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41809257-4809-44bd-883b-2e64f7388cd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:14.577035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41809257-4809-44bd-883b-2e64f7388cd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:14.578758 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41809257-4809-44bd-883b-2e64f7388cd0 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:14.591127 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 430/858] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:42:14 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 03 12:42:14.597343 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 429/859] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:42:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:14.598545 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e09a58-0403-4fd7-bced-7e0be4624612 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:14.598769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41809257-4809-44bd-883b-2e64f7388cd0 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:14.709912 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e09a58-0403-4fd7-bced-7e0be4624612 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:14.715193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41809257-4809-44bd-883b-2e64f7388cd0 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:14.747002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5689b54-447a-40d6-bc04-7ce0a11d49f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:14.747884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5689b54-447a-40d6-bc04-7ce0a11d49f4 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:14.748342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5689b54-447a-40d6-bc04-7ce0a11d49f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:14.748780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5689b54-447a-40d6-bc04-7ce0a11d49f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:14.751529 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5eede-8e48-4e54-9344-53c2cced5321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:14.752293 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5eede-8e48-4e54-9344-53c2cced5321 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:14.752733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5eede-8e48-4e54-9344-53c2cced5321 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:14.753142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5eede-8e48-4e54-9344-53c2cced5321 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:14.754587 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5eede-8e48-4e54-9344-53c2cced5321 None admin] RBAC: Adding query filter params (role.id=72fab3a91c004428b7e615dac55116cd, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=b9d70abf4f754530a3cf6efa7a782736) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:14.755059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5eede-8e48-4e54-9344-53c2cced5321 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:14.756718 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5eede-8e48-4e54-9344-53c2cced5321 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:14.760085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5689b54-447a-40d6-bc04-7ce0a11d49f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:14.761427 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5689b54-447a-40d6-bc04-7ce0a11d49f4 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:14.763690 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 430/860] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:42:14 2022] GET /identity/v3/role_assignments?user.id=b9d70abf4f754530a3cf6efa7a782736&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=72fab3a91c004428b7e615dac55116cd => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:14.777780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-b5689b54-447a-40d6-bc04-7ce0a11d49f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:14.777780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:14.777780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:14.777780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:14.777780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:14.777780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:14.777780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:14.777780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:14.777780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:14.777780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:14.777780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:14.777780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:14.777780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:14.777780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:14.777780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:14.779079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:14.779079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:14.779079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:14.779079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:14.779079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:14.779079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:14.779079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:14.779079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:14.779079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:14.779079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:14.779079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:14.779079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:14.779079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:14.779079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:14.779079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:14.779079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:14.779079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:14.780150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:14.780150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:14.780150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:14.780150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:14.780150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 431/861] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:14.785193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5eede-8e48-4e54-9344-53c2cced5321 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:14.794433 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6ccdc-5d35-4643-853f-2598f08f484e None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:14.795002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6ccdc-5d35-4643-853f-2598f08f484e None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:14.795434 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6ccdc-5d35-4643-853f-2598f08f484e None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:14.797319 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 432/862] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:14.804524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a67471-a4fd-4f73-9e36-b5c59024e05b None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:14.804839 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a67471-a4fd-4f73-9e36-b5c59024e05b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:14.805101 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a67471-a4fd-4f73-9e36-b5c59024e05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:14.824576 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-82a67471-a4fd-4f73-9e36-b5c59024e05b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:14.825838 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-82a67471-a4fd-4f73-9e36-b5c59024e05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:14.828715 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:14.835550 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:14.914231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 433/863] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:14.933771 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5eede-8e48-4e54-9344-53c2cced5321 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:14.938299 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a67471-a4fd-4f73-9e36-b5c59024e05b None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:14.990435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204feda-a8ab-49ad-b77e-9a8e71a19c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:14.991122 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204feda-a8ab-49ad-b77e-9a8e71a19c30 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:14.991442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204feda-a8ab-49ad-b77e-9a8e71a19c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:14.991728 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204feda-a8ab-49ad-b77e-9a8e71a19c30 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:14.992476 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204feda-a8ab-49ad-b77e-9a8e71a19c30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:14.992794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204feda-a8ab-49ad-b77e-9a8e71a19c30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:14.994202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204feda-a8ab-49ad-b77e-9a8e71a19c30 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:15.007578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 431/864] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:15.014266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204feda-a8ab-49ad-b77e-9a8e71a19c30 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:15.064204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a67471-a4fd-4f73-9e36-b5c59024e05b None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:15.107519 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53dd495-dc26-4495-b71b-c9cc0e3443bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:15.108322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53dd495-dc26-4495-b71b-c9cc0e3443bb None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:15.108604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53dd495-dc26-4495-b71b-c9cc0e3443bb None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:15.108874 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53dd495-dc26-4495-b71b-c9cc0e3443bb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:15.109989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53dd495-dc26-4495-b71b-c9cc0e3443bb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:15.111714 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53dd495-dc26-4495-b71b-c9cc0e3443bb None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:15.123742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-f53dd495-dc26-4495-b71b-c9cc0e3443bb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:42:15.123742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:15.123742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:42:15.123742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:42:15.123742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:42:15.123742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:42:15.123742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:42:15.123742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:15.123742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:42:15.123742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:15.123742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:15.123742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:15.123742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:15.123742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:15.123742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:15.123742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:15.124693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:15.124693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:15.124693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:15.124693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:15.124693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:15.124693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:15.124693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:15.124693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:42:15.124693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:42:15.124693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:42:15.124693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:42:15.124693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:15.124693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:15.124693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:15.124693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:15.124693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:15.126008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:15.126008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:15.126008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:15.126008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:15.126008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:15.126008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:15.126008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:15.126008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:15.126008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:15.126008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:15.126008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:15.126008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:42:15.126008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:15.126008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:42:15.126008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:15.126008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 434/865] 10.222.0.64 () {56 vars in 1132 bytes} [Wed Aug 3 12:42:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:15.131790 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53dd495-dc26-4495-b71b-c9cc0e3443bb None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:15.132317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:15.135475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:15.148642 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204feda-a8ab-49ad-b77e-9a8e71a19c30 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:15.186308 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58677513-0325-4de7-9cf7-d4a30d7c3809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:15.186980 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58677513-0325-4de7-9cf7-d4a30d7c3809 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:15.187675 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58677513-0325-4de7-9cf7-d4a30d7c3809 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:15.187954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58677513-0325-4de7-9cf7-d4a30d7c3809 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:15.200050 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58677513-0325-4de7-9cf7-d4a30d7c3809 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:15.202216 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58677513-0325-4de7-9cf7-d4a30d7c3809 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:15.215935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-58677513-0325-4de7-9cf7-d4a30d7c3809 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:15.215935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:15.215935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:15.215935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:15.215935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:15.215935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:15.215935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:15.215935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:15.215935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:15.215935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:15.215935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:15.215935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:15.215935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:42:15.215935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:42:15.215935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:42:15.216869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:42:15.216869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:15.216869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:15.216869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:15.216869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:15.216869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:15.216869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:15.216869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:15.216869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:15.216869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:15.216869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:15.216869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:15.216869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:15.216869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:15.216869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:15.216869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:15.216869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:15.218063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:42:15.218063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:42:15.218063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:42:15.218063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:42:15.218063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:42:15.218063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:42:15.218063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:15.218063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:15.218063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 432/866] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:42:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:15.224436 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58677513-0325-4de7-9cf7-d4a30d7c3809 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:15.248589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53dd495-dc26-4495-b71b-c9cc0e3443bb None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:15.284661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd20aa9-1cf7-4d8b-abba-fd94865968e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:15.285861 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd20aa9-1cf7-4d8b-abba-fd94865968e0 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:15.286148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd20aa9-1cf7-4d8b-abba-fd94865968e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:15.286429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd20aa9-1cf7-4d8b-abba-fd94865968e0 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:15.287206 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd20aa9-1cf7-4d8b-abba-fd94865968e0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:15.287519 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd20aa9-1cf7-4d8b-abba-fd94865968e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:15.288901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd20aa9-1cf7-4d8b-abba-fd94865968e0 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:15.300298 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 435/867] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 3 12:42:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:15.301712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd20aa9-1cf7-4d8b-abba-fd94865968e0 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:15.359268 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58677513-0325-4de7-9cf7-d4a30d7c3809 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:15.373201 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:15.401212 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bad18a-45fe-42b0-9ada-abc93fd428eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:15.401877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bad18a-45fe-42b0-9ada-abc93fd428eb None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:15.402173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bad18a-45fe-42b0-9ada-abc93fd428eb None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:15.402453 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bad18a-45fe-42b0-9ada-abc93fd428eb None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:15.403243 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bad18a-45fe-42b0-9ada-abc93fd428eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:15.403557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bad18a-45fe-42b0-9ada-abc93fd428eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:15.405162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bad18a-45fe-42b0-9ada-abc93fd428eb None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:15.414910 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd20aa9-1cf7-4d8b-abba-fd94865968e0 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:15.424130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 433/868] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:42:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:15.425059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bad18a-45fe-42b0-9ada-abc93fd428eb None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:15.435903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:15.460396 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034bd7e-ea9c-4d84-b1c3-71861589efb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:15.461514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034bd7e-ea9c-4d84-b1c3-71861589efb7 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:15.462822 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034bd7e-ea9c-4d84-b1c3-71861589efb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:15.463329 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034bd7e-ea9c-4d84-b1c3-71861589efb7 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:15.464396 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034bd7e-ea9c-4d84-b1c3-71861589efb7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:15.464923 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034bd7e-ea9c-4d84-b1c3-71861589efb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:15.466553 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034bd7e-ea9c-4d84-b1c3-71861589efb7 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:15.475225 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 436/869] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 3 12:42:15 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:15.553056 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bad18a-45fe-42b0-9ada-abc93fd428eb None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:15.592007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7e75b-d380-401a-a41e-559b7b25d242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:15.592649 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7e75b-d380-401a-a41e-559b7b25d242 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:15.592934 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7e75b-d380-401a-a41e-559b7b25d242 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:15.593208 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7e75b-d380-401a-a41e-559b7b25d242 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:15.594014 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7e75b-d380-401a-a41e-559b7b25d242 None admin] RBAC: Adding query filter params (role.id=a6d209169b77456f9f1cc3ff53646cfc, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=5209ec838a4f45d6b746edb27970c93d) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:15.594331 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7e75b-d380-401a-a41e-559b7b25d242 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:15.595829 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7e75b-d380-401a-a41e-559b7b25d242 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:15.603226 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 434/870] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:42:15 2022] GET /identity/v3/role_assignments?user.id=5209ec838a4f45d6b746edb27970c93d&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=a6d209169b77456f9f1cc3ff53646cfc => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:15.935327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445f152-88b8-41a3-8eaa-5bf976698900 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:15.935617 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445f152-88b8-41a3-8eaa-5bf976698900 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:15.935901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445f152-88b8-41a3-8eaa-5bf976698900 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:15.937515 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 437/871] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:15.943308 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb323b-988f-42ec-9f81-8f5939a6ffdf None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:15.943607 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb323b-988f-42ec-9f81-8f5939a6ffdf None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:15.943943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb323b-988f-42ec-9f81-8f5939a6ffdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:15.963546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-8ffb323b-988f-42ec-9f81-8f5939a6ffdf None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:15.964765 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-8ffb323b-988f-42ec-9f81-8f5939a6ffdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:16.037520 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:16.042696 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 435/872] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:16.065845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445f152-88b8-41a3-8eaa-5bf976698900 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:16.173695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445f152-88b8-41a3-8eaa-5bf976698900 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:16.204802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:16.208555 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332afcc-8af3-4e01-9158-836c0a0653f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:16.209175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332afcc-8af3-4e01-9158-836c0a0653f9 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:16.209455 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332afcc-8af3-4e01-9158-836c0a0653f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:16.209732 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332afcc-8af3-4e01-9158-836c0a0653f9 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:16.216166 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332afcc-8af3-4e01-9158-836c0a0653f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:16.216166 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332afcc-8af3-4e01-9158-836c0a0653f9 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:16.289852 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 438/873] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 3 12:42:16 2022] POST /identity/v3/services => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:42:16.978437 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4c618-a50a-49f8-8ddd-d1f4826fddb9 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:16.978975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4c618-a50a-49f8-8ddd-d1f4826fddb9 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:16.979363 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4c618-a50a-49f8-8ddd-d1f4826fddb9 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:16.981038 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 436/874] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:16.986193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7836b8-5653-41ab-8d4a-050419dbd49a None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:16.986486 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7836b8-5653-41ab-8d4a-050419dbd49a None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:16.986784 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7836b8-5653-41ab-8d4a-050419dbd49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:17.005987 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-9d7836b8-5653-41ab-8d4a-050419dbd49a None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:17.007203 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-9d7836b8-5653-41ab-8d4a-050419dbd49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:17.087859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 439/875] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:16 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:17.110134 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4c618-a50a-49f8-8ddd-d1f4826fddb9 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:17.232488 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4c618-a50a-49f8-8ddd-d1f4826fddb9 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:17.269985 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1520e18-9f9a-4324-a4db-d12c35a0181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:17.270630 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1520e18-9f9a-4324-a4db-d12c35a0181b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:17.270945 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1520e18-9f9a-4324-a4db-d12c35a0181b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:17.271346 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1520e18-9f9a-4324-a4db-d12c35a0181b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:17.282266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1520e18-9f9a-4324-a4db-d12c35a0181b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:42:17.287310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-d1520e18-9f9a-4324-a4db-d12c35a0181b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:42:17.287310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:17.287310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:17.287310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:17.287310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:17.287310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:17.287310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:17.287310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:17.287310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:17.287310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:17.287310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:17.287310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:17.287310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:42:17.287310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:42:17.287310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:42:17.287310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:42:17.288254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:42:17.288254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:42:17.288254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:42:17.288254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:42:17.288254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:17.288254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:17.288254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:17.288254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:17.288254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:17.288254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:17.288254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:17.288254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:17.288254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:17.288254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:17.288254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:17.288254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:17.289595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:17.289595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:17.289595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:17.289595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:17.289595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:42:17.289595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:42:17.289595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:42:17.289595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:42:17.289595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:42:17.289595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:42:17.289595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:42:17.289595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:17.289595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 437/876] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 3 12:42:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:17.295803 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7836b8-5653-41ab-8d4a-050419dbd49a None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:17.402094 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7836b8-5653-41ab-8d4a-050419dbd49a None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:17.421113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:17.439452 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25f990-cb2a-4f79-94e4-99174f9b2586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:17.440118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25f990-cb2a-4f79-94e4-99174f9b2586 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:17.440450 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25f990-cb2a-4f79-94e4-99174f9b2586 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:17.440732 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25f990-cb2a-4f79-94e4-99174f9b2586 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:17.442089 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25f990-cb2a-4f79-94e4-99174f9b2586 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:17.442395 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25f990-cb2a-4f79-94e4-99174f9b2586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:17.443793 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25f990-cb2a-4f79-94e4-99174f9b2586 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:17.452472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 440/877] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 3 12:42:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:17.458140 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1520e18-9f9a-4324-a4db-d12c35a0181b None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:17.523178 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:17.570608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1520e18-9f9a-4324-a4db-d12c35a0181b None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:17.593566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1a0fc-e68b-4fce-a560-da0230e5c88d None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:17.593898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1a0fc-e68b-4fce-a560-da0230e5c88d None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:17.594114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1a0fc-e68b-4fce-a560-da0230e5c88d None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:17.595885 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 441/878] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:42:17.601293 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f383160-18fa-48de-bc89-0ee3f8fc8e3e None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:17.601729 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f383160-18fa-48de-bc89-0ee3f8fc8e3e None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:17.602011 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f383160-18fa-48de-bc89-0ee3f8fc8e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:17.607118 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486853c-ec77-4157-a56b-83bc5aa16e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:17.607767 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486853c-ec77-4157-a56b-83bc5aa16e6f None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:17.608080 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486853c-ec77-4157-a56b-83bc5aa16e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:17.608442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486853c-ec77-4157-a56b-83bc5aa16e6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:17.620386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486853c-ec77-4157-a56b-83bc5aa16e6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:17.621097 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-6f383160-18fa-48de-bc89-0ee3f8fc8e3e None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:17.621869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486853c-ec77-4157-a56b-83bc5aa16e6f None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:17.622341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-6f383160-18fa-48de-bc89-0ee3f8fc8e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:17.637284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-6486853c-ec77-4157-a56b-83bc5aa16e6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:17.637284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:17.637284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:17.637284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:17.637284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:17.637284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:17.637284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:17.637284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:17.637284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:17.637284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:17.637284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:17.637284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:17.637284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:17.637284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:17.637284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:17.639409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:17.639409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:17.639409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:17.639409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:17.639409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:17.639409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:17.639409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:17.639409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:17.639409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:17.639409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:17.639409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:17.639409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:17.639409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:17.639409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:17.639409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:17.639409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:17.639409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:17.640638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:17.640638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:17.640638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:17.640638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:17.640638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 438/879] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:17.644624 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486853c-ec77-4157-a56b-83bc5aa16e6f None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:17.715065 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 442/880] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:17 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:17.724973 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f44b7-43b8-4980-be19-033e43c0cf17 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:17.724973 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f44b7-43b8-4980-be19-033e43c0cf17 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:17.725835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f44b7-43b8-4980-be19-033e43c0cf17 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:17.731121 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 443/881] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:42:17.733041 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda2683-3f86-4e08-ace7-63afb1c6f49b None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:17.733332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda2683-3f86-4e08-ace7-63afb1c6f49b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:17.733623 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda2683-3f86-4e08-ace7-63afb1c6f49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:17.752611 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-2dda2683-3f86-4e08-ace7-63afb1c6f49b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:17.753847 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-2dda2683-3f86-4e08-ace7-63afb1c6f49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:17.774369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486853c-ec77-4157-a56b-83bc5aa16e6f None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:17.789724 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:17.812273 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc0431-2286-407c-a2df-4dd488f1639a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:17.813264 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc0431-2286-407c-a2df-4dd488f1639a None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:17.813858 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc0431-2286-407c-a2df-4dd488f1639a None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:17.814347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc0431-2286-407c-a2df-4dd488f1639a None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:17.815300 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc0431-2286-407c-a2df-4dd488f1639a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:17.815902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc0431-2286-407c-a2df-4dd488f1639a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:17.817598 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc0431-2286-407c-a2df-4dd488f1639a None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:17.820874 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 444/882] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:17 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:17.821697 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda2683-3f86-4e08-ace7-63afb1c6f49b None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:17.831366 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 439/883] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:17.841600 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc0431-2286-407c-a2df-4dd488f1639a None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:17.873347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:17.933927 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda2683-3f86-4e08-ace7-63afb1c6f49b None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:17.949549 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc0431-2286-407c-a2df-4dd488f1639a None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:17.969148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbf835-a2fa-47bd-bc31-5644dde90290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:17.969761 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbf835-a2fa-47bd-bc31-5644dde90290 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:17.970039 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbf835-a2fa-47bd-bc31-5644dde90290 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:17.970313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbf835-a2fa-47bd-bc31-5644dde90290 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:17.971031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbf835-a2fa-47bd-bc31-5644dde90290 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:17.972929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbf835-a2fa-47bd-bc31-5644dde90290 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:17.986547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bd08b-879e-4195-acfa-dae0e51d9042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:17.987219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bd08b-879e-4195-acfa-dae0e51d9042 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:17.987576 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bd08b-879e-4195-acfa-dae0e51d9042 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:17.987946 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bd08b-879e-4195-acfa-dae0e51d9042 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:17.995335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11bd08b-879e-4195-acfa-dae0e51d9042 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:17.996782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11bd08b-879e-4195-acfa-dae0e51d9042 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:18.008615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-f11bd08b-879e-4195-acfa-dae0e51d9042 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:42:18.008615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:18.008615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:18.008615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:18.008615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:18.008615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:18.008615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:18.008615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:18.008615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:18.008615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:18.008615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:18.008615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:18.008615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:42:18.008615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:42:18.008615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:42:18.008615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:42:18.015516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:18.015516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:18.015516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:42:18.015516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:18.015516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:42:18.015516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:18.015516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:18.015516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:18.015516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:18.015516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:18.015516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:18.015516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:18.015516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:18.015516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:18.015516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:18.015516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:18.015516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:18.015516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:18.016659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:18.016659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:18.016659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:42:18.016659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:42:18.016659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:42:18.016659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:42:18.016659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:42:18.016659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:42:18.016659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:42:18.016659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:18.016659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 440/884] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 3 12:42:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:18.016659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bd08b-879e-4195-acfa-dae0e51d9042 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:18.038191 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 445/885] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 3 12:42:17 2022] POST /identity/v3/services => generated 269 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:42:18.047863 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbf835-a2fa-47bd-bc31-5644dde90290 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:18.053971 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:18.150968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bd08b-879e-4195-acfa-dae0e51d9042 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:18.197857 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:18.205488 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb7f98-08a2-47aa-b6f7-c9e19f62ffb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:18.207401 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb7f98-08a2-47aa-b6f7-c9e19f62ffb8 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:18.207401 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb7f98-08a2-47aa-b6f7-c9e19f62ffb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:18.207600 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb7f98-08a2-47aa-b6f7-c9e19f62ffb8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:18.208849 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb7f98-08a2-47aa-b6f7-c9e19f62ffb8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:18.209547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb7f98-08a2-47aa-b6f7-c9e19f62ffb8 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:18.212715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbf835-a2fa-47bd-bc31-5644dde90290 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:18.223603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-4dbb7f98-08a2-47aa-b6f7-c9e19f62ffb8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:42:18.223603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:18.223603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:42:18.223603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:42:18.223603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:42:18.223603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:42:18.223603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:42:18.223603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:18.223603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:42:18.223603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:18.223603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:18.223603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:18.223603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:18.223603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:18.223603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:18.223603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:18.223603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:18.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:18.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:18.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:18.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:18.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:18.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:18.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:42:18.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:42:18.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:42:18.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:42:18.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:18.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:18.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:18.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:18.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:18.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:18.225621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:18.225621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:18.225621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:18.225621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:18.225621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:18.225621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:18.225621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:18.225621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:18.225621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:18.225621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:18.225621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:42:18.225621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:18.225621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:42:18.225621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:18.225621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 441/886] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 3 12:42:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:18.233082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb7f98-08a2-47aa-b6f7-c9e19f62ffb8 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:18.253870 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47813e9-b5e2-4388-afb3-6f066b8edc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:18.254802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47813e9-b5e2-4388-afb3-6f066b8edc88 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:18.255096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47813e9-b5e2-4388-afb3-6f066b8edc88 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:18.255382 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47813e9-b5e2-4388-afb3-6f066b8edc88 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:18.256199 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47813e9-b5e2-4388-afb3-6f066b8edc88 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:18.256511 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47813e9-b5e2-4388-afb3-6f066b8edc88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:18.258012 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47813e9-b5e2-4388-afb3-6f066b8edc88 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:18.276636 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 446/887] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 3 12:42:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:18.282366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47813e9-b5e2-4388-afb3-6f066b8edc88 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:18.352699 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:18.361335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb7f98-08a2-47aa-b6f7-c9e19f62ffb8 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:18.389929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47813e9-b5e2-4388-afb3-6f066b8edc88 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:18.397539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5f807-ec9d-4b3e-b589-3f9882d3051b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:18.400259 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5f807-ec9d-4b3e-b589-3f9882d3051b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:18.400259 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5f807-ec9d-4b3e-b589-3f9882d3051b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:18.400259 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5f807-ec9d-4b3e-b589-3f9882d3051b None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:18.400259 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5f807-ec9d-4b3e-b589-3f9882d3051b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:18.400259 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5f807-ec9d-4b3e-b589-3f9882d3051b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:18.401248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5f807-ec9d-4b3e-b589-3f9882d3051b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:18.410764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 442/888] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 3 12:42:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:18.410764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803925b-56fc-4d68-b91e-ff95abdb2f8e None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:18.410764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803925b-56fc-4d68-b91e-ff95abdb2f8e None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:18.410764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803925b-56fc-4d68-b91e-ff95abdb2f8e None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:18.410764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 443/889] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:18.413872 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803925b-56fc-4d68-b91e-ff95abdb2f8e None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:18.436649 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b9882-678f-4c0e-9e37-67174884d3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:18.438267 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b9882-678f-4c0e-9e37-67174884d3ec None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:18.438267 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b9882-678f-4c0e-9e37-67174884d3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:18.438267 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b9882-678f-4c0e-9e37-67174884d3ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:18.467641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:18.516452 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b9882-678f-4c0e-9e37-67174884d3ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:18.517909 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b9882-678f-4c0e-9e37-67174884d3ec None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:18.519096 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803925b-56fc-4d68-b91e-ff95abdb2f8e None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:18.557029 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97749a7b-0f6f-49cf-93d4-4317e1a3a1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:18.557662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97749a7b-0f6f-49cf-93d4-4317e1a3a1fc None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:18.557955 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97749a7b-0f6f-49cf-93d4-4317e1a3a1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:18.558241 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97749a7b-0f6f-49cf-93d4-4317e1a3a1fc None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:18.558959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97749a7b-0f6f-49cf-93d4-4317e1a3a1fc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:18.559274 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97749a7b-0f6f-49cf-93d4-4317e1a3a1fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:18.560652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97749a7b-0f6f-49cf-93d4-4317e1a3a1fc None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:18.565430 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 444/890] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 3 12:42:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:18.567487 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4369c83-bc96-4593-8af4-8031d1df6f68 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:18.567783 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4369c83-bc96-4593-8af4-8031d1df6f68 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:18.568064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4369c83-bc96-4593-8af4-8031d1df6f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:18.590924 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-b4369c83-bc96-4593-8af4-8031d1df6f68 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:18.592521 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b4369c83-bc96-4593-8af4-8031d1df6f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:18.612283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:18.645804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 447/891] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:42:18 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:42:18.652827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b9882-678f-4c0e-9e37-67174884d3ec None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:18.702381 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 445/892] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:18.722160 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:18.726541 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4369c83-bc96-4593-8af4-8031d1df6f68 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:18.772512 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b9882-678f-4c0e-9e37-67174884d3ec None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:18.808328 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f2c10-609f-4d10-8e4c-298d4185c194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:18.808973 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f2c10-609f-4d10-8e4c-298d4185c194 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:18.809262 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f2c10-609f-4d10-8e4c-298d4185c194 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:18.809542 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f2c10-609f-4d10-8e4c-298d4185c194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:18.821470 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f2c10-609f-4d10-8e4c-298d4185c194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:18.822775 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f2c10-609f-4d10-8e4c-298d4185c194 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:18.837428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4369c83-bc96-4593-8af4-8031d1df6f68 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:18.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-ea9f2c10-609f-4d10-8e4c-298d4185c194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:18.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:18.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:18.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:18.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:18.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:18.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:18.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:18.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:18.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:18.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:18.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:18.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:18.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:18.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:18.838651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:18.838651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:18.838651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:18.838651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:18.838651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:18.838651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:18.838651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:18.838651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:18.838651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:18.838651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:18.838651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:18.838651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:18.838651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:18.838651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:18.838651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:18.838651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:18.838651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:18.839554 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:18.839554 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:18.839554 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:18.839554 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:18.839554 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 448/893] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:18.847189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f2c10-609f-4d10-8e4c-298d4185c194 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:18.891999 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32298348-6ce3-44b9-bfa8-cb7792d44b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:18.892576 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32298348-6ce3-44b9-bfa8-cb7792d44b44 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:18.892863 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32298348-6ce3-44b9-bfa8-cb7792d44b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:18.893147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32298348-6ce3-44b9-bfa8-cb7792d44b44 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:18.893793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32298348-6ce3-44b9-bfa8-cb7792d44b44 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:18.895268 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32298348-6ce3-44b9-bfa8-cb7792d44b44 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:18.906787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-32298348-6ce3-44b9-bfa8-cb7792d44b44 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:42:18.906787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:18.906787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:42:18.906787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:42:18.906787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:42:18.906787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:42:18.906787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:42:18.906787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:18.906787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:42:18.906787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:18.906787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:18.906787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:18.906787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:18.906787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:18.906787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:18.906787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:18.906787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:18.907804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:18.907804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:18.907804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:18.907804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:18.907804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:18.907804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:18.907804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:42:18.907804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:42:18.907804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:42:18.907804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:42:18.907804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:18.907804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:18.907804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:18.907804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:18.907804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:18.907804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:18.908680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:18.908680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:18.908680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:18.908680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:18.908680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:18.908680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:18.908680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:18.908680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:18.908680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:18.908680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:18.908680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:42:18.908680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:18.908680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:42:18.908680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:18.908680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 446/894] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:42:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:18.914527 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32298348-6ce3-44b9-bfa8-cb7792d44b44 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:18.934948 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:18.984194 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f2c10-609f-4d10-8e4c-298d4185c194 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:18.994704 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:19.030503 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd4323-9029-46f5-a5fc-a4298f83a639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:19.031448 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd4323-9029-46f5-a5fc-a4298f83a639 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:19.031915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd4323-9029-46f5-a5fc-a4298f83a639 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:19.032953 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd4323-9029-46f5-a5fc-a4298f83a639 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:19.034149 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd4323-9029-46f5-a5fc-a4298f83a639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:19.035211 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd4323-9029-46f5-a5fc-a4298f83a639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:19.037710 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd4323-9029-46f5-a5fc-a4298f83a639 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:19.053395 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32298348-6ce3-44b9-bfa8-cb7792d44b44 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:19.058323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 449/895] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:19.061450 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd4323-9029-46f5-a5fc-a4298f83a639 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:19.098211 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef021497-22a0-4105-bfc0-70d451821450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:19.099183 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef021497-22a0-4105-bfc0-70d451821450 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:19.099482 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef021497-22a0-4105-bfc0-70d451821450 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:19.099766 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef021497-22a0-4105-bfc0-70d451821450 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:19.100727 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef021497-22a0-4105-bfc0-70d451821450 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:19.101049 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef021497-22a0-4105-bfc0-70d451821450 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:19.102599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef021497-22a0-4105-bfc0-70d451821450 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:19.109393 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 447/896] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:42:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:19.115156 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef021497-22a0-4105-bfc0-70d451821450 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:19.185356 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd4323-9029-46f5-a5fc-a4298f83a639 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:19.218325 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:19.230115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad745d5b-667e-4b18-b399-8b3998a45816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:19.231849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad745d5b-667e-4b18-b399-8b3998a45816 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:19.235750 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad745d5b-667e-4b18-b399-8b3998a45816 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:19.235750 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad745d5b-667e-4b18-b399-8b3998a45816 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:19.243352 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad745d5b-667e-4b18-b399-8b3998a45816 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:19.244939 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad745d5b-667e-4b18-b399-8b3998a45816 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:19.245302 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef021497-22a0-4105-bfc0-70d451821450 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:19.261100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-ad745d5b-667e-4b18-b399-8b3998a45816 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:19.261100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:19.261100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:19.261100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:19.261100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:19.261100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:19.261100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:19.261100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:19.261100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:19.261100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:19.261100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:19.261100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:19.261100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:42:19.261100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:42:19.261100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:42:19.262042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:42:19.262042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:19.262042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:19.262042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:19.262042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:19.262042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:19.262042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:19.262042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:19.262042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:19.262042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:19.262042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:19.262042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:19.262042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:19.262042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:19.262042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:19.262042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:19.262042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:19.262997 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:42:19.262997 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:42:19.262997 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:42:19.262997 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:42:19.262997 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:42:19.262997 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:42:19.262997 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:19.262997 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:19.265522 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 450/897] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:42:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:19.270883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad745d5b-667e-4b18-b399-8b3998a45816 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:19.295899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a51191-90e9-4bd7-96fc-3b3a25c21ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:19.296686 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a51191-90e9-4bd7-96fc-3b3a25c21ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:19.297039 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a51191-90e9-4bd7-96fc-3b3a25c21ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:19.297430 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a51191-90e9-4bd7-96fc-3b3a25c21ea9 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:19.298195 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a51191-90e9-4bd7-96fc-3b3a25c21ea9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:19.298578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a51191-90e9-4bd7-96fc-3b3a25c21ea9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:19.300998 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a51191-90e9-4bd7-96fc-3b3a25c21ea9 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:19.303575 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:19.311237 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 448/898] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:42:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:19.319238 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a51191-90e9-4bd7-96fc-3b3a25c21ea9 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:19.415149 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad745d5b-667e-4b18-b399-8b3998a45816 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:19.440743 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a51191-90e9-4bd7-96fc-3b3a25c21ea9 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:19.460549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7cb1a-bbd9-4918-9b7c-472d4cfd1844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:19.461728 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7cb1a-bbd9-4918-9b7c-472d4cfd1844 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:19.462583 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7cb1a-bbd9-4918-9b7c-472d4cfd1844 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:19.463088 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7cb1a-bbd9-4918-9b7c-472d4cfd1844 None admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:19.464031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7cb1a-bbd9-4918-9b7c-472d4cfd1844 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:19.464533 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7cb1a-bbd9-4918-9b7c-472d4cfd1844 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:19.467038 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7cb1a-bbd9-4918-9b7c-472d4cfd1844 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:19.486638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27be1c-9858-4fa1-8216-cda8eff1c3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:19.486638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27be1c-9858-4fa1-8216-cda8eff1c3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:19.486638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27be1c-9858-4fa1-8216-cda8eff1c3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:19.486638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27be1c-9858-4fa1-8216-cda8eff1c3f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:19.487027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27be1c-9858-4fa1-8216-cda8eff1c3f2 None admin] RBAC: Adding query filter params (interface=public, service_id=712b1e5dfb4f456c93b6b7c54c441ac2, region_id=RegionOne) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:19.487027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27be1c-9858-4fa1-8216-cda8eff1c3f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:19.487632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 451/899] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:42:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:19.488848 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27be1c-9858-4fa1-8216-cda8eff1c3f2 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:19.489389 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7cb1a-bbd9-4918-9b7c-472d4cfd1844 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:19.497985 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 449/900] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 3 12:42:19 2022] GET /identity/v3/endpoints?service_id=712b1e5dfb4f456c93b6b7c54c441ac2&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:19.504145 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27be1c-9858-4fa1-8216-cda8eff1c3f2 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:19.515358 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:19.599339 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:19.618770 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7cb1a-bbd9-4918-9b7c-472d4cfd1844 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:19.627207 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27be1c-9858-4fa1-8216-cda8eff1c3f2 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:19.666776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3131fcf-0116-4d48-b1e1-adf39d847188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:19.667746 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3131fcf-0116-4d48-b1e1-adf39d847188 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:19.668251 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3131fcf-0116-4d48-b1e1-adf39d847188 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:19.668592 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9151a-ac96-426e-a46d-3f5119b46793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:19.668979 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3131fcf-0116-4d48-b1e1-adf39d847188 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:19.669275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9151a-ac96-426e-a46d-3f5119b46793 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:19.669562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9151a-ac96-426e-a46d-3f5119b46793 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:19.669840 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9151a-ac96-426e-a46d-3f5119b46793 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:19.670504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9151a-ac96-426e-a46d-3f5119b46793 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:19.670804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3131fcf-0116-4d48-b1e1-adf39d847188 None admin] RBAC: Adding query filter params (role.id=68aa1e11e519409289c25ac896f855aa, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=b9d70abf4f754530a3cf6efa7a782736) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:19.671325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3131fcf-0116-4d48-b1e1-adf39d847188 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:19.671938 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9151a-ac96-426e-a46d-3f5119b46793 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:19.673468 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3131fcf-0116-4d48-b1e1-adf39d847188 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:19.687108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 450/902] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 3 12:42:19 2022] GET /identity/v3/services => generated 1268 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:42:19.687463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 452/902] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:42:19 2022] GET /identity/v3/role_assignments?user.id=b9d70abf4f754530a3cf6efa7a782736&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=68aa1e11e519409289c25ac896f855aa => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:20.124923 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6690cc-28a1-4128-ba52-a23ed45e57da None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:20.125321 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6690cc-28a1-4128-ba52-a23ed45e57da None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:20.125499 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6690cc-28a1-4128-ba52-a23ed45e57da None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:20.126961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 451/903] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:20.132543 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80501c32-2497-4be2-a86a-b68fe2e9055e None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:20.133104 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80501c32-2497-4be2-a86a-b68fe2e9055e None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:20.133587 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80501c32-2497-4be2-a86a-b68fe2e9055e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:20.166625 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-80501c32-2497-4be2-a86a-b68fe2e9055e None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:20.168144 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-80501c32-2497-4be2-a86a-b68fe2e9055e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:20.242834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 453/904] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:20.259811 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6690cc-28a1-4128-ba52-a23ed45e57da None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:20.332713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:20.365447 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6690cc-28a1-4128-ba52-a23ed45e57da None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:20.401736 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a76fd-2896-4d7c-8aa4-67310d482c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:20.402812 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a76fd-2896-4d7c-8aa4-67310d482c8b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:20.403301 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a76fd-2896-4d7c-8aa4-67310d482c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:20.403793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a76fd-2896-4d7c-8aa4-67310d482c8b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:20.404626 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a76fd-2896-4d7c-8aa4-67310d482c8b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:20.406234 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a76fd-2896-4d7c-8aa4-67310d482c8b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:20.416162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-046a76fd-2896-4d7c-8aa4-67310d482c8b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:42:20.416162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:20.416162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:42:20.416162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:42:20.416162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:42:20.416162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:42:20.416162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:42:20.416162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:20.416162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:42:20.416162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:20.416162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:20.416162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:20.416162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:20.416162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:20.416162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:20.416162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:20.417135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:20.417135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:20.417135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:20.417135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:20.417135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:20.417135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:20.417135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:20.417135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:42:20.417135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:42:20.417135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:42:20.417135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:42:20.417135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:20.417135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:20.417135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:20.417135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:20.417135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:20.418003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:20.418003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:20.418003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:20.418003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:20.418003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:20.418003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:20.418003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:20.418003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:20.418003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:20.418003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:20.418003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:20.418003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:42:20.418003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:20.418003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:42:20.418003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:20.424678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 452/905] 10.222.0.64 () {56 vars in 1132 bytes} [Wed Aug 3 12:42:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:20.427884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80501c32-2497-4be2-a86a-b68fe2e9055e None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:20.510842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:20.532817 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80501c32-2497-4be2-a86a-b68fe2e9055e None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:20.569731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857593d-5152-4fc2-9268-941c3a567903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:20.570350 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857593d-5152-4fc2-9268-941c3a567903 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:20.570630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857593d-5152-4fc2-9268-941c3a567903 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:20.570925 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857593d-5152-4fc2-9268-941c3a567903 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:20.571605 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857593d-5152-4fc2-9268-941c3a567903 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:20.571910 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857593d-5152-4fc2-9268-941c3a567903 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:20.573318 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857593d-5152-4fc2-9268-941c3a567903 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:20.578314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 454/906] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 3 12:42:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:20.584574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a76fd-2896-4d7c-8aa4-67310d482c8b None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:20.617227 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5702b72-b2d6-4048-884f-78906f0df44f None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:20.617547 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5702b72-b2d6-4048-884f-78906f0df44f None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:20.617829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5702b72-b2d6-4048-884f-78906f0df44f None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:20.619459 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 455/907] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:42:20.624195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d0f73-0c32-4cd5-a16e-c790e4230417 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:20.624492 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d0f73-0c32-4cd5-a16e-c790e4230417 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:20.624773 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d0f73-0c32-4cd5-a16e-c790e4230417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:20.643590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-b93d0f73-0c32-4cd5-a16e-c790e4230417 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:20.645342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b93d0f73-0c32-4cd5-a16e-c790e4230417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:20.691482 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a76fd-2896-4d7c-8aa4-67310d482c8b None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:20.737306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 456/908] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:20.740801 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc697bd4-3d13-400b-b6a1-f0b68ed82fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:20.741437 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc697bd4-3d13-400b-b6a1-f0b68ed82fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:20.741720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc697bd4-3d13-400b-b6a1-f0b68ed82fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:20.741998 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc697bd4-3d13-400b-b6a1-f0b68ed82fb9 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:20.742752 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc697bd4-3d13-400b-b6a1-f0b68ed82fb9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:20.743081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc697bd4-3d13-400b-b6a1-f0b68ed82fb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:20.744517 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc697bd4-3d13-400b-b6a1-f0b68ed82fb9 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:20.745890 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:20.751179 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 453/909] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 3 12:42:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:20.761004 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d0f73-0c32-4cd5-a16e-c790e4230417 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:20.762124 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc697bd4-3d13-400b-b6a1-f0b68ed82fb9 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:20.854015 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:20.882098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d0f73-0c32-4cd5-a16e-c790e4230417 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:20.888240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc697bd4-3d13-400b-b6a1-f0b68ed82fb9 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:20.926504 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc437d7-24ad-4f6d-9978-2b5613d9da27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:20.927641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc437d7-24ad-4f6d-9978-2b5613d9da27 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:20.928220 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc437d7-24ad-4f6d-9978-2b5613d9da27 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:20.928679 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc437d7-24ad-4f6d-9978-2b5613d9da27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:20.929101 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187d17e-34e3-4d7c-9bd7-e4f037570b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:20.929806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187d17e-34e3-4d7c-9bd7-e4f037570b16 None admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:20.930140 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc437d7-24ad-4f6d-9978-2b5613d9da27 None admin] RBAC: Adding query filter params (interface=public, service_id=5f16d69fdc8c4f24bb481098822fabc4, region_id=RegionOne) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:20.930246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187d17e-34e3-4d7c-9bd7-e4f037570b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:20.930479 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187d17e-34e3-4d7c-9bd7-e4f037570b16 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:20.930938 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc437d7-24ad-4f6d-9978-2b5613d9da27 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:20.931325 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187d17e-34e3-4d7c-9bd7-e4f037570b16 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:20.932720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc437d7-24ad-4f6d-9978-2b5613d9da27 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:20.932839 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187d17e-34e3-4d7c-9bd7-e4f037570b16 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:20.939074 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 457/910] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 3 12:42:20 2022] GET /identity/v3/endpoints?service_id=5f16d69fdc8c4f24bb481098822fabc4&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:20.945014 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc437d7-24ad-4f6d-9978-2b5613d9da27 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:21.016534 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 454/911] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 3 12:42:20 2022] POST /identity/v3/services => generated 241 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:42:21.063970 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc437d7-24ad-4f6d-9978-2b5613d9da27 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:21.110609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44e747-ca74-49c8-bcf3-1583d25d1527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:21.111627 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44e747-ca74-49c8-bcf3-1583d25d1527 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:21.112114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44e747-ca74-49c8-bcf3-1583d25d1527 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:21.113140 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44e747-ca74-49c8-bcf3-1583d25d1527 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:21.114010 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44e747-ca74-49c8-bcf3-1583d25d1527 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:21.115620 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44e747-ca74-49c8-bcf3-1583d25d1527 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:21.117055 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:21.130943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 458/912] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 3 12:42:20 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:42:21.831530 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e0ea7-9a6f-45dc-905e-9ef1c7bc8784 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:21.832048 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e0ea7-9a6f-45dc-905e-9ef1c7bc8784 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:21.832125 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e0ea7-9a6f-45dc-905e-9ef1c7bc8784 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:21.833695 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 455/913] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:21.838821 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae55857-fe83-492b-949d-b50535676134 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:21.839240 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae55857-fe83-492b-949d-b50535676134 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:21.839438 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae55857-fe83-492b-949d-b50535676134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:21.843401 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76e70c-786f-477e-abdc-74b897fff902 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:21.843693 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76e70c-786f-477e-abdc-74b897fff902 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:21.843975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76e70c-786f-477e-abdc-74b897fff902 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:21.845528 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 456/914] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:21.850365 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f69ca7-b559-4794-9266-420e5ce64657 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:21.850653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f69ca7-b559-4794-9266-420e5ce64657 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:21.850980 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f69ca7-b559-4794-9266-420e5ce64657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:21.859271 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-3ae55857-fe83-492b-949d-b50535676134 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:21.860644 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-3ae55857-fe83-492b-949d-b50535676134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:21.873850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-47f69ca7-b559-4794-9266-420e5ce64657 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:21.875163 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-47f69ca7-b559-4794-9266-420e5ce64657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:21.931164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:21.946018 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 459/916] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:21.954790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 457/916] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:21.967916 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae55857-fe83-492b-949d-b50535676134 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:21.968546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f69ca7-b559-4794-9266-420e5ce64657 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:22.073348 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae55857-fe83-492b-949d-b50535676134 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:22.093115 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f69ca7-b559-4794-9266-420e5ce64657 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:22.102723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:22.110972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7df9a1-78e9-444c-a18b-1442c56dff1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:22.113528 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7df9a1-78e9-444c-a18b-1442c56dff1f None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:22.113528 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7df9a1-78e9-444c-a18b-1442c56dff1f None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:22.113528 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7df9a1-78e9-444c-a18b-1442c56dff1f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:22.113741 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7df9a1-78e9-444c-a18b-1442c56dff1f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:22.115091 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7df9a1-78e9-444c-a18b-1442c56dff1f None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:22.124720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-8e7df9a1-78e9-444c-a18b-1442c56dff1f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:42:22.124720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:22.124720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:42:22.124720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:42:22.124720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:42:22.124720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:42:22.124720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:42:22.124720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:22.124720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:42:22.124720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:22.124720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:22.124720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:22.124720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:22.124720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:22.124720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:22.124720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:22.124720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:22.125695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:22.125695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:22.125695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:22.125695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:22.125695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:22.125695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:22.125695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:42:22.125695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:42:22.125695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:42:22.125695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:42:22.125695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:22.125695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:22.125695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:22.125695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:22.125695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:22.125695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:22.126527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:22.126527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:22.126527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:22.126527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:22.126527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:22.126527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:22.126527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:22.126527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:22.126527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:22.126527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:22.126527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:42:22.126527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:22.126527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:42:22.126527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:22.130855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 460/917] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:42:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:22.131813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7df9a1-78e9-444c-a18b-1442c56dff1f None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:22.137565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4ae4d-d862-4f56-954a-25ef6cf6575a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:22.138299 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4ae4d-d862-4f56-954a-25ef6cf6575a None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:22.138663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4ae4d-d862-4f56-954a-25ef6cf6575a None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:22.139035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4ae4d-d862-4f56-954a-25ef6cf6575a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:22.153248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4ae4d-d862-4f56-954a-25ef6cf6575a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:42:22.163441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-f5b4ae4d-d862-4f56-954a-25ef6cf6575a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:42:22.163441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:22.163441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:22.163441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:22.163441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:22.163441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:22.163441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:22.163441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:22.163441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:22.163441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:22.163441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:22.163441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:22.163441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:42:22.163441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:42:22.163441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:42:22.163441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:42:22.164627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:42:22.164627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:42:22.164627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:42:22.164627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:42:22.164627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:22.164627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:22.164627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:22.164627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:22.164627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:22.164627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:22.164627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:22.164627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:22.164627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:22.164627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:22.164627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:22.164627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:22.165442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:22.165442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:22.165442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:22.165442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:22.165442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:42:22.165442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:42:22.165442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:42:22.165442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:42:22.165442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:42:22.165442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:42:22.165442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:42:22.165442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:22.166921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 458/918] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 3 12:42:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:22.168822 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4ae4d-d862-4f56-954a-25ef6cf6575a None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:22.232959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:22.262861 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7df9a1-78e9-444c-a18b-1442c56dff1f None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:22.286505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4ae4d-d862-4f56-954a-25ef6cf6575a None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:22.309724 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11008b72-f31d-4b70-91d0-9b04e14e79ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:22.311100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11008b72-f31d-4b70-91d0-9b04e14e79ba None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:22.311634 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11008b72-f31d-4b70-91d0-9b04e14e79ba None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:22.312315 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11008b72-f31d-4b70-91d0-9b04e14e79ba None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:22.313666 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11008b72-f31d-4b70-91d0-9b04e14e79ba None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:22.314447 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11008b72-f31d-4b70-91d0-9b04e14e79ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:22.316624 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11008b72-f31d-4b70-91d0-9b04e14e79ba None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:22.324030 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adee45b-4ea1-4941-a504-6461ba59d33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:22.324322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 461/919] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:42:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:22.329089 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adee45b-4ea1-4941-a504-6461ba59d33c None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:22.329381 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adee45b-4ea1-4941-a504-6461ba59d33c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:22.329659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adee45b-4ea1-4941-a504-6461ba59d33c None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:22.330389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adee45b-4ea1-4941-a504-6461ba59d33c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:22.330648 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11008b72-f31d-4b70-91d0-9b04e14e79ba None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:22.330872 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adee45b-4ea1-4941-a504-6461ba59d33c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:22.332320 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adee45b-4ea1-4941-a504-6461ba59d33c None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:22.345512 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 459/920] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 3 12:42:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:22.348288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adee45b-4ea1-4941-a504-6461ba59d33c None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:22.398425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:22.446797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11008b72-f31d-4b70-91d0-9b04e14e79ba None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:22.484691 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad7ddd-b211-42d1-b4d3-caf208c4d406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:22.485356 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adee45b-4ea1-4941-a504-6461ba59d33c None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:22.485508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad7ddd-b211-42d1-b4d3-caf208c4d406 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:22.485887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad7ddd-b211-42d1-b4d3-caf208c4d406 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:22.486256 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad7ddd-b211-42d1-b4d3-caf208c4d406 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:22.487076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad7ddd-b211-42d1-b4d3-caf208c4d406 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:22.487613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad7ddd-b211-42d1-b4d3-caf208c4d406 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:22.489201 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad7ddd-b211-42d1-b4d3-caf208c4d406 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:22.499088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:22.500139 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 462/921] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Aug 3 12:42:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:22.501755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad7ddd-b211-42d1-b4d3-caf208c4d406 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:22.529986 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc631acb-6703-43de-b5b5-b50872112100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:22.531188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc631acb-6703-43de-b5b5-b50872112100 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:22.531627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc631acb-6703-43de-b5b5-b50872112100 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:22.532304 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc631acb-6703-43de-b5b5-b50872112100 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:22.547647 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc631acb-6703-43de-b5b5-b50872112100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:22.549750 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc631acb-6703-43de-b5b5-b50872112100 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:22.570084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-dc631acb-6703-43de-b5b5-b50872112100 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:22.570084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:22.570084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:22.570084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:22.570084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:22.570084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:22.570084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:22.570084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:22.570084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:22.570084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:22.570084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:22.570084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:22.570084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:22.570084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:22.570084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:22.571231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:22.571231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:22.571231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:22.571231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:22.571231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:22.571231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:22.571231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:22.571231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:22.571231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:22.571231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:22.571231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:22.571231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:22.571231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:22.571231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:22.571231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:22.571231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:22.571231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:22.572410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:22.572410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:22.572410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:22.572410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:22.579542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 460/922] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:22.580115 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc631acb-6703-43de-b5b5-b50872112100 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:22.628613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad7ddd-b211-42d1-b4d3-caf208c4d406 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:22.656108 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:22.675183 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb820862-d73c-42e9-9939-b21f4d305717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:22.676217 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb820862-d73c-42e9-9939-b21f4d305717 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:22.676655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb820862-d73c-42e9-9939-b21f4d305717 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:22.677259 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb820862-d73c-42e9-9939-b21f4d305717 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:22.678502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb820862-d73c-42e9-9939-b21f4d305717 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:22.680460 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb820862-d73c-42e9-9939-b21f4d305717 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:22.687205 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc631acb-6703-43de-b5b5-b50872112100 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:22.724036 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcb38c-9882-4daa-8cad-8cd10c815d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:22.724790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcb38c-9882-4daa-8cad-8cd10c815d85 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:22.725141 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcb38c-9882-4daa-8cad-8cd10c815d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:22.725480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcb38c-9882-4daa-8cad-8cd10c815d85 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:22.726233 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcb38c-9882-4daa-8cad-8cd10c815d85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:22.726603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcb38c-9882-4daa-8cad-8cd10c815d85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:22.728156 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcb38c-9882-4daa-8cad-8cd10c815d85 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:22.745963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 461/923] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:22.747272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcb38c-9882-4daa-8cad-8cd10c815d85 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:22.757634 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 463/924] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:42:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:42:22.779335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:22.872324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcb38c-9882-4daa-8cad-8cd10c815d85 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:22.920024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90b17e-ee33-4252-b1d4-f3e0ca19148c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:22.920962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90b17e-ee33-4252-b1d4-f3e0ca19148c None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:22.921252 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90b17e-ee33-4252-b1d4-f3e0ca19148c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:22.921534 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90b17e-ee33-4252-b1d4-f3e0ca19148c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:22.929380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90b17e-ee33-4252-b1d4-f3e0ca19148c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:22.930883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90b17e-ee33-4252-b1d4-f3e0ca19148c None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:22.943608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-ab90b17e-ee33-4252-b1d4-f3e0ca19148c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:42:22.943608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:22.943608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:22.943608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:22.943608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:22.943608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:22.943608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:22.943608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:22.943608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:22.943608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:22.943608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:22.943608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:22.943608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:42:22.943608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:42:22.943608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:42:22.943608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:42:22.944542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:22.944542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:22.944542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:42:22.944542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:22.944542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:42:22.944542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:22.944542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:22.944542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:22.944542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:22.944542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:22.944542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:22.944542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:22.944542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:22.944542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:22.944542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:22.944542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:22.944542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:22.944542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:22.945495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:22.945495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:22.945495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:42:22.945495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:42:22.945495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:42:22.945495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:42:22.945495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:42:22.945495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:42:22.945495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:42:22.945495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:22.945495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 462/925] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 3 12:42:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:22.950786 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb820862-d73c-42e9-9939-b21f4d305717 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:23.059050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb820862-d73c-42e9-9939-b21f4d305717 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:23.078577 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd3245-cc5c-4b40-950a-e4d2bd01259a None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:23.078909 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd3245-cc5c-4b40-950a-e4d2bd01259a None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:23.079169 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd3245-cc5c-4b40-950a-e4d2bd01259a None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:23.080825 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 463/926] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:42:23.088361 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb2cc5-8845-4d62-9ac9-c8b3bb1d7e13 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:23.088643 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb2cc5-8845-4d62-9ac9-c8b3bb1d7e13 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:23.088915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb2cc5-8845-4d62-9ac9-c8b3bb1d7e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:23.098602 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900f28b-0e91-4962-b60d-07fe974e45f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:23.099256 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900f28b-0e91-4962-b60d-07fe974e45f6 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:23.099544 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900f28b-0e91-4962-b60d-07fe974e45f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:23.099828 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900f28b-0e91-4962-b60d-07fe974e45f6 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:23.100625 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900f28b-0e91-4962-b60d-07fe974e45f6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:23.100939 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900f28b-0e91-4962-b60d-07fe974e45f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:23.102363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900f28b-0e91-4962-b60d-07fe974e45f6 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:23.121262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-23bb2cc5-8845-4d62-9ac9-c8b3bb1d7e13 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:23.121468 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 464/927] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 3 12:42:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:23.123043 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-23bb2cc5-8845-4d62-9ac9-c8b3bb1d7e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:23.126979 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900f28b-0e91-4962-b60d-07fe974e45f6 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:23.166796 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:23.223071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 464/928] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:23.224281 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a0d19-1b68-43cc-a2c7-8b68b9bfd5ae None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:23.224574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a0d19-1b68-43cc-a2c7-8b68b9bfd5ae None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:23.224853 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a0d19-1b68-43cc-a2c7-8b68b9bfd5ae None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:23.229924 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 465/929] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:23.231415 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d64c8b-5d43-4afc-8e78-d499317edd77 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:23.231710 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d64c8b-5d43-4afc-8e78-d499317edd77 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:23.231995 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d64c8b-5d43-4afc-8e78-d499317edd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:23.249893 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-f4d64c8b-5d43-4afc-8e78-d499317edd77 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:23.251129 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-f4d64c8b-5d43-4afc-8e78-d499317edd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:23.252433 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900f28b-0e91-4962-b60d-07fe974e45f6 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:23.253381 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:23.292471 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82e105-071f-491b-a0f1-a1ebb201f572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:23.293779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82e105-071f-491b-a0f1-a1ebb201f572 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:23.294463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82e105-071f-491b-a0f1-a1ebb201f572 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:23.295033 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82e105-071f-491b-a0f1-a1ebb201f572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:23.307445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82e105-071f-491b-a0f1-a1ebb201f572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:23.308945 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82e105-071f-491b-a0f1-a1ebb201f572 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:23.324016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-0f82e105-071f-491b-a0f1-a1ebb201f572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:23.324016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:23.324016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:23.324016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:23.324016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:23.324016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:23.324016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:23.324016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:23.324016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:23.324016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:23.324016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:23.324016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:23.324016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:23.324016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:23.324016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:23.324959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:23.324959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:23.324959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:23.324959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:23.324959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:23.324959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:23.324959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:23.324959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:23.324959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:23.324959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:23.324959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:23.324959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:23.324959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:23.324959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:23.324959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:23.324959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:23.324959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:23.325836 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:23.325836 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:23.325836 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:23.325836 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:23.325836 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 465/930] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:23.326126 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82e105-071f-491b-a0f1-a1ebb201f572 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:23.332830 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 466/931] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:23.333553 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d64c8b-5d43-4afc-8e78-d499317edd77 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:23.432066 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:23.440810 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d64c8b-5d43-4afc-8e78-d499317edd77 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:23.448662 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82e105-071f-491b-a0f1-a1ebb201f572 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:23.477063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990af13-49ab-4dc5-b189-7539bc9ef563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:23.477603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990af13-49ab-4dc5-b189-7539bc9ef563 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:23.477896 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990af13-49ab-4dc5-b189-7539bc9ef563 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:23.478165 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990af13-49ab-4dc5-b189-7539bc9ef563 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:23.478898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990af13-49ab-4dc5-b189-7539bc9ef563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:23.479209 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990af13-49ab-4dc5-b189-7539bc9ef563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:23.480586 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990af13-49ab-4dc5-b189-7539bc9ef563 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:23.486907 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931fbbd-8ac8-4a97-bfa5-82f414ef73cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:23.487583 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931fbbd-8ac8-4a97-bfa5-82f414ef73cf None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:23.487873 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931fbbd-8ac8-4a97-bfa5-82f414ef73cf None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:23.488153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931fbbd-8ac8-4a97-bfa5-82f414ef73cf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:23.488784 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931fbbd-8ac8-4a97-bfa5-82f414ef73cf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:23.489678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:23.490185 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931fbbd-8ac8-4a97-bfa5-82f414ef73cf None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:23.493613 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 467/932] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:23.494389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990af13-49ab-4dc5-b189-7539bc9ef563 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:23.503926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-9931fbbd-8ac8-4a97-bfa5-82f414ef73cf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:42:23.503926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:23.503926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:42:23.503926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:42:23.503926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:42:23.503926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:42:23.503926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:42:23.503926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:23.503926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:42:23.503926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:23.503926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:23.503926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:23.503926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:23.503926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:23.503926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:23.503926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:23.503926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:23.504966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:23.504966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:23.504966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:23.504966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:23.504966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:23.504966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:23.504966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:42:23.504966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:42:23.504966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:42:23.504966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:42:23.504966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:23.504966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:23.504966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:23.504966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:23.504966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:23.504966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:23.505829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:23.505829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:23.505829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:23.505829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:23.505829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:23.505829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:23.505829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:23.505829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:23.505829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:23.505829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:23.505829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:42:23.505829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:23.505829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:42:23.505829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:23.505829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 466/933] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 3 12:42:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:23.506654 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931fbbd-8ac8-4a97-bfa5-82f414ef73cf None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:23.606085 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990af13-49ab-4dc5-b189-7539bc9ef563 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:23.615259 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931fbbd-8ac8-4a97-bfa5-82f414ef73cf None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:23.641945 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1424f-f91f-4bc1-92f9-724c4106f618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:23.642590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1424f-f91f-4bc1-92f9-724c4106f618 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:23.642908 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1424f-f91f-4bc1-92f9-724c4106f618 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:23.643178 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1424f-f91f-4bc1-92f9-724c4106f618 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:23.643845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1424f-f91f-4bc1-92f9-724c4106f618 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:23.645206 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1424f-f91f-4bc1-92f9-724c4106f618 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:23.651048 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e417b-55d7-4d7d-84dc-4aa6456df669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:23.651792 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e417b-55d7-4d7d-84dc-4aa6456df669 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:23.652192 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e417b-55d7-4d7d-84dc-4aa6456df669 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:23.652569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e417b-55d7-4d7d-84dc-4aa6456df669 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:23.654574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-9ec1424f-f91f-4bc1-92f9-724c4106f618 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:42:23.654574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:23.654574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:42:23.654574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:42:23.654574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:42:23.654574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:42:23.654574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:42:23.654574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:23.654574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:42:23.654574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:23.654574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:23.654574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:23.654574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:23.654574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:23.654574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:23.654574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:23.655713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:23.655713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:23.655713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:23.655713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:23.655713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:23.655713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:23.655713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:23.655713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:42:23.655713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:42:23.655713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:42:23.655713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:42:23.655713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:23.655713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:23.655713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:23.655713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:23.655713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:23.656740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:23.656740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:23.656740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:23.656740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:23.656740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:23.656740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:23.656740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:23.656740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:23.656740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:23.656740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:23.656740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:23.656740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:42:23.656740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:23.656740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:42:23.656740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:23.656740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 468/934] 10.222.0.64 () {56 vars in 1132 bytes} [Wed Aug 3 12:42:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:23.657775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1424f-f91f-4bc1-92f9-724c4106f618 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:23.662785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e417b-55d7-4d7d-84dc-4aa6456df669 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:23.664504 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e417b-55d7-4d7d-84dc-4aa6456df669 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:23.679254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-f24e417b-55d7-4d7d-84dc-4aa6456df669 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:23.679254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:23.679254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:23.679254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:23.679254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:23.679254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:23.679254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:23.679254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:23.679254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:23.679254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:23.679254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:23.679254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:23.679254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:42:23.679254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:42:23.679254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:42:23.680128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:42:23.680128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:23.680128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:23.680128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:23.680128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:23.680128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:23.680128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:23.680128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:23.680128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:23.680128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:23.680128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:23.680128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:23.680128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:23.680128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:23.680128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:23.680128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:23.680128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:23.681003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:42:23.681003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:42:23.681003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:42:23.681003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:42:23.681003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:42:23.681003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:42:23.681003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:23.681003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:23.682070 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 467/935] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:42:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:23.682070 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e417b-55d7-4d7d-84dc-4aa6456df669 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:23.698067 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:23.728429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:23.766869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1424f-f91f-4bc1-92f9-724c4106f618 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:23.795914 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e417b-55d7-4d7d-84dc-4aa6456df669 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:23.806242 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a6808-9f9d-4226-a780-b0e33cde1f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:23.806593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a6808-9f9d-4226-a780-b0e33cde1f8e None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:23.806907 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a6808-9f9d-4226-a780-b0e33cde1f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:23.807183 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a6808-9f9d-4226-a780-b0e33cde1f8e None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:23.807866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a6808-9f9d-4226-a780-b0e33cde1f8e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:23.808171 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a6808-9f9d-4226-a780-b0e33cde1f8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:23.809538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a6808-9f9d-4226-a780-b0e33cde1f8e None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:23.814790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 469/936] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 3 12:42:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:23.815216 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a6808-9f9d-4226-a780-b0e33cde1f8e None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:23.841256 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6349e6-d9b3-4447-8c5c-296657753725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:23.841874 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6349e6-d9b3-4447-8c5c-296657753725 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:23.842154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6349e6-d9b3-4447-8c5c-296657753725 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:23.842439 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6349e6-d9b3-4447-8c5c-296657753725 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:23.843171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6349e6-d9b3-4447-8c5c-296657753725 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:23.843476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6349e6-d9b3-4447-8c5c-296657753725 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:23.844859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6349e6-d9b3-4447-8c5c-296657753725 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:23.850752 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 468/937] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 3 12:42:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:23.851381 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6349e6-d9b3-4447-8c5c-296657753725 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:23.926199 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a6808-9f9d-4226-a780-b0e33cde1f8e None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:23.927713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:23.953782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6349e6-d9b3-4447-8c5c-296657753725 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:23.954369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:23.964030 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8804d51-88e5-4bc3-91c0-71d9fd9e4d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:23.964886 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8804d51-88e5-4bc3-91c0-71d9fd9e4d5c None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:23.965174 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8804d51-88e5-4bc3-91c0-71d9fd9e4d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:23.965476 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8804d51-88e5-4bc3-91c0-71d9fd9e4d5c None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:23.966276 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8804d51-88e5-4bc3-91c0-71d9fd9e4d5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:23.966603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8804d51-88e5-4bc3-91c0-71d9fd9e4d5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:23.968153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8804d51-88e5-4bc3-91c0-71d9fd9e4d5c None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:23.981969 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 470/938] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:42:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:23.983079 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8804d51-88e5-4bc3-91c0-71d9fd9e4d5c None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:23.996997 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0be45a-74a7-4fde-ab90-5f78d88282a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:23.997722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0be45a-74a7-4fde-ab90-5f78d88282a7 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:23.997912 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0be45a-74a7-4fde-ab90-5f78d88282a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:23.998191 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0be45a-74a7-4fde-ab90-5f78d88282a7 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:23.998914 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0be45a-74a7-4fde-ab90-5f78d88282a7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:23.999228 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0be45a-74a7-4fde-ab90-5f78d88282a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:24.000601 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0be45a-74a7-4fde-ab90-5f78d88282a7 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:24.010251 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 469/939] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 3 12:42:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:24.010251 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0be45a-74a7-4fde-ab90-5f78d88282a7 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:24.092796 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8804d51-88e5-4bc3-91c0-71d9fd9e4d5c None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:24.116159 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0be45a-74a7-4fde-ab90-5f78d88282a7 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:24.127606 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626c3a9-d2d0-4151-a58a-013420458430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:24.128249 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626c3a9-d2d0-4151-a58a-013420458430 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:24.128533 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626c3a9-d2d0-4151-a58a-013420458430 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:24.128813 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626c3a9-d2d0-4151-a58a-013420458430 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:24.129487 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626c3a9-d2d0-4151-a58a-013420458430 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:24.129794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626c3a9-d2d0-4151-a58a-013420458430 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:24.131196 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626c3a9-d2d0-4151-a58a-013420458430 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:24.140506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 471/940] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 3 12:42:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:24.140506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626c3a9-d2d0-4151-a58a-013420458430 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:24.161461 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c44a7-585b-42da-88d7-86d8ba0ed09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:24.162234 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c44a7-585b-42da-88d7-86d8ba0ed09f None admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:24.162579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c44a7-585b-42da-88d7-86d8ba0ed09f None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:24.162958 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c44a7-585b-42da-88d7-86d8ba0ed09f None admin] PATH_INFO: `/v3/projects/020d395e82f0448f95789a896703ce98/users/b9d70abf4f754530a3cf6efa7a782736/roles/68aa1e11e519409289c25ac896f855aa` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:24.165430 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c44a7-585b-42da-88d7-86d8ba0ed09f None admin] RBAC: Authorizing `identity:create_grant(project_id=020d395e82f0448f95789a896703ce98, user_id=b9d70abf4f754530a3cf6efa7a782736, role_id=68aa1e11e519409289c25ac896f855aa)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:24.166890 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c44a7-585b-42da-88d7-86d8ba0ed09f None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:24.196997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:24.220139 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:24.234854 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 470/941] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:42:24 2022] PUT /identity/v3/projects/020d395e82f0448f95789a896703ce98/users/b9d70abf4f754530a3cf6efa7a782736/roles/68aa1e11e519409289c25ac896f855aa => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:42:24.234854 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c44a7-585b-42da-88d7-86d8ba0ed09f None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:24.258173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626c3a9-d2d0-4151-a58a-013420458430 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:24.298811 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29f3d3-edae-4cd4-a582-400421dcb2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:24.299559 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29f3d3-edae-4cd4-a582-400421dcb2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:24.299983 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29f3d3-edae-4cd4-a582-400421dcb2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:24.300329 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29f3d3-edae-4cd4-a582-400421dcb2e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:24.301179 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29f3d3-edae-4cd4-a582-400421dcb2e1 None admin] RBAC: Adding query filter params (interface=public, service_id=c8f41697f81d4078ba8ec48e0b380e62, region_id=RegionOne) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:24.301564 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29f3d3-edae-4cd4-a582-400421dcb2e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:24.303124 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29f3d3-edae-4cd4-a582-400421dcb2e1 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:24.309617 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 472/942] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 3 12:42:24 2022] GET /identity/v3/endpoints?service_id=c8f41697f81d4078ba8ec48e0b380e62&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:24.319829 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29f3d3-edae-4cd4-a582-400421dcb2e1 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:24.369559 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c44a7-585b-42da-88d7-86d8ba0ed09f None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:24.412687 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5592c18-9823-4326-8680-97952ceedc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:24.413322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5592c18-9823-4326-8680-97952ceedc65 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:24.413611 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5592c18-9823-4326-8680-97952ceedc65 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:24.413895 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5592c18-9823-4326-8680-97952ceedc65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:24.415041 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5592c18-9823-4326-8680-97952ceedc65 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:24.416699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5592c18-9823-4326-8680-97952ceedc65 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:24.432551 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29f3d3-edae-4cd4-a582-400421dcb2e1 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:24.449503 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:24.470620 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90430f12-f6ba-4f91-9fda-728dc8d49eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:24.471272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90430f12-f6ba-4f91-9fda-728dc8d49eca None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:24.471556 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90430f12-f6ba-4f91-9fda-728dc8d49eca None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:24.471876 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90430f12-f6ba-4f91-9fda-728dc8d49eca None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:24.472526 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90430f12-f6ba-4f91-9fda-728dc8d49eca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:24.473932 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90430f12-f6ba-4f91-9fda-728dc8d49eca None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:24.482419 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 473/943] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 3 12:42:24 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:42:24.490125 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 471/944] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:42:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:42:24.939212 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4804cf-aae2-4da8-aa68-e1e163f65950 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:24.939764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4804cf-aae2-4da8-aa68-e1e163f65950 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:24.939764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4804cf-aae2-4da8-aa68-e1e163f65950 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:24.941938 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 474/945] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:24.947275 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f8e78-b21f-4a41-82b6-4bacf61c6e5a None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:24.947569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f8e78-b21f-4a41-82b6-4bacf61c6e5a None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:24.947852 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f8e78-b21f-4a41-82b6-4bacf61c6e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:24.966547 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-4b8f8e78-b21f-4a41-82b6-4bacf61c6e5a None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:24.967802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-4b8f8e78-b21f-4a41-82b6-4bacf61c6e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:25.020248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:25.045291 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 472/946] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:25.068551 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4804cf-aae2-4da8-aa68-e1e163f65950 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:25.189326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4804cf-aae2-4da8-aa68-e1e163f65950 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:25.241873 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d5dbc-21d9-424b-abc9-682d88cb11ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:25.242508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d5dbc-21d9-424b-abc9-682d88cb11ee None admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:25.242821 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d5dbc-21d9-424b-abc9-682d88cb11ee None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:25.243107 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d5dbc-21d9-424b-abc9-682d88cb11ee None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:25.243821 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d5dbc-21d9-424b-abc9-682d88cb11ee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:25.245345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d5dbc-21d9-424b-abc9-682d88cb11ee None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:25.248106 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: WARNING keystone.server.flask.common [None req-b57d5dbc-21d9-424b-abc9-682d88cb11ee None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 03 12:42:25.366301 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.sql.core [None req-b57d5dbc-21d9-424b-abc9-682d88cb11ee None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 03 12:42:25.366301 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 03 12:42:25.366301 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [parameters: {'id': '419b5eef2afe4890bc9805791fa18242', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 03 12:42:25.366301 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81208) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 03 12:42:25.383305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-b57d5dbc-21d9-424b-abc9-682d88cb11ee None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 419b5eef2afe4890bc9805791fa18242.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 419b5eef2afe4890bc9805791fa18242. Aug 03 12:42:25.383305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:25.383305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 12:42:25.383305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 12:42:25.383305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 12:42:25.383305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 12:42:25.383305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 12:42:25.383305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 12:42:25.383305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 12:42:25.383305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application conn.query(q) Aug 03 12:42:25.383305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 12:42:25.383305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 12:42:25.383305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 12:42:25.384149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application result.read() Aug 03 12:42:25.384149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 12:42:25.384149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 12:42:25.384149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 12:42:25.384149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 12:42:25.384149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 12:42:25.384149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 12:42:25.384149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 12:42:25.384149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 12:42:25.384149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 03 12:42:25.384149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:25.384149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 03 12:42:25.384149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:25.384149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:25.384149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 03 12:42:25.384149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 03 12:42:25.384149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 03 12:42:25.384149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 03 12:42:25.385094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 12:42:25.385094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application next(self.gen) Aug 03 12:42:25.385094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 03 12:42:25.385094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application yield resource Aug 03 12:42:25.385094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 12:42:25.385094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application next(self.gen) Aug 03 12:42:25.385094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 03 12:42:25.385094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self.session.rollback() Aug 03 12:42:25.385094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 12:42:25.385094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self.force_reraise() Aug 03 12:42:25.385094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 12:42:25.385094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise self.value Aug 03 12:42:25.385094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 03 12:42:25.385094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 03 12:42:25.385094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 03 12:42:25.385094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application session.commit() Aug 03 12:42:25.385094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 03 12:42:25.385976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 03 12:42:25.385976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 03 12:42:25.385976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._prepare_impl() Aug 03 12:42:25.385976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 03 12:42:25.385976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self.session.flush() Aug 03 12:42:25.385976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 03 12:42:25.385976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._flush(objects) Aug 03 12:42:25.385976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 03 12:42:25.385976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 03 12:42:25.385976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 03 12:42:25.385976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application compat.raise_( Aug 03 12:42:25.385976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 12:42:25.385976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception Aug 03 12:42:25.385976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 03 12:42:25.385976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application flush_context.execute() Aug 03 12:42:25.385976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 03 12:42:25.385976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rec.execute(self) Aug 03 12:42:25.394584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 03 12:42:25.394584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 03 12:42:25.394584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 03 12:42:25.394584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 03 12:42:25.394584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 03 12:42:25.394584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 03 12:42:25.394584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 03 12:42:25.394584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 03 12:42:25.394584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 03 12:42:25.394584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 03 12:42:25.394584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 03 12:42:25.394584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 03 12:42:25.394584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 03 12:42:25.394584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 03 12:42:25.394584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 03 12:42:25.395438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 03 12:42:25.395438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 12:42:25.395438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception Aug 03 12:42:25.395438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 12:42:25.395438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 12:42:25.395438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 12:42:25.395438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 12:42:25.395438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 12:42:25.395438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 12:42:25.395438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 12:42:25.395438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application conn.query(q) Aug 03 12:42:25.395438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 12:42:25.395438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 12:42:25.395438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 12:42:25.395438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application result.read() Aug 03 12:42:25.395438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 12:42:25.395438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 12:42:25.396326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 12:42:25.396326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 12:42:25.396326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 12:42:25.396326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 12:42:25.396326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 12:42:25.396326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 12:42:25.396326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 03 12:42:25.396326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 03 12:42:25.396326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [parameters: {'id': '419b5eef2afe4890bc9805791fa18242', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 03 12:42:25.396326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 03 12:42:25.396326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:25.396326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:25.396326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:25.396326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:25.396326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 03 12:42:25.397120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 03 12:42:25.397120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 03 12:42:25.397120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 03 12:42:25.397120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 03 12:42:25.397120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:25.397120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:25.397120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:25.397120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:25.397120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:25.397120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:25.397120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:25.397120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:25.397120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:25.397120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:25.397120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:25.397120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:25.397120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:25.398058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:25.398058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 03 12:42:25.398058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 03 12:42:25.398058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:25.398058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:25.398058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 03 12:42:25.398058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 03 12:42:25.398058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 419b5eef2afe4890bc9805791fa18242. Aug 03 12:42:25.398058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:25.398058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 475/947] 10.222.0.64 () {60 vars in 1140 bytes} [Wed Aug 3 12:42:25 2022] POST /identity/v3/projects => generated 262 bytes in 321 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:25.398604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f8e78-b21f-4a41-82b6-4bacf61c6e5a None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:25.515406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f8e78-b21f-4a41-82b6-4bacf61c6e5a None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:25.553315 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139fb83-e124-458e-ba99-d021552854da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:25.553966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139fb83-e124-458e-ba99-d021552854da None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:25.554248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139fb83-e124-458e-ba99-d021552854da None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:25.554524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139fb83-e124-458e-ba99-d021552854da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:25.562237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139fb83-e124-458e-ba99-d021552854da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:25.563700 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139fb83-e124-458e-ba99-d021552854da None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:25.575579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-e139fb83-e124-458e-ba99-d021552854da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:25.575579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:25.575579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:25.575579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:25.575579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:25.575579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:25.575579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:25.575579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:25.575579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:25.575579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:25.575579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:25.575579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:25.575579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:42:25.575579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:42:25.575579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:42:25.577606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:42:25.577606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:25.577606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:25.577606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:25.577606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:25.577606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:25.577606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:25.577606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:25.577606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:25.577606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:25.577606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:25.577606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:25.577606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:25.577606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:25.577606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:25.577606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:25.577606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:25.579200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:42:25.579200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:42:25.579200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:42:25.579200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:42:25.579200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:42:25.579200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:42:25.579200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:25.579200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:25.579200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 473/948] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:42:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:25.583859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d5dbc-21d9-424b-abc9-682d88cb11ee None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:25.647553 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:25.715417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d5dbc-21d9-424b-abc9-682d88cb11ee None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:25.752513 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d861a-161a-4d6b-bc52-9a9f35ddde67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:25.753175 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d861a-161a-4d6b-bc52-9a9f35ddde67 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:25.753462 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d861a-161a-4d6b-bc52-9a9f35ddde67 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:25.753744 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d861a-161a-4d6b-bc52-9a9f35ddde67 None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:25.754474 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d861a-161a-4d6b-bc52-9a9f35ddde67 None admin] RBAC: Adding query filter params (name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:25.754823 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d861a-161a-4d6b-bc52-9a9f35ddde67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:25.756506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d861a-161a-4d6b-bc52-9a9f35ddde67 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:25.781346 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 476/949] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 3 12:42:25 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:26.417044 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205107ca-7e8a-4bba-821b-d31aad83cec6 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:26.417565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205107ca-7e8a-4bba-821b-d31aad83cec6 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:26.417658 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205107ca-7e8a-4bba-821b-d31aad83cec6 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:26.419210 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 474/950] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:42:26.424445 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21f562-ad7f-4f52-968c-2ddf12bfcc7e None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:26.425374 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21f562-ad7f-4f52-968c-2ddf12bfcc7e None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:26.425564 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21f562-ad7f-4f52-968c-2ddf12bfcc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:26.446374 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-9f21f562-ad7f-4f52-968c-2ddf12bfcc7e None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:26.447944 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-9f21f562-ad7f-4f52-968c-2ddf12bfcc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:26.518874 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 477/951] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:26.543533 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205107ca-7e8a-4bba-821b-d31aad83cec6 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:26.594077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:26.654140 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205107ca-7e8a-4bba-821b-d31aad83cec6 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:26.683370 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137775e0-5333-4a79-a0e2-8e4ce16fc7b4 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:26.683656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137775e0-5333-4a79-a0e2-8e4ce16fc7b4 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:26.683855 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137775e0-5333-4a79-a0e2-8e4ce16fc7b4 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:26.685451 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 478/952] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:42:26.690811 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cf659-7aa9-4d6b-b227-d25598e72794 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:26.691051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1cf16-7cd6-4b1c-94b5-3d7b0b3534e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:26.691236 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cf659-7aa9-4d6b-b227-d25598e72794 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:26.691391 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cf659-7aa9-4d6b-b227-d25598e72794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:26.691543 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1cf16-7cd6-4b1c-94b5-3d7b0b3534e9 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:26.691733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1cf16-7cd6-4b1c-94b5-3d7b0b3534e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:26.692010 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1cf16-7cd6-4b1c-94b5-3d7b0b3534e9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:26.702970 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1cf16-7cd6-4b1c-94b5-3d7b0b3534e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:42:26.707993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-eef1cf16-7cd6-4b1c-94b5-3d7b0b3534e9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:42:26.707993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:26.707993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:26.707993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:26.707993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:26.707993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:26.707993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:26.707993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:26.707993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:26.707993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:26.707993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:26.707993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:26.707993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:42:26.707993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:42:26.707993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:42:26.707993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:42:26.710325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:42:26.710325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:42:26.710325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:42:26.710325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:42:26.710325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:26.710325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:26.710325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:26.710325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:26.710325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:26.710325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:26.710325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:26.710325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:26.710325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:26.710325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:26.710325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:26.710325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:26.712524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:26.712524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:26.712524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:26.712524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:26.712524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:42:26.712524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:42:26.712524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:42:26.712524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:42:26.712524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:42:26.712524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:42:26.712524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:42:26.712524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:26.712524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 475/953] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 3 12:42:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:26.712524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aae2f-4610-4f0d-9dd1-df395046369f None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:26.714174 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aae2f-4610-4f0d-9dd1-df395046369f None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:26.714174 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aae2f-4610-4f0d-9dd1-df395046369f None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:26.714174 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 476/954] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:26.714593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-4d0cf659-7aa9-4d6b-b227-d25598e72794 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:26.718492 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69aae2f-4610-4f0d-9dd1-df395046369f None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:26.718837 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-4d0cf659-7aa9-4d6b-b227-d25598e72794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:26.734536 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:26.788867 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 479/955] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:26.790696 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5c4ee-2f45-4ad0-bc05-f1998011d5f1 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:26.791176 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5c4ee-2f45-4ad0-bc05-f1998011d5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:26.791648 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5c4ee-2f45-4ad0-bc05-f1998011d5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:26.809932 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-94b5c4ee-2f45-4ad0-bc05-f1998011d5f1 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:26.811531 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-94b5c4ee-2f45-4ad0-bc05-f1998011d5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:26.833585 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:26.837821 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69aae2f-4610-4f0d-9dd1-df395046369f None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:26.875497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e3882-bb61-4bdd-baac-ab9921c78f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:26.876118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e3882-bb61-4bdd-baac-ab9921c78f98 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:26.876404 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e3882-bb61-4bdd-baac-ab9921c78f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:26.876681 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e3882-bb61-4bdd-baac-ab9921c78f98 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:26.877393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e3882-bb61-4bdd-baac-ab9921c78f98 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:26.877862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e3882-bb61-4bdd-baac-ab9921c78f98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:26.879315 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e3882-bb61-4bdd-baac-ab9921c78f98 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:26.879927 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 480/956] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:26.892109 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 477/957] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 3 12:42:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:26.892506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5c4ee-2f45-4ad0-bc05-f1998011d5f1 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:26.893184 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e3882-bb61-4bdd-baac-ab9921c78f98 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:26.989400 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:27.005135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5c4ee-2f45-4ad0-bc05-f1998011d5f1 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:27.011823 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e3882-bb61-4bdd-baac-ab9921c78f98 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:27.041730 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605e5a3-e2a1-4e83-b0bb-41cc44f672d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:27.042359 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605e5a3-e2a1-4e83-b0bb-41cc44f672d4 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:27.042647 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605e5a3-e2a1-4e83-b0bb-41cc44f672d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:27.042967 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605e5a3-e2a1-4e83-b0bb-41cc44f672d4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:27.043602 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605e5a3-e2a1-4e83-b0bb-41cc44f672d4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:27.044980 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605e5a3-e2a1-4e83-b0bb-41cc44f672d4 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:27.047891 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7e9b8-3eb3-4b82-93ff-3bf3006d34ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:27.048809 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7e9b8-3eb3-4b82-93ff-3bf3006d34ec None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:27.049248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7e9b8-3eb3-4b82-93ff-3bf3006d34ec None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:27.049513 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7e9b8-3eb3-4b82-93ff-3bf3006d34ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:27.054464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-1605e5a3-e2a1-4e83-b0bb-41cc44f672d4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:42:27.054464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:27.054464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:42:27.054464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:42:27.054464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:42:27.054464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:42:27.054464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:42:27.054464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:27.054464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:42:27.054464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:27.054464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:27.054464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:27.054464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:27.054464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:27.054464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:27.054464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:27.054464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:27.055590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:27.055590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:27.055590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:27.055590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:27.055590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:27.055590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:27.055590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:42:27.055590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:42:27.055590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:42:27.055590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:42:27.055590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:27.055590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:27.055590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:27.055590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:27.055590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:27.055590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:27.056568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:27.056568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:27.056568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:27.056568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:27.056568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:27.056568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:27.056568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:27.056568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:27.056568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:27.056568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:27.056568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:42:27.056568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:27.056568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:42:27.056568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:27.056568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 481/958] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 3 12:42:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:27.057365 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605e5a3-e2a1-4e83-b0bb-41cc44f672d4 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:27.065097 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7e9b8-3eb3-4b82-93ff-3bf3006d34ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:27.066631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7e9b8-3eb3-4b82-93ff-3bf3006d34ec None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:27.083155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-74b7e9b8-3eb3-4b82-93ff-3bf3006d34ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:27.083155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:27.083155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:27.083155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:27.083155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:27.083155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:27.083155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:27.083155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:27.083155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:27.083155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:27.083155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:27.083155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:27.083155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:27.083155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:27.083155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:27.084052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:27.084052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:27.084052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:27.084052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:27.084052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:27.084052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:27.084052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:27.084052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:27.084052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:27.084052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:27.084052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:27.084052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:27.084052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:27.084052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:27.084052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:27.084052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:27.084052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:27.084939 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:27.084939 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:27.084939 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:27.084939 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:27.084939 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 478/959] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:27.085221 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7e9b8-3eb3-4b82-93ff-3bf3006d34ec None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:27.103667 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:27.171564 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605e5a3-e2a1-4e83-b0bb-41cc44f672d4 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:27.204861 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7e9b8-3eb3-4b82-93ff-3bf3006d34ec None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:27.208514 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1743534-f56b-40e7-bbcb-9a6b7d2c4374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:27.209353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1743534-f56b-40e7-bbcb-9a6b7d2c4374 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:27.209817 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1743534-f56b-40e7-bbcb-9a6b7d2c4374 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:27.210291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1743534-f56b-40e7-bbcb-9a6b7d2c4374 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:27.211126 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1743534-f56b-40e7-bbcb-9a6b7d2c4374 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:27.212689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1743534-f56b-40e7-bbcb-9a6b7d2c4374 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:27.223027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-f1743534-f56b-40e7-bbcb-9a6b7d2c4374 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:42:27.223027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:27.223027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:42:27.223027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:42:27.223027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:42:27.223027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:42:27.223027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:42:27.223027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:27.223027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:42:27.223027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:27.223027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:27.223027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:27.223027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:27.223027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:27.223027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:27.223027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:27.223027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:27.223991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:27.223991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:27.223991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:27.223991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:27.223991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:27.223991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:27.223991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:42:27.223991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:42:27.223991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:42:27.223991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:42:27.223991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:27.223991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:27.223991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:27.223991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:27.223991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:27.223991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:27.224827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:27.224827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:27.224827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:27.224827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:27.224827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:27.224827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:27.224827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:27.224827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:27.224827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:27.224827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:27.224827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:42:27.224827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:27.224827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:42:27.224827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:27.226999 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 482/960] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:42:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:27.227926 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1743534-f56b-40e7-bbcb-9a6b7d2c4374 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:27.244673 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:27.245561 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9110d-36e4-4dd3-8e96-f142af0e114d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:27.246179 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9110d-36e4-4dd3-8e96-f142af0e114d None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:27.246461 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9110d-36e4-4dd3-8e96-f142af0e114d None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:27.246753 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9110d-36e4-4dd3-8e96-f142af0e114d None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:27.247534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9110d-36e4-4dd3-8e96-f142af0e114d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:27.247822 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9110d-36e4-4dd3-8e96-f142af0e114d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:27.249119 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9110d-36e4-4dd3-8e96-f142af0e114d None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:27.254694 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 479/961] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 3 12:42:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:27.258296 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9110d-36e4-4dd3-8e96-f142af0e114d None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:27.337399 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:27.343548 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1743534-f56b-40e7-bbcb-9a6b7d2c4374 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:27.359858 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9110d-36e4-4dd3-8e96-f142af0e114d None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:27.384878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44614f05-e574-426b-81bd-82eefd991202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:27.385505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44614f05-e574-426b-81bd-82eefd991202 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:27.385805 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44614f05-e574-426b-81bd-82eefd991202 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:27.386064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44614f05-e574-426b-81bd-82eefd991202 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:27.386786 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44614f05-e574-426b-81bd-82eefd991202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:27.387098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44614f05-e574-426b-81bd-82eefd991202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:27.388484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44614f05-e574-426b-81bd-82eefd991202 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:27.397854 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9ac67-005f-4c88-acef-cdba26abaccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:27.398481 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9ac67-005f-4c88-acef-cdba26abaccd None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:27.398795 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9ac67-005f-4c88-acef-cdba26abaccd None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:27.399078 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9ac67-005f-4c88-acef-cdba26abaccd None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:27.399763 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9ac67-005f-4c88-acef-cdba26abaccd None admin] RBAC: Adding query filter params (name=compute) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:27.400071 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9ac67-005f-4c88-acef-cdba26abaccd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:27.401544 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9ac67-005f-4c88-acef-cdba26abaccd None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:27.405634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 483/962] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:27.406401 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44614f05-e574-426b-81bd-82eefd991202 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:27.413019 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 480/963] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 3 12:42:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:27.437545 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9ac67-005f-4c88-acef-cdba26abaccd None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:27.486070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:27.519860 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44614f05-e574-426b-81bd-82eefd991202 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:27.529135 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9ac67-005f-4c88-acef-cdba26abaccd None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:27.557980 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686d90a-79e3-4395-bc9d-cfa155920e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:27.558714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686d90a-79e3-4395-bc9d-cfa155920e71 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:27.559044 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686d90a-79e3-4395-bc9d-cfa155920e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:27.559435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686d90a-79e3-4395-bc9d-cfa155920e71 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:27.560117 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686d90a-79e3-4395-bc9d-cfa155920e71 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:27.560433 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686d90a-79e3-4395-bc9d-cfa155920e71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:27.561808 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686d90a-79e3-4395-bc9d-cfa155920e71 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:27.564592 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca477d-5877-47ab-8a0c-0547660d3e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:27.565234 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca477d-5877-47ab-8a0c-0547660d3e65 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:27.565552 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca477d-5877-47ab-8a0c-0547660d3e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:27.565830 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca477d-5877-47ab-8a0c-0547660d3e65 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:27.572023 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 484/964] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 3 12:42:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:27.572023 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686d90a-79e3-4395-bc9d-cfa155920e71 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:27.578954 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca477d-5877-47ab-8a0c-0547660d3e65 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:27.580415 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca477d-5877-47ab-8a0c-0547660d3e65 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:27.594423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-4dca477d-5877-47ab-8a0c-0547660d3e65 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:42:27.594423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:27.594423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:27.594423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:27.594423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:27.594423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:27.594423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:27.594423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:27.594423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:27.594423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:27.594423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:27.594423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:27.594423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:42:27.594423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:42:27.594423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:42:27.594423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:42:27.595499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:27.595499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:27.595499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:42:27.595499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:27.595499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:42:27.595499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:27.595499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:27.595499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:27.595499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:27.595499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:27.595499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:27.595499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:27.595499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:27.595499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:27.595499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:27.595499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:27.595499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:27.595499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:27.596523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:27.596523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:27.596523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:42:27.596523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:42:27.596523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:42:27.596523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:42:27.596523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:42:27.596523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:42:27.596523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:42:27.596523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:27.596523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 481/965] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 3 12:42:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:27.596523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca477d-5877-47ab-8a0c-0547660d3e65 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:27.599821 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:27.686139 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686d90a-79e3-4395-bc9d-cfa155920e71 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:27.703722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca477d-5877-47ab-8a0c-0547660d3e65 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:27.724218 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919dfab7-f42a-4bcd-869a-272292704edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:27.724846 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dfab7-f42a-4bcd-869a-272292704edf None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:27.725132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dfab7-f42a-4bcd-869a-272292704edf None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:27.725414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dfab7-f42a-4bcd-869a-272292704edf None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:27.726093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919dfab7-f42a-4bcd-869a-272292704edf None admin] RBAC: Adding query filter params (type=compute) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:27.726407 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919dfab7-f42a-4bcd-869a-272292704edf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:27.727824 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919dfab7-f42a-4bcd-869a-272292704edf None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:27.730268 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:27.733597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 485/966] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 3 12:42:27 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:27.734373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919dfab7-f42a-4bcd-869a-272292704edf None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:27.748164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2e849-fc00-4cd6-8e38-e3914fce6da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:27.749118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2e849-fc00-4cd6-8e38-e3914fce6da1 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:27.749568 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2e849-fc00-4cd6-8e38-e3914fce6da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:27.750011 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2e849-fc00-4cd6-8e38-e3914fce6da1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:27.750972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2e849-fc00-4cd6-8e38-e3914fce6da1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:27.752590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2e849-fc00-4cd6-8e38-e3914fce6da1 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:27.831534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 482/967] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:42:27 2022] POST /identity/v3/endpoints => generated 349 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:42:27.872768 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919dfab7-f42a-4bcd-869a-272292704edf None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:27.906110 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045ec6c-ef52-47a3-abae-a025b07fe896 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:27.906452 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045ec6c-ef52-47a3-abae-a025b07fe896 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:27.906682 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045ec6c-ef52-47a3-abae-a025b07fe896 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:27.908406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 483/968] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:42:27.914773 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8795d7-4292-4e38-aa8c-3a327b662ee7 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:27.915081 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8795d7-4292-4e38-aa8c-3a327b662ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:27.915426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8795d7-4292-4e38-aa8c-3a327b662ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:27.925068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fe1b6-b3c6-4f6b-9509-18f3d629ee65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:27.925710 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fe1b6-b3c6-4f6b-9509-18f3d629ee65 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:27.925995 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fe1b6-b3c6-4f6b-9509-18f3d629ee65 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:27.926275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fe1b6-b3c6-4f6b-9509-18f3d629ee65 None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:27.927150 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fe1b6-b3c6-4f6b-9509-18f3d629ee65 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:27.927463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fe1b6-b3c6-4f6b-9509-18f3d629ee65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:27.928943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fe1b6-b3c6-4f6b-9509-18f3d629ee65 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:27.940896 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-ee8795d7-4292-4e38-aa8c-3a327b662ee7 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:27.942501 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ee8795d7-4292-4e38-aa8c-3a327b662ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:27.949093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 486/969] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Aug 3 12:42:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:27.957184 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fe1b6-b3c6-4f6b-9509-18f3d629ee65 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:28.012190 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:28.033822 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 484/970] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:28.035433 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:28.059466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8795d7-4292-4e38-aa8c-3a327b662ee7 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:28.105636 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fe1b6-b3c6-4f6b-9509-18f3d629ee65 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:28.145108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aff06a-c072-4322-a727-d8169bc4f4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:28.145792 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aff06a-c072-4322-a727-d8169bc4f4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:28.146085 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aff06a-c072-4322-a727-d8169bc4f4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:28.146363 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aff06a-c072-4322-a727-d8169bc4f4e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:28.188220 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8795d7-4292-4e38-aa8c-3a327b662ee7 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:28.224045 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aff06a-c072-4322-a727-d8169bc4f4e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:28.225526 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aff06a-c072-4322-a727-d8169bc4f4e2 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:28.228483 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86a1e7-753b-4258-85e5-e08473a0fad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:28.229369 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86a1e7-753b-4258-85e5-e08473a0fad6 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:28.229860 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86a1e7-753b-4258-85e5-e08473a0fad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:28.230348 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86a1e7-753b-4258-85e5-e08473a0fad6 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:28.231283 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86a1e7-753b-4258-85e5-e08473a0fad6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:28.233096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86a1e7-753b-4258-85e5-e08473a0fad6 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:28.236128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: WARNING keystone.server.flask.common [None req-9a86a1e7-753b-4258-85e5-e08473a0fad6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 03 12:42:28.280575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:28.292903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.sql.core [None req-9a86a1e7-753b-4258-85e5-e08473a0fad6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 03 12:42:28.292903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 03 12:42:28.292903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [parameters: {'user_id': '91e009d1269e418fae201530d1e254e8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 03 12:42:28.292903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81209) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 03 12:42:28.311813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-9a86a1e7-753b-4258-85e5-e08473a0fad6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 03 12:42:28.311813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:28.311813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 12:42:28.311813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 12:42:28.311813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 12:42:28.311813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 12:42:28.311813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 12:42:28.311813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 12:42:28.311813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 12:42:28.311813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application conn.query(q) Aug 03 12:42:28.311813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 12:42:28.311813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 12:42:28.311813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 12:42:28.311813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application result.read() Aug 03 12:42:28.311813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 12:42:28.312818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 12:42:28.312818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 12:42:28.312818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 12:42:28.312818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 12:42:28.312818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 12:42:28.312818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 12:42:28.312818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 12:42:28.312818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 03 12:42:28.312818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:28.312818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 03 12:42:28.312818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:28.312818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:28.312818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 03 12:42:28.312818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 03 12:42:28.312818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 03 12:42:28.312818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 03 12:42:28.312818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 12:42:28.312818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application next(self.gen) Aug 03 12:42:28.313804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 03 12:42:28.313804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application yield resource Aug 03 12:42:28.313804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 12:42:28.313804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application next(self.gen) Aug 03 12:42:28.313804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 03 12:42:28.313804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self.session.rollback() Aug 03 12:42:28.313804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 12:42:28.313804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self.force_reraise() Aug 03 12:42:28.313804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 12:42:28.313804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise self.value Aug 03 12:42:28.313804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 03 12:42:28.313804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 03 12:42:28.313804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 03 12:42:28.313804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application session.commit() Aug 03 12:42:28.313804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 03 12:42:28.313804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 03 12:42:28.313804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 03 12:42:28.314716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._prepare_impl() Aug 03 12:42:28.314716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 03 12:42:28.314716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self.session.flush() Aug 03 12:42:28.314716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 03 12:42:28.314716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._flush(objects) Aug 03 12:42:28.314716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 03 12:42:28.314716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 03 12:42:28.314716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 03 12:42:28.314716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application compat.raise_( Aug 03 12:42:28.314716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 12:42:28.314716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception Aug 03 12:42:28.314716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 03 12:42:28.314716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application flush_context.execute() Aug 03 12:42:28.314716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 03 12:42:28.314716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rec.execute(self) Aug 03 12:42:28.314716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 03 12:42:28.314716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 03 12:42:28.316984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 03 12:42:28.316984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 03 12:42:28.316984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 03 12:42:28.316984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 03 12:42:28.316984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 03 12:42:28.316984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 03 12:42:28.316984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 03 12:42:28.316984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 03 12:42:28.316984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 03 12:42:28.316984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 03 12:42:28.316984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 03 12:42:28.316984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 03 12:42:28.316984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 03 12:42:28.316984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 03 12:42:28.316984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 12:42:28.316984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception Aug 03 12:42:28.318397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 12:42:28.318397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 12:42:28.318397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 12:42:28.318397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 12:42:28.318397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 12:42:28.318397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 12:42:28.318397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 12:42:28.318397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application conn.query(q) Aug 03 12:42:28.318397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 12:42:28.318397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 12:42:28.318397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 12:42:28.318397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application result.read() Aug 03 12:42:28.318397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 12:42:28.318397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 12:42:28.318397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 12:42:28.318397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 12:42:28.320322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 12:42:28.320322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 12:42:28.320322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 12:42:28.320322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 12:42:28.320322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 03 12:42:28.320322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 03 12:42:28.320322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [parameters: {'user_id': '91e009d1269e418fae201530d1e254e8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 03 12:42:28.320322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 03 12:42:28.320322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:28.320322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:28.320322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:28.320322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:28.320322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:28.320322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:28.320322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:28.322124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:28.322124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:28.322124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:28.322124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:28.322124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:28.322124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:28.322124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:28.322124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 03 12:42:28.322124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 03 12:42:28.322124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:28.322124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:28.322124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:42:28.322124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:28.322124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:42:28.322124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:28.322124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 03 12:42:28.322124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 03 12:42:28.325757 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 03 12:42:28.325757 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 03 12:42:28.325757 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 03 12:42:28.325757 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 03 12:42:28.325757 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 03 12:42:28.325757 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:28.331701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 485/971] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Aug 3 12:42:28 2022] POST /identity/v3/users => generated 160 bytes in 272 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:28.332483 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 487/972] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:42:27 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:42:28.336037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86a1e7-753b-4258-85e5-e08473a0fad6 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:28.337865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aff06a-c072-4322-a727-d8169bc4f4e2 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:28.399100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:28.454475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86a1e7-753b-4258-85e5-e08473a0fad6 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:28.475496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aff06a-c072-4322-a727-d8169bc4f4e2 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:28.489972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb829e0-cb15-4c04-9cb2-07a4dca6c686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:28.490515 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb829e0-cb15-4c04-9cb2-07a4dca6c686 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:28.490826 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb829e0-cb15-4c04-9cb2-07a4dca6c686 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:28.491103 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb829e0-cb15-4c04-9cb2-07a4dca6c686 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:28.501277 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb829e0-cb15-4c04-9cb2-07a4dca6c686 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:28.503766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb829e0-cb15-4c04-9cb2-07a4dca6c686 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:28.517113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-5cb829e0-cb15-4c04-9cb2-07a4dca6c686 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:42:28.517113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:28.517113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:28.517113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:28.517113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:28.517113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:28.517113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:28.517113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:28.517113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:28.517113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:28.517113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:28.517113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:28.517113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:42:28.517113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:42:28.517113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:42:28.517113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:42:28.518115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:28.518115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:28.518115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:42:28.518115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:28.518115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:42:28.518115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:28.518115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:28.518115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:28.518115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:28.518115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:28.518115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:28.518115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:28.518115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:28.518115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:28.518115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:28.518115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:28.518115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:28.518115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:28.519175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:28.519175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:28.519175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:42:28.519175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:42:28.519175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:42:28.519175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:42:28.519175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:42:28.519175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:42:28.519175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:42:28.519175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:28.519175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 486/973] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:42:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:28.520902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1d91b-650d-4f36-a038-b19b794f9c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:28.521599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1d91b-650d-4f36-a038-b19b794f9c01 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:28.521825 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1d91b-650d-4f36-a038-b19b794f9c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:28.522093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1d91b-650d-4f36-a038-b19b794f9c01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:28.524501 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb829e0-cb15-4c04-9cb2-07a4dca6c686 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:28.539277 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1d91b-650d-4f36-a038-b19b794f9c01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:28.540670 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1d91b-650d-4f36-a038-b19b794f9c01 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:28.556466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-58f1d91b-650d-4f36-a038-b19b794f9c01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:28.556466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:28.556466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:28.556466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:28.556466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:28.556466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:28.556466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:28.556466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:28.556466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:28.556466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:28.556466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:28.556466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:28.556466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:28.556466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:28.556466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:28.557508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:28.557508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:28.557508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:28.557508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:28.557508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:28.557508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:28.557508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:28.557508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:28.557508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:28.557508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:28.557508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:28.557508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:28.557508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:28.557508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:28.557508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:28.557508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:28.557508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:28.558405 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:28.558405 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:28.558405 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:28.558405 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:28.562395 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 488/974] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:28.563304 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1d91b-650d-4f36-a038-b19b794f9c01 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:28.572997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:28.638057 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb829e0-cb15-4c04-9cb2-07a4dca6c686 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:28.649432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:28.673420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecced0ed-d80e-4d0e-b163-ee9b0d44af61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:28.674085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecced0ed-d80e-4d0e-b163-ee9b0d44af61 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:28.674325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecced0ed-d80e-4d0e-b163-ee9b0d44af61 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:28.675117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecced0ed-d80e-4d0e-b163-ee9b0d44af61 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:28.676329 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecced0ed-d80e-4d0e-b163-ee9b0d44af61 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:28.676452 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecced0ed-d80e-4d0e-b163-ee9b0d44af61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:28.677925 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecced0ed-d80e-4d0e-b163-ee9b0d44af61 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:28.682881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1d91b-650d-4f36-a038-b19b794f9c01 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:28.724868 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75028790-1105-453e-ae75-d35b3f329a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:28.725974 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75028790-1105-453e-ae75-d35b3f329a8c None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:28.726474 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75028790-1105-453e-ae75-d35b3f329a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:28.726826 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 487/975] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Aug 3 12:42:28 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:28.727197 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75028790-1105-453e-ae75-d35b3f329a8c None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:28.728129 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75028790-1105-453e-ae75-d35b3f329a8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:28.728637 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75028790-1105-453e-ae75-d35b3f329a8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:28.730298 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75028790-1105-453e-ae75-d35b3f329a8c None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:28.745996 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 489/976] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:28.752200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecced0ed-d80e-4d0e-b163-ee9b0d44af61 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:28.871435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecced0ed-d80e-4d0e-b163-ee9b0d44af61 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:28.911762 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e92a4-74be-4ac5-a1e8-7e3ffda28207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:28.912414 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e92a4-74be-4ac5-a1e8-7e3ffda28207 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:28.912699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e92a4-74be-4ac5-a1e8-7e3ffda28207 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:28.912977 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e92a4-74be-4ac5-a1e8-7e3ffda28207 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:28.920449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e92a4-74be-4ac5-a1e8-7e3ffda28207 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:28.921901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e92a4-74be-4ac5-a1e8-7e3ffda28207 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:28.934284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-149e92a4-74be-4ac5-a1e8-7e3ffda28207 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:28.934284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:28.934284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:28.934284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:28.934284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:28.934284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:28.934284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:28.934284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:28.934284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:28.934284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:28.934284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:28.934284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:28.934284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:42:28.934284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:42:28.934284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:42:28.935239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:42:28.935239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:28.935239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:28.935239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:28.935239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:28.935239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:28.935239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:28.935239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:28.935239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:28.935239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:28.935239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:28.935239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:28.935239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:28.935239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:28.935239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:28.935239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:28.935239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:28.936098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:42:28.936098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:42:28.936098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:42:28.936098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:42:28.936098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:42:28.936098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:42:28.936098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:28.936098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:28.936098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 488/977] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:42:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:28.943003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75028790-1105-453e-ae75-d35b3f329a8c None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:29.019225 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:29.055733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75028790-1105-453e-ae75-d35b3f329a8c None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:29.089259 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de62eaf-8d90-408d-8e5d-4e05891282b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:29.089918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de62eaf-8d90-408d-8e5d-4e05891282b6 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:29.090203 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de62eaf-8d90-408d-8e5d-4e05891282b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:29.090477 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de62eaf-8d90-408d-8e5d-4e05891282b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:29.091247 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de62eaf-8d90-408d-8e5d-4e05891282b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:29.091555 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de62eaf-8d90-408d-8e5d-4e05891282b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:29.092976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de62eaf-8d90-408d-8e5d-4e05891282b6 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:29.105620 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 490/978] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:42:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:29.111318 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e92a4-74be-4ac5-a1e8-7e3ffda28207 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:29.140545 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:29.222361 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e92a4-74be-4ac5-a1e8-7e3ffda28207 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:29.254708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764f370-5312-4ba0-8aaf-3a266119991a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:29.255361 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764f370-5312-4ba0-8aaf-3a266119991a None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:29.255643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764f370-5312-4ba0-8aaf-3a266119991a None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:29.255912 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764f370-5312-4ba0-8aaf-3a266119991a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:29.256689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764f370-5312-4ba0-8aaf-3a266119991a None admin] RBAC: Adding query filter params (role.id=68aa1e11e519409289c25ac896f855aa, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=b9d70abf4f754530a3cf6efa7a782736) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:29.256996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764f370-5312-4ba0-8aaf-3a266119991a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:29.258394 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764f370-5312-4ba0-8aaf-3a266119991a None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:29.266800 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 489/979] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:42:29 2022] GET /identity/v3/role_assignments?user.id=b9d70abf4f754530a3cf6efa7a782736&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=68aa1e11e519409289c25ac896f855aa => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:29.864669 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfae4c-f257-47d2-8d8a-2dd2fcba317b None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:29.865214 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfae4c-f257-47d2-8d8a-2dd2fcba317b None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:29.865214 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfae4c-f257-47d2-8d8a-2dd2fcba317b None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:29.866626 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 491/980] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:29.871784 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d0cd1-7814-4e53-8597-dc2f955daeb9 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:29.872178 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d0cd1-7814-4e53-8597-dc2f955daeb9 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:29.872339 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d0cd1-7814-4e53-8597-dc2f955daeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:29.890230 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-bb0d0cd1-7814-4e53-8597-dc2f955daeb9 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:29.891772 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-bb0d0cd1-7814-4e53-8597-dc2f955daeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:29.909665 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b27e15-5a5e-4d7b-80e0-0c4616ffc654 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:29.909958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b27e15-5a5e-4d7b-80e0-0c4616ffc654 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:29.910240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b27e15-5a5e-4d7b-80e0-0c4616ffc654 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:29.911766 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 492/981] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:42:29.916933 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42230275-81c2-47b5-bfd0-97dab5e18e1d None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:29.917247 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42230275-81c2-47b5-bfd0-97dab5e18e1d None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:29.917500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42230275-81c2-47b5-bfd0-97dab5e18e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:29.935649 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-42230275-81c2-47b5-bfd0-97dab5e18e1d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:29.936849 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-42230275-81c2-47b5-bfd0-97dab5e18e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:29.965475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 490/982] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:29.988135 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d0cd1-7814-4e53-8597-dc2f955daeb9 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:30.012296 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:30.014886 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 493/983] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:30.028519 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42230275-81c2-47b5-bfd0-97dab5e18e1d None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:30.093549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d0cd1-7814-4e53-8597-dc2f955daeb9 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:30.101022 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:30.132149 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb35899-ddc5-4332-9174-0620582df922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:30.132874 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb35899-ddc5-4332-9174-0620582df922 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:30.133359 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb35899-ddc5-4332-9174-0620582df922 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:30.133816 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb35899-ddc5-4332-9174-0620582df922 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:30.134639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb35899-ddc5-4332-9174-0620582df922 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:30.136619 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb35899-ddc5-4332-9174-0620582df922 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:30.160110 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42230275-81c2-47b5-bfd0-97dab5e18e1d None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:30.193907 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20aa1f-9422-445b-869f-e760b38b558d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:30.194566 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20aa1f-9422-445b-869f-e760b38b558d None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:30.194893 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20aa1f-9422-445b-869f-e760b38b558d None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:30.195171 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20aa1f-9422-445b-869f-e760b38b558d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:30.195796 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20aa1f-9422-445b-869f-e760b38b558d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:30.197211 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20aa1f-9422-445b-869f-e760b38b558d None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:30.206565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-2c20aa1f-9422-445b-869f-e760b38b558d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:42:30.206565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:30.206565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:42:30.206565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:42:30.206565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:42:30.206565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:42:30.206565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:42:30.206565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:30.206565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:42:30.206565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:30.206565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:30.206565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:30.206565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:30.206565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:30.206565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:30.206565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:30.206565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:30.207807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:30.207807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:30.207807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:30.207807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:30.207807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:30.207807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:30.207807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:42:30.207807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:42:30.207807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:42:30.207807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:42:30.207807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:30.207807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:30.207807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:30.207807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:30.207807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:30.207807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:30.208877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:30.208877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:30.208877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:30.208877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:30.208877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:30.208877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:30.208877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:30.208877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:30.208877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:30.208877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:30.208877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:42:30.208877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:30.208877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:42:30.208877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:30.210878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 494/984] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 3 12:42:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:30.213591 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20aa1f-9422-445b-869f-e760b38b558d None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:30.217993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 491/985] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 3 12:42:29 2022] POST /identity/v3/services => generated 242 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:42:30.326430 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20aa1f-9422-445b-869f-e760b38b558d None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:30.349785 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:30.371072 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43aa5f-4f77-40d7-9bed-a6a8bc813597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:30.371699 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43aa5f-4f77-40d7-9bed-a6a8bc813597 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:30.371986 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43aa5f-4f77-40d7-9bed-a6a8bc813597 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:30.372268 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43aa5f-4f77-40d7-9bed-a6a8bc813597 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:30.372955 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43aa5f-4f77-40d7-9bed-a6a8bc813597 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:30.373260 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43aa5f-4f77-40d7-9bed-a6a8bc813597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:30.374638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43aa5f-4f77-40d7-9bed-a6a8bc813597 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:30.380389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 495/986] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 3 12:42:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:30.386140 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb35899-ddc5-4332-9174-0620582df922 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:30.472793 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:30.491513 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb35899-ddc5-4332-9174-0620582df922 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:30.526327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010719f4-93d7-43cc-a14b-d73948ece8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:30.527328 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010719f4-93d7-43cc-a14b-d73948ece8bd None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:30.527835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010719f4-93d7-43cc-a14b-d73948ece8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:30.528311 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010719f4-93d7-43cc-a14b-d73948ece8bd None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:30.529212 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010719f4-93d7-43cc-a14b-d73948ece8bd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:30.529718 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010719f4-93d7-43cc-a14b-d73948ece8bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:30.531370 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010719f4-93d7-43cc-a14b-d73948ece8bd None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:30.542160 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 492/987] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 3 12:42:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:30.543436 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43aa5f-4f77-40d7-9bed-a6a8bc813597 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:30.645683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43aa5f-4f77-40d7-9bed-a6a8bc813597 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:30.679266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76370acb-86d7-4d74-9364-edc1ff08d88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:30.679886 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76370acb-86d7-4d74-9364-edc1ff08d88e None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:30.680174 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76370acb-86d7-4d74-9364-edc1ff08d88e None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:30.680454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76370acb-86d7-4d74-9364-edc1ff08d88e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:30.681216 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76370acb-86d7-4d74-9364-edc1ff08d88e None admin] RBAC: Adding query filter params (interface=admin, service_id=c8f41697f81d4078ba8ec48e0b380e62, region_id=RegionOne) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:30.681532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76370acb-86d7-4d74-9364-edc1ff08d88e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:30.682926 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76370acb-86d7-4d74-9364-edc1ff08d88e None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:30.693056 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 496/988] 10.222.0.64 () {56 vars in 1249 bytes} [Wed Aug 3 12:42:30 2022] GET /identity/v3/endpoints?service_id=c8f41697f81d4078ba8ec48e0b380e62&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:30.694100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010719f4-93d7-43cc-a14b-d73948ece8bd None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:30.795171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010719f4-93d7-43cc-a14b-d73948ece8bd None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:30.830258 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651270d-de4d-4562-a0b8-f81c0e7d9506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:30.831440 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651270d-de4d-4562-a0b8-f81c0e7d9506 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:30.831731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651270d-de4d-4562-a0b8-f81c0e7d9506 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:30.832008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651270d-de4d-4562-a0b8-f81c0e7d9506 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:30.832667 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651270d-de4d-4562-a0b8-f81c0e7d9506 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:30.834032 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651270d-de4d-4562-a0b8-f81c0e7d9506 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:30.847231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 493/989] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 3 12:42:30 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:42:31.320622 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0976808-d1c2-4c2f-a220-73ff304d3119 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:31.321128 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0976808-d1c2-4c2f-a220-73ff304d3119 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:31.321229 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0976808-d1c2-4c2f-a220-73ff304d3119 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:31.322683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 497/990] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:31.327779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19d231-e4a2-4103-8237-b91a1f39d9fc None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:31.328208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19d231-e4a2-4103-8237-b91a1f39d9fc None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:31.328385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19d231-e4a2-4103-8237-b91a1f39d9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:31.348163 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-6c19d231-e4a2-4103-8237-b91a1f39d9fc None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:31.349424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-6c19d231-e4a2-4103-8237-b91a1f39d9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:31.352793 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:31.421812 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 494/991] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:31.444247 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0976808-d1c2-4c2f-a220-73ff304d3119 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:31.493297 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:31.552289 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0976808-d1c2-4c2f-a220-73ff304d3119 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:31.587316 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d093190-877e-4e10-8e53-e0459e8ca10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:31.588293 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d093190-877e-4e10-8e53-e0459e8ca10d None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:31.588784 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d093190-877e-4e10-8e53-e0459e8ca10d None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:31.589262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d093190-877e-4e10-8e53-e0459e8ca10d None admin] PATH_INFO: `/v3/services/image` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:31.590179 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d093190-877e-4e10-8e53-e0459e8ca10d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:31.591831 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d093190-877e-4e10-8e53-e0459e8ca10d None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:31.600928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-6d093190-877e-4e10-8e53-e0459e8ca10d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:42:31.600928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:31.600928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:42:31.600928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:42:31.600928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:42:31.600928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:42:31.600928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:42:31.600928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:31.600928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:42:31.600928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:31.600928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:31.600928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:31.600928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:31.600928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:31.600928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:31.600928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:31.600928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:31.601902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:31.601902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:31.601902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:31.601902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:31.601902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:31.601902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:31.601902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:42:31.601902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:42:31.601902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:42:31.601902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:42:31.601902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:31.601902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:31.601902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:31.601902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:31.601902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:31.601902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:31.602800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:31.602800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:31.602800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:31.602800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:31.602800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:31.602800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:31.602800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:31.602800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:31.602800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:31.602800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:31.602800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:42:31.602800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:31.602800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:42:31.602800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:31.606885 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 498/992] 10.222.0.64 () {56 vars in 1105 bytes} [Wed Aug 3 12:42:31 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:31.610004 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19d231-e4a2-4103-8237-b91a1f39d9fc None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:31.712368 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19d231-e4a2-4103-8237-b91a1f39d9fc None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:31.746682 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8c0d5-1fb1-4137-889a-8a5127cf15ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:31.747326 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8c0d5-1fb1-4137-889a-8a5127cf15ad None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:31.747610 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8c0d5-1fb1-4137-889a-8a5127cf15ad None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:31.747885 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8c0d5-1fb1-4137-889a-8a5127cf15ad None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:31.748561 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8c0d5-1fb1-4137-889a-8a5127cf15ad None admin] RBAC: Adding query filter params (name=image) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:31.748868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8c0d5-1fb1-4137-889a-8a5127cf15ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:31.750226 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8c0d5-1fb1-4137-889a-8a5127cf15ad None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:31.760492 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 495/993] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:31.761969 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d093190-877e-4e10-8e53-e0459e8ca10d None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:31.863482 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d093190-877e-4e10-8e53-e0459e8ca10d None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:31.872369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:31.897162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c61476-8c06-4d78-89ce-47d53ac4413d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:31.898025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c61476-8c06-4d78-89ce-47d53ac4413d None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:31.898491 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c61476-8c06-4d78-89ce-47d53ac4413d None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:31.898815 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c61476-8c06-4d78-89ce-47d53ac4413d None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:31.899767 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c61476-8c06-4d78-89ce-47d53ac4413d None admin] RBAC: Adding query filter params (type=image) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:31.900093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c61476-8c06-4d78-89ce-47d53ac4413d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:31.901466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c61476-8c06-4d78-89ce-47d53ac4413d None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:31.910758 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 499/994] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:32.251418 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb170bc6-712d-4a03-8472-a9a1b2280c15 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:32.251738 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb170bc6-712d-4a03-8472-a9a1b2280c15 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:32.251977 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb170bc6-712d-4a03-8472-a9a1b2280c15 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:32.253413 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 496/995] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:32.258463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3a928-d257-4e18-a745-0928f826efe0 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:32.258765 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3a928-d257-4e18-a745-0928f826efe0 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:32.259046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3a928-d257-4e18-a745-0928f826efe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:32.277283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-67b3a928-d257-4e18-a745-0928f826efe0 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:32.278467 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-67b3a928-d257-4e18-a745-0928f826efe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:32.345719 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 500/996] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:32.367876 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb170bc6-712d-4a03-8472-a9a1b2280c15 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:32.371936 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:32.472454 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb170bc6-712d-4a03-8472-a9a1b2280c15 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:32.509137 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba99a5-9468-4241-87f0-55668956358d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:32.509834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba99a5-9468-4241-87f0-55668956358d None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:32.510120 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba99a5-9468-4241-87f0-55668956358d None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:32.510393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba99a5-9468-4241-87f0-55668956358d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:32.511049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba99a5-9468-4241-87f0-55668956358d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:32.512394 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba99a5-9468-4241-87f0-55668956358d None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:32.521943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-afba99a5-9468-4241-87f0-55668956358d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:42:32.521943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:32.521943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:42:32.521943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:42:32.521943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:42:32.521943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:42:32.521943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:42:32.521943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:32.521943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:42:32.521943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:32.521943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:32.521943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:32.521943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:32.521943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:32.521943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:32.521943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:32.521943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:32.523233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:32.523233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:32.523233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:32.523233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:32.523233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:32.523233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:32.523233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:42:32.523233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:42:32.523233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:42:32.523233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:42:32.523233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:32.523233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:32.523233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:32.523233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:32.523233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:32.523233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:32.524378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:32.524378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:32.524378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:32.524378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:32.524378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:32.524378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:32.524378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:32.524378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:32.524378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:32.524378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:32.524378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:42:32.524378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:32.524378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:42:32.524378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:32.525463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 497/997] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:42:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:32.529038 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3a928-d257-4e18-a745-0928f826efe0 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:32.628807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3a928-d257-4e18-a745-0928f826efe0 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:32.630337 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:32.664244 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e91587-2adc-483a-9e67-e32f60f6b824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:32.664855 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e91587-2adc-483a-9e67-e32f60f6b824 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:32.665133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e91587-2adc-483a-9e67-e32f60f6b824 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:32.665408 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e91587-2adc-483a-9e67-e32f60f6b824 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:32.666142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e91587-2adc-483a-9e67-e32f60f6b824 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:32.666451 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e91587-2adc-483a-9e67-e32f60f6b824 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:32.667938 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e91587-2adc-483a-9e67-e32f60f6b824 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:32.677223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 501/998] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 3 12:42:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:32.678720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba99a5-9468-4241-87f0-55668956358d None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:32.747372 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:32.780514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba99a5-9468-4241-87f0-55668956358d None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:32.815515 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1200f7e-06f4-4bc9-b189-6ef0bee05dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:32.816455 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1200f7e-06f4-4bc9-b189-6ef0bee05dca None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:32.816934 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1200f7e-06f4-4bc9-b189-6ef0bee05dca None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:32.817415 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1200f7e-06f4-4bc9-b189-6ef0bee05dca None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:32.818282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1200f7e-06f4-4bc9-b189-6ef0bee05dca None admin] RBAC: Adding query filter params (type=compute) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:32.818804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1200f7e-06f4-4bc9-b189-6ef0bee05dca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:32.820460 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1200f7e-06f4-4bc9-b189-6ef0bee05dca None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:32.825978 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 498/999] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 3 12:42:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:32.832297 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e91587-2adc-483a-9e67-e32f60f6b824 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:32.869910 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdcfe6-d0c0-4224-b2f6-06f3cc664ecd None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:32.870224 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdcfe6-d0c0-4224-b2f6-06f3cc664ecd None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:32.870476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdcfe6-d0c0-4224-b2f6-06f3cc664ecd None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:32.871990 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 499/1000] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:32.876682 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf957e-efa7-4dbf-acc9-1127fe12457b None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:32.876975 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf957e-efa7-4dbf-acc9-1127fe12457b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:32.877263 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf957e-efa7-4dbf-acc9-1127fe12457b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:32.897486 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-ffaf957e-efa7-4dbf-acc9-1127fe12457b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:32.898682 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ffaf957e-efa7-4dbf-acc9-1127fe12457b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:32.938440 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e91587-2adc-483a-9e67-e32f60f6b824 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:32.967093 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 500/1001] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:32.977729 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01fafc-a917-49bd-b19c-1b62db6bcdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:32.978395 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01fafc-a917-49bd-b19c-1b62db6bcdc5 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:32.978687 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01fafc-a917-49bd-b19c-1b62db6bcdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:32.979072 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01fafc-a917-49bd-b19c-1b62db6bcdc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:32.979850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01fafc-a917-49bd-b19c-1b62db6bcdc5 None admin] RBAC: Adding query filter params (interface=public, service_id=0202407ba17246faa0c23329b7ac9217, region_id=RegionOne) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:32.980217 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01fafc-a917-49bd-b19c-1b62db6bcdc5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:32.981722 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01fafc-a917-49bd-b19c-1b62db6bcdc5 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:32.988707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 502/1002] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 3 12:42:32 2022] GET /identity/v3/endpoints?service_id=0202407ba17246faa0c23329b7ac9217&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:32.989546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf957e-efa7-4dbf-acc9-1127fe12457b None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:32.992902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01fafc-a917-49bd-b19c-1b62db6bcdc5 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:33.027121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:33.051935 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:33.091860 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf957e-efa7-4dbf-acc9-1127fe12457b None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:33.102980 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01fafc-a917-49bd-b19c-1b62db6bcdc5 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:33.130049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e419b73-5453-4bf3-ad62-db06ec45f414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:33.130839 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e419b73-5453-4bf3-ad62-db06ec45f414 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:33.131163 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e419b73-5453-4bf3-ad62-db06ec45f414 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:33.131445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e419b73-5453-4bf3-ad62-db06ec45f414 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:33.132212 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e419b73-5453-4bf3-ad62-db06ec45f414 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:33.133619 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e419b73-5453-4bf3-ad62-db06ec45f414 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:33.139373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b74ea4-d2c6-43f2-9474-083da817e69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:33.140198 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b74ea4-d2c6-43f2-9474-083da817e69b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:33.140674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b74ea4-d2c6-43f2-9474-083da817e69b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:33.141127 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b74ea4-d2c6-43f2-9474-083da817e69b None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:33.141986 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b74ea4-d2c6-43f2-9474-083da817e69b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:33.142653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-2e419b73-5453-4bf3-ad62-db06ec45f414 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:42:33.142653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:33.142653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:42:33.142653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:42:33.142653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:42:33.142653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:42:33.142653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:42:33.142653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:33.142653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:42:33.142653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:33.142653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:33.142653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:33.142653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:33.142653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:33.142653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:33.142653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:33.142653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:33.143868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:33.143868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:33.143868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:33.143868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:33.143868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:33.143868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:33.143868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:42:33.143868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:42:33.143868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:42:33.143868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:42:33.143868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:33.143868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:33.143868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:33.143868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:33.143868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:33.143868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:33.144747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:33.144747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:33.144747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:33.144747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:33.144747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:33.144747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:33.144747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:33.144747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:33.144747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:33.144747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:33.144747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:42:33.144747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:33.144747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:42:33.144747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:33.144747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 501/1003] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Aug 3 12:42:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:33.146670 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b74ea4-d2c6-43f2-9474-083da817e69b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:33.149619 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e419b73-5453-4bf3-ad62-db06ec45f414 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:33.162795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 503/1004] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 3 12:42:32 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:42:33.265630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e419b73-5453-4bf3-ad62-db06ec45f414 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:33.293714 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:33.303437 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410fc9a-3df3-4cdd-a5b0-f4666f91e7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:33.304063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410fc9a-3df3-4cdd-a5b0-f4666f91e7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:33.304351 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410fc9a-3df3-4cdd-a5b0-f4666f91e7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:33.304635 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410fc9a-3df3-4cdd-a5b0-f4666f91e7a1 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:33.309903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410fc9a-3df3-4cdd-a5b0-f4666f91e7a1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:33.309903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410fc9a-3df3-4cdd-a5b0-f4666f91e7a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:33.309903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410fc9a-3df3-4cdd-a5b0-f4666f91e7a1 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:33.312021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 502/1005] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 3 12:42:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:33.317598 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b74ea4-d2c6-43f2-9474-083da817e69b None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:33.422132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:33.433022 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b74ea4-d2c6-43f2-9474-083da817e69b None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:33.466519 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e4a6b-e868-4196-a7f5-23155800adc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:33.467172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e4a6b-e868-4196-a7f5-23155800adc7 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:33.467454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e4a6b-e868-4196-a7f5-23155800adc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:33.467728 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e4a6b-e868-4196-a7f5-23155800adc7 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:33.468651 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e4a6b-e868-4196-a7f5-23155800adc7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:33.468977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e4a6b-e868-4196-a7f5-23155800adc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:33.470587 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e4a6b-e868-4196-a7f5-23155800adc7 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:33.476572 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 504/1006] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Aug 3 12:42:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:33.482414 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410fc9a-3df3-4cdd-a5b0-f4666f91e7a1 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:33.584363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410fc9a-3df3-4cdd-a5b0-f4666f91e7a1 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:33.620000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfdbbc-6a8e-45ac-8893-39fbfed02cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:33.620000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfdbbc-6a8e-45ac-8893-39fbfed02cf9 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:33.620000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfdbbc-6a8e-45ac-8893-39fbfed02cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:33.620000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfdbbc-6a8e-45ac-8893-39fbfed02cf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:33.620585 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfdbbc-6a8e-45ac-8893-39fbfed02cf9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:33.621960 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfdbbc-6a8e-45ac-8893-39fbfed02cf9 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:33.704595 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 503/1007] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:42:33 2022] POST /identity/v3/endpoints => generated 325 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:42:33.920814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b219ed2-6a68-4b48-910c-47b393c2ed22 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:33.921141 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b219ed2-6a68-4b48-910c-47b393c2ed22 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:33.921392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b219ed2-6a68-4b48-910c-47b393c2ed22 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:33.922911 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 505/1008] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:33.927834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fc4c9-53d8-451f-ba83-10be09c9d03c None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:33.928128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fc4c9-53d8-451f-ba83-10be09c9d03c None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:33.928405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fc4c9-53d8-451f-ba83-10be09c9d03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:33.946384 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-e36fc4c9-53d8-451f-ba83-10be09c9d03c None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:33.947598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e36fc4c9-53d8-451f-ba83-10be09c9d03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:33.994144 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:34.021071 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 504/1009] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:33 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:34.044070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b219ed2-6a68-4b48-910c-47b393c2ed22 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:34.152889 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b219ed2-6a68-4b48-910c-47b393c2ed22 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:34.189758 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465a9c6-2793-4002-b6f5-8cd25f144151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:34.190920 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465a9c6-2793-4002-b6f5-8cd25f144151 None admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:34.191209 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465a9c6-2793-4002-b6f5-8cd25f144151 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:34.191488 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465a9c6-2793-4002-b6f5-8cd25f144151 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:34.192235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465a9c6-2793-4002-b6f5-8cd25f144151 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:34.193666 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465a9c6-2793-4002-b6f5-8cd25f144151 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:34.259744 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 506/1010] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 3 12:42:34 2022] POST /identity/v3/services => generated 242 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:42:35.161914 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976bcd5-a871-467a-a032-ff91b53b8e76 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:35.162336 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976bcd5-a871-467a-a032-ff91b53b8e76 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:35.162513 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976bcd5-a871-467a-a032-ff91b53b8e76 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:35.164268 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 505/1011] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:35.169326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bb2d8-0d9c-42c7-b11b-e1e6d7c17577 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:35.169702 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bb2d8-0d9c-42c7-b11b-e1e6d7c17577 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:35.169885 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bb2d8-0d9c-42c7-b11b-e1e6d7c17577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:35.188098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-006bb2d8-0d9c-42c7-b11b-e1e6d7c17577 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:35.189307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-006bb2d8-0d9c-42c7-b11b-e1e6d7c17577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:35.203418 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:35.263217 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 507/1012] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:35 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:35.286172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976bcd5-a871-467a-a032-ff91b53b8e76 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:35.393059 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976bcd5-a871-467a-a032-ff91b53b8e76 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:35.429157 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ee687-fd1f-42d6-b058-b4adf0ea7599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:35.430181 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ee687-fd1f-42d6-b058-b4adf0ea7599 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:35.430669 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ee687-fd1f-42d6-b058-b4adf0ea7599 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:35.436216 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ee687-fd1f-42d6-b058-b4adf0ea7599 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:35.436216 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ee687-fd1f-42d6-b058-b4adf0ea7599 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:35.436216 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ee687-fd1f-42d6-b058-b4adf0ea7599 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:35.444518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-a40ee687-fd1f-42d6-b058-b4adf0ea7599 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:42:35.444518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:35.444518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:42:35.444518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:42:35.444518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:42:35.444518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:42:35.444518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:42:35.444518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:35.444518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:42:35.444518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:35.444518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:35.444518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:35.444518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:35.444518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:35.444518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:35.444518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:35.444518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:35.445676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:35.445676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:35.445676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:35.445676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:35.445676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:35.445676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:35.445676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:42:35.445676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:42:35.445676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:42:35.445676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:42:35.445676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:35.445676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:35.445676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:35.445676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:35.445676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:35.445676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:35.446609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:35.446609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:35.446609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:35.446609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:35.446609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:35.446609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:35.446609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:35.446609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:35.446609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:35.446609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:35.446609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:42:35.446609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:35.446609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:42:35.446609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:35.448349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 506/1013] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:42:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:35.454231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bb2d8-0d9c-42c7-b11b-e1e6d7c17577 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:35.556389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bb2d8-0d9c-42c7-b11b-e1e6d7c17577 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:35.589309 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbbcbe-f315-47a7-83e7-8245db80732c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:35.590013 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbbcbe-f315-47a7-83e7-8245db80732c None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:35.590302 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbbcbe-f315-47a7-83e7-8245db80732c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:35.590586 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbbcbe-f315-47a7-83e7-8245db80732c None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:35.591338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbbcbe-f315-47a7-83e7-8245db80732c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:35.591649 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbbcbe-f315-47a7-83e7-8245db80732c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:35.593021 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbbcbe-f315-47a7-83e7-8245db80732c None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:35.603082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 508/1014] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 3 12:42:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:35.604623 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ee687-fd1f-42d6-b058-b4adf0ea7599 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:35.646932 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:35.706607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ee687-fd1f-42d6-b058-b4adf0ea7599 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:35.741168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbf918-942e-4c43-8d39-c762341bebf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:35.741526 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c17119-225c-491f-9692-4f8c607fc232 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:35.741797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbf918-942e-4c43-8d39-c762341bebf4 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:35.741898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c17119-225c-491f-9692-4f8c607fc232 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:35.742076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c17119-225c-491f-9692-4f8c607fc232 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:35.742199 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbf918-942e-4c43-8d39-c762341bebf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:35.742358 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbf918-942e-4c43-8d39-c762341bebf4 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:35.743073 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbf918-942e-4c43-8d39-c762341bebf4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:35.743583 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbf918-942e-4c43-8d39-c762341bebf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:35.743684 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 509/1015] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:42:35.744769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbf918-942e-4c43-8d39-c762341bebf4 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:35.748884 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250baf7c-47e5-475e-a333-6ba6b20c7005 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:35.749402 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250baf7c-47e5-475e-a333-6ba6b20c7005 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:35.749800 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 507/1016] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Aug 3 12:42:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:35.750082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250baf7c-47e5-475e-a333-6ba6b20c7005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:35.755489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbf918-942e-4c43-8d39-c762341bebf4 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:35.770782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-250baf7c-47e5-475e-a333-6ba6b20c7005 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:35.772225 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-250baf7c-47e5-475e-a333-6ba6b20c7005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:35.774584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:35.864271 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbf918-942e-4c43-8d39-c762341bebf4 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:35.866967 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 510/1017] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:35 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:35.867711 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:35.881974 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250baf7c-47e5-475e-a333-6ba6b20c7005 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:35.900966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9eff4c-a045-4bb5-8648-833c5c4bcba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:35.901877 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9eff4c-a045-4bb5-8648-833c5c4bcba7 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:35.902168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9eff4c-a045-4bb5-8648-833c5c4bcba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:35.902449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9eff4c-a045-4bb5-8648-833c5c4bcba7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:35.903200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9eff4c-a045-4bb5-8648-833c5c4bcba7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:35.904995 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9eff4c-a045-4bb5-8648-833c5c4bcba7 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:35.982830 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250baf7c-47e5-475e-a333-6ba6b20c7005 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:36.008038 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 508/1018] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:42:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:42:36.037483 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ce481-9281-4ece-8fbc-aedb48fb3d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:36.038153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ce481-9281-4ece-8fbc-aedb48fb3d80 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:36.038438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ce481-9281-4ece-8fbc-aedb48fb3d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:36.038989 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ce481-9281-4ece-8fbc-aedb48fb3d80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:36.040294 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ce481-9281-4ece-8fbc-aedb48fb3d80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:36.041811 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ce481-9281-4ece-8fbc-aedb48fb3d80 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:36.043801 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 511/1019] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:36.049721 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9eff4c-a045-4bb5-8648-833c5c4bcba7 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:36.184746 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9eff4c-a045-4bb5-8648-833c5c4bcba7 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:36.220045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce4630-5f2b-431e-8e05-1a80183fbaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:36.220672 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce4630-5f2b-431e-8e05-1a80183fbaca None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:36.220961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce4630-5f2b-431e-8e05-1a80183fbaca None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:36.221265 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce4630-5f2b-431e-8e05-1a80183fbaca None admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:36.221954 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce4630-5f2b-431e-8e05-1a80183fbaca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:36.223435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce4630-5f2b-431e-8e05-1a80183fbaca None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:36.287482 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf68eb5-854b-44f1-8c69-a291d249a4ff None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:36.287976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf68eb5-854b-44f1-8c69-a291d249a4ff None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:36.288079 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf68eb5-854b-44f1-8c69-a291d249a4ff None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:36.289891 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 512/1020] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:42:36.295115 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d837ce7-84d1-4463-92eb-227edf32814a None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:36.295406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d837ce7-84d1-4463-92eb-227edf32814a None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:36.295689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d837ce7-84d1-4463-92eb-227edf32814a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:36.302901 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:36.307370 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 509/1021] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 3 12:42:36 2022] POST /identity/v3/projects => generated 311 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:42:36.315854 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-4d837ce7-84d1-4463-92eb-227edf32814a None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:36.317151 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-4d837ce7-84d1-4463-92eb-227edf32814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:36.392696 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 513/1022] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:36.415937 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce4630-5f2b-431e-8e05-1a80183fbaca None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:36.433014 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:36.526174 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce4630-5f2b-431e-8e05-1a80183fbaca None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:36.562465 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32762251-8570-40ad-9d6e-ba8dca8df979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:36.563058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32762251-8570-40ad-9d6e-ba8dca8df979 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:36.563337 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32762251-8570-40ad-9d6e-ba8dca8df979 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:36.563608 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32762251-8570-40ad-9d6e-ba8dca8df979 None admin] PATH_INFO: `/v3/services/image` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:36.564238 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32762251-8570-40ad-9d6e-ba8dca8df979 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:36.565612 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32762251-8570-40ad-9d6e-ba8dca8df979 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:36.574517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-32762251-8570-40ad-9d6e-ba8dca8df979 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:42:36.574517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:36.574517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:42:36.574517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:42:36.574517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:42:36.574517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:42:36.574517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:42:36.574517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:36.574517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:42:36.574517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:36.574517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:36.574517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:36.574517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:36.574517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:36.574517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:36.574517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:36.574517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:36.575677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:36.575677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:36.575677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:36.575677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:36.575677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:36.575677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:36.575677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:42:36.575677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:42:36.575677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:42:36.575677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:42:36.575677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:36.575677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:36.575677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:36.575677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:36.575677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:36.575677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:36.576531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:36.576531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:36.576531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:36.576531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:36.576531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:36.576531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:36.576531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:36.576531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:36.576531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:36.576531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:36.576531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:42:36.576531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:36.576531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:42:36.576531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:36.576531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 510/1023] 10.222.0.64 () {56 vars in 1105 bytes} [Wed Aug 3 12:42:36 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:36.581889 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d837ce7-84d1-4463-92eb-227edf32814a None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:36.683962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d837ce7-84d1-4463-92eb-227edf32814a None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:36.714047 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:36.719742 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23ba42-b76e-474f-a82c-3f3325ec1c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:36.720359 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23ba42-b76e-474f-a82c-3f3325ec1c06 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:36.720636 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23ba42-b76e-474f-a82c-3f3325ec1c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:36.720907 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23ba42-b76e-474f-a82c-3f3325ec1c06 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:36.722187 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23ba42-b76e-474f-a82c-3f3325ec1c06 None admin] RBAC: Adding query filter params (name=image) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:36.722493 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23ba42-b76e-474f-a82c-3f3325ec1c06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:36.723895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23ba42-b76e-474f-a82c-3f3325ec1c06 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:36.728823 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 514/1024] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:36.734279 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32762251-8570-40ad-9d6e-ba8dca8df979 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:36.811635 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:36.847936 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32762251-8570-40ad-9d6e-ba8dca8df979 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:36.885263 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced4a3a-bd06-4073-96ca-d4fcaeb55048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:36.885893 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced4a3a-bd06-4073-96ca-d4fcaeb55048 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:36.886171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced4a3a-bd06-4073-96ca-d4fcaeb55048 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:36.886441 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced4a3a-bd06-4073-96ca-d4fcaeb55048 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:36.887149 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced4a3a-bd06-4073-96ca-d4fcaeb55048 None admin] RBAC: Adding query filter params (type=image) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:36.887457 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced4a3a-bd06-4073-96ca-d4fcaeb55048 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:36.888834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced4a3a-bd06-4073-96ca-d4fcaeb55048 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:36.899288 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 511/1025] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:36.900564 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23ba42-b76e-474f-a82c-3f3325ec1c06 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:37.004236 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23ba42-b76e-474f-a82c-3f3325ec1c06 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:37.038665 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a379d-ac07-4ceb-bfd0-2fdbed2f0b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:37.039565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a379d-ac07-4ceb-bfd0-2fdbed2f0b29 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:37.039851 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a379d-ac07-4ceb-bfd0-2fdbed2f0b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:37.040130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a379d-ac07-4ceb-bfd0-2fdbed2f0b29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:37.040889 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a379d-ac07-4ceb-bfd0-2fdbed2f0b29 None admin] RBAC: Adding query filter params (interface=public, service_id=490eb88ecaff4481987d9eb689132c11, region_id=RegionOne) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:37.041206 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a379d-ac07-4ceb-bfd0-2fdbed2f0b29 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:37.042581 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a379d-ac07-4ceb-bfd0-2fdbed2f0b29 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:37.052898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 515/1026] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 3 12:42:36 2022] GET /identity/v3/endpoints?service_id=490eb88ecaff4481987d9eb689132c11&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:37.053860 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced4a3a-bd06-4073-96ca-d4fcaeb55048 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:37.163148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced4a3a-bd06-4073-96ca-d4fcaeb55048 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:37.198644 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae488417-4ca3-4424-b48d-5ace8e9f7347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:37.199291 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae488417-4ca3-4424-b48d-5ace8e9f7347 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:37.199569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae488417-4ca3-4424-b48d-5ace8e9f7347 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:37.199847 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae488417-4ca3-4424-b48d-5ace8e9f7347 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:37.200501 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae488417-4ca3-4424-b48d-5ace8e9f7347 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:37.201866 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae488417-4ca3-4424-b48d-5ace8e9f7347 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:37.215014 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 512/1027] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 3 12:42:37 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:42:38.136484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10db585-a0ed-4c3b-9b88-198ba7812afe None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:38.137044 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10db585-a0ed-4c3b-9b88-198ba7812afe None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:38.137044 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10db585-a0ed-4c3b-9b88-198ba7812afe None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:38.138541 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 516/1028] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:38.146280 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdaaf03-fec5-41f9-b888-f00ea3e212ad None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:38.146574 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdaaf03-fec5-41f9-b888-f00ea3e212ad None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:38.146905 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdaaf03-fec5-41f9-b888-f00ea3e212ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:38.157078 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:38.168272 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-dcdaaf03-fec5-41f9-b888-f00ea3e212ad None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:38.173738 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-dcdaaf03-fec5-41f9-b888-f00ea3e212ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:38.237375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 513/1029] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:38.260432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10db585-a0ed-4c3b-9b88-198ba7812afe None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:38.323924 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:38.366452 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10db585-a0ed-4c3b-9b88-198ba7812afe None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:38.374484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a64df-43cd-42e6-871c-626fbc636668 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:38.374815 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a64df-43cd-42e6-871c-626fbc636668 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:38.375101 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a64df-43cd-42e6-871c-626fbc636668 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:38.376597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 514/1030] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:38.381892 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2561e-a040-4ce8-962d-76caf0a139b0 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:38.382189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2561e-a040-4ce8-962d-76caf0a139b0 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:38.382567 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2561e-a040-4ce8-962d-76caf0a139b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:38.400579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-dcd2561e-a040-4ce8-962d-76caf0a139b0 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:38.401698 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-dcd2561e-a040-4ce8-962d-76caf0a139b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:38.402048 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968d08a-27ce-47bf-a607-b1297fe03008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:38.402695 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968d08a-27ce-47bf-a607-b1297fe03008 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:38.403009 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968d08a-27ce-47bf-a607-b1297fe03008 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:38.403285 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968d08a-27ce-47bf-a607-b1297fe03008 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:38.413941 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968d08a-27ce-47bf-a607-b1297fe03008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:42:38.419288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-d968d08a-27ce-47bf-a607-b1297fe03008 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:42:38.419288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:38.419288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:38.419288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:38.419288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:38.419288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:38.419288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:38.419288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:38.419288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:38.419288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:38.419288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:38.419288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:38.419288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:42:38.419288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:42:38.419288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:42:38.419288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:42:38.420376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:42:38.420376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:42:38.420376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:42:38.420376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:42:38.420376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:38.420376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:38.420376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:38.420376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:38.420376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:38.420376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:38.420376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:38.420376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:38.420376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:38.420376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:38.420376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:38.420376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:38.421265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:38.421265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:38.421265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:38.421265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:38.421265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:42:38.421265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:42:38.421265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:42:38.421265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:42:38.421265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:42:38.421265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:42:38.421265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:42:38.421265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:38.426092 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 517/1031] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 3 12:42:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:38.426846 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968d08a-27ce-47bf-a607-b1297fe03008 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:38.476896 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 515/1032] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:38.501311 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2561e-a040-4ce8-962d-76caf0a139b0 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:38.529024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968d08a-27ce-47bf-a607-b1297fe03008 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:38.555598 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:38.564960 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:38.575021 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff8db4-5b84-4791-bd32-4f70847375c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:38.575881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff8db4-5b84-4791-bd32-4f70847375c8 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:38.576354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff8db4-5b84-4791-bd32-4f70847375c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:38.576847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff8db4-5b84-4791-bd32-4f70847375c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:38.578162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff8db4-5b84-4791-bd32-4f70847375c8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:38.578695 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff8db4-5b84-4791-bd32-4f70847375c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:38.580216 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff8db4-5b84-4791-bd32-4f70847375c8 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:38.591800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 518/1033] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 3 12:42:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:38.597212 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff8db4-5b84-4791-bd32-4f70847375c8 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:38.603818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2561e-a040-4ce8-962d-76caf0a139b0 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:38.645289 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e57241-7774-458c-a107-adc569a405fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:38.645939 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e57241-7774-458c-a107-adc569a405fc None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:38.646478 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e57241-7774-458c-a107-adc569a405fc None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:38.646787 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e57241-7774-458c-a107-adc569a405fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:38.648695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e57241-7774-458c-a107-adc569a405fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:38.650819 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e57241-7774-458c-a107-adc569a405fc None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:38.657219 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 516/1034] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:38.658291 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e57241-7774-458c-a107-adc569a405fc None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:38.704252 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff8db4-5b84-4791-bd32-4f70847375c8 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:38.741419 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e98ee6-7fc3-448f-afd6-72dcbbe0efc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:38.742062 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e98ee6-7fc3-448f-afd6-72dcbbe0efc1 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:38.742347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e98ee6-7fc3-448f-afd6-72dcbbe0efc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:38.742632 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e98ee6-7fc3-448f-afd6-72dcbbe0efc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:38.753103 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e98ee6-7fc3-448f-afd6-72dcbbe0efc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:38.754572 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e98ee6-7fc3-448f-afd6-72dcbbe0efc1 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:38.769211 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e57241-7774-458c-a107-adc569a405fc None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:38.769847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-58e98ee6-7fc3-448f-afd6-72dcbbe0efc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:38.769847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:38.769847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:38.769847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:38.769847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:38.769847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:38.769847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:38.769847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:38.769847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:38.769847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:38.769847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:38.769847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:38.769847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:38.769847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:38.769847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:38.770714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:38.770714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:38.770714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:38.770714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:38.770714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:38.770714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:38.770714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:38.770714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:38.770714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:38.770714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:38.770714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:38.770714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:38.770714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:38.770714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:38.770714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:38.770714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:38.770714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:38.772075 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:38.772075 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:38.772075 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:38.772075 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:38.772075 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 519/1035] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:38.776590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e98ee6-7fc3-448f-afd6-72dcbbe0efc1 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:38.811356 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:38.813588 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:38.817530 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a84f67-4771-4bf0-8c50-67ca2c7bb61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:38.818152 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a84f67-4771-4bf0-8c50-67ca2c7bb61b None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:38.818431 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a84f67-4771-4bf0-8c50-67ca2c7bb61b None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:38.818795 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a84f67-4771-4bf0-8c50-67ca2c7bb61b None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:38.819437 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a84f67-4771-4bf0-8c50-67ca2c7bb61b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:38.820853 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a84f67-4771-4bf0-8c50-67ca2c7bb61b None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:38.879130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e98ee6-7fc3-448f-afd6-72dcbbe0efc1 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:38.899561 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 517/1036] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 3 12:42:38 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:42:38.917727 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60a865-e74e-4776-91ff-7f33791ce942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:38.918381 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60a865-e74e-4776-91ff-7f33791ce942 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:38.918666 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60a865-e74e-4776-91ff-7f33791ce942 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:38.918972 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60a865-e74e-4776-91ff-7f33791ce942 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:38.919743 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60a865-e74e-4776-91ff-7f33791ce942 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:38.920128 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60a865-e74e-4776-91ff-7f33791ce942 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:38.921489 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60a865-e74e-4776-91ff-7f33791ce942 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:38.937835 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 520/1037] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:38.941184 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a84f67-4771-4bf0-8c50-67ca2c7bb61b None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:39.056891 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a84f67-4771-4bf0-8c50-67ca2c7bb61b None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:39.092133 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fefccd-5209-4d65-ac57-64014409c4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:39.092783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fefccd-5209-4d65-ac57-64014409c4fa None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:39.093068 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fefccd-5209-4d65-ac57-64014409c4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:39.093344 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fefccd-5209-4d65-ac57-64014409c4fa None admin] PATH_INFO: `/v3/users/nova` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:39.102507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fefccd-5209-4d65-ac57-64014409c4fa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:39.103986 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fefccd-5209-4d65-ac57-64014409c4fa None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:39.115416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-e0fefccd-5209-4d65-ac57-64014409c4fa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:42:39.115416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:39.115416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:39.115416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:39.115416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:39.115416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:39.115416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:39.115416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:39.115416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:39.115416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:39.115416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:39.115416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:39.115416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:42:39.115416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:42:39.115416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:42:39.115416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:42:39.116598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:39.116598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:39.116598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:42:39.116598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:39.116598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:42:39.116598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:39.116598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:39.116598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:39.116598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:39.116598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:39.116598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:39.116598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:39.116598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:39.116598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:39.116598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:39.116598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:39.116598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:39.116598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:39.117875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:39.117875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:39.117875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:42:39.117875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:42:39.117875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:42:39.117875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:42:39.117875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:42:39.117875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:42:39.117875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:42:39.117875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:39.117875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 518/1038] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 3 12:42:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:39.123769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60a865-e74e-4776-91ff-7f33791ce942 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:39.222929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e08a1e-df1c-4613-aa9f-8fe94cfc777d None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:39.223219 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e08a1e-df1c-4613-aa9f-8fe94cfc777d None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:39.223428 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e08a1e-df1c-4613-aa9f-8fe94cfc777d None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:39.224786 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 519/1039] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:42:39.229681 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1206c-1a03-43f4-8d87-b99bb7f1ad8f None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:39.229974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1206c-1a03-43f4-8d87-b99bb7f1ad8f None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:39.230255 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1206c-1a03-43f4-8d87-b99bb7f1ad8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:39.230906 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:39.237890 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60a865-e74e-4776-91ff-7f33791ce942 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:39.248480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-d8e1206c-1a03-43f4-8d87-b99bb7f1ad8f None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:39.249730 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d8e1206c-1a03-43f4-8d87-b99bb7f1ad8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:39.273206 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af40e49-ce0d-4f4d-8c78-d0b81c6580e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:39.274028 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af40e49-ce0d-4f4d-8c78-d0b81c6580e8 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:39.274725 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af40e49-ce0d-4f4d-8c78-d0b81c6580e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:39.275470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af40e49-ce0d-4f4d-8c78-d0b81c6580e8 None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:39.276279 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af40e49-ce0d-4f4d-8c78-d0b81c6580e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:39.276595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af40e49-ce0d-4f4d-8c78-d0b81c6580e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:39.278035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af40e49-ce0d-4f4d-8c78-d0b81c6580e8 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:39.298382 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:39.300721 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 521/1040] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 3 12:42:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:39.306412 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af40e49-ce0d-4f4d-8c78-d0b81c6580e8 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:39.323196 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 520/1041] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:39.346182 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1206c-1a03-43f4-8d87-b99bb7f1ad8f None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:39.411013 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af40e49-ce0d-4f4d-8c78-d0b81c6580e8 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:39.447657 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872156cf-2457-4043-bf0e-323208e86037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:39.448276 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872156cf-2457-4043-bf0e-323208e86037 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:39.448558 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872156cf-2457-4043-bf0e-323208e86037 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:39.448837 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872156cf-2457-4043-bf0e-323208e86037 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:39.452816 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1206c-1a03-43f4-8d87-b99bb7f1ad8f None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:39.475958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:39.494941 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf64af1-7c2f-408f-baa0-f47fd2abe9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:39.495629 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf64af1-7c2f-408f-baa0-f47fd2abe9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:39.495922 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf64af1-7c2f-408f-baa0-f47fd2abe9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:39.496205 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf64af1-7c2f-408f-baa0-f47fd2abe9c5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:39.496849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf64af1-7c2f-408f-baa0-f47fd2abe9c5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:39.498474 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf64af1-7c2f-408f-baa0-f47fd2abe9c5 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:39.508900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-6cf64af1-7c2f-408f-baa0-f47fd2abe9c5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:42:39.508900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:39.508900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:42:39.508900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:42:39.508900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:42:39.508900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:42:39.508900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:42:39.508900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:39.508900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:42:39.508900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:39.508900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:42:39.508900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:39.508900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:39.508900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:39.508900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:39.508900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:39.508900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:39.509917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:39.509917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:39.509917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:39.509917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:39.509917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:39.509917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:39.509917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:42:39.509917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:42:39.509917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:42:39.509917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:42:39.509917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:39.509917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:39.509917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:39.509917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:39.509917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:39.509917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:39.510783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:39.510783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:39.510783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:39.510783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:39.510783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:39.510783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:39.510783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:39.510783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:39.510783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:39.510783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:39.510783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:42:39.510783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:42:39.510783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:42:39.510783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:39.510783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 521/1042] 10.222.0.64 () {56 vars in 1105 bytes} [Wed Aug 3 12:42:39 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:39.516073 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf64af1-7c2f-408f-baa0-f47fd2abe9c5 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:39.533500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872156cf-2457-4043-bf0e-323208e86037 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:39.535101 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872156cf-2457-4043-bf0e-323208e86037 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:39.561102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:39.621875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf64af1-7c2f-408f-baa0-f47fd2abe9c5 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:39.635974 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 522/1043] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:42:39 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 03 12:42:39.641485 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872156cf-2457-4043-bf0e-323208e86037 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:39.665316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950051b-b08b-4ef1-9947-718d04f39287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:39.665943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950051b-b08b-4ef1-9947-718d04f39287 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:39.666229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950051b-b08b-4ef1-9947-718d04f39287 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:39.666511 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950051b-b08b-4ef1-9947-718d04f39287 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:39.667236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950051b-b08b-4ef1-9947-718d04f39287 None admin] RBAC: Adding query filter params (name=image) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:39.667547 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950051b-b08b-4ef1-9947-718d04f39287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:39.668926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950051b-b08b-4ef1-9947-718d04f39287 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:39.673785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 522/1044] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:39.680214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950051b-b08b-4ef1-9947-718d04f39287 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:39.700579 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:39.752847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872156cf-2457-4043-bf0e-323208e86037 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:39.785034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950051b-b08b-4ef1-9947-718d04f39287 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:39.789707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90770868-f918-4bfe-8848-1aa0b94aec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:39.790461 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90770868-f918-4bfe-8848-1aa0b94aec3b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:39.790773 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90770868-f918-4bfe-8848-1aa0b94aec3b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:39.791060 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90770868-f918-4bfe-8848-1aa0b94aec3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:39.792449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:39.802549 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90770868-f918-4bfe-8848-1aa0b94aec3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:39.804035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90770868-f918-4bfe-8848-1aa0b94aec3b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:39.818674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-90770868-f918-4bfe-8848-1aa0b94aec3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:39.818674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:39.818674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:39.818674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:39.818674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:39.818674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:39.818674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:39.818674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:39.818674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:39.818674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:39.818674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:39.818674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:39.818674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:39.818674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:39.818674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:39.819601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:39.819601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:39.819601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:39.819601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:39.819601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:39.819601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:39.819601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:39.819601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:39.819601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:39.819601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:39.819601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:39.819601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:39.819601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:39.819601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:39.819601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:39.819601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:39.819601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:39.820527 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:39.820527 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:39.820527 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:39.820527 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:39.820527 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 523/1045] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:39.825572 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90770868-f918-4bfe-8848-1aa0b94aec3b None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:39.826228 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d406f8f-c8f6-4d39-a503-0fcab2422a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:39.826881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d406f8f-c8f6-4d39-a503-0fcab2422a4e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:39.827173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d406f8f-c8f6-4d39-a503-0fcab2422a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:39.827452 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d406f8f-c8f6-4d39-a503-0fcab2422a4e None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:39.828182 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d406f8f-c8f6-4d39-a503-0fcab2422a4e None admin] RBAC: Adding query filter params (type=image) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:39.828883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d406f8f-c8f6-4d39-a503-0fcab2422a4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:39.830289 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d406f8f-c8f6-4d39-a503-0fcab2422a4e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:39.840427 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 523/1046] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:39.841193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d406f8f-c8f6-4d39-a503-0fcab2422a4e None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:39.931926 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90770868-f918-4bfe-8848-1aa0b94aec3b None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:39.934664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:39.950938 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d406f8f-c8f6-4d39-a503-0fcab2422a4e None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:39.968676 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4935c-2338-4c64-a29b-9cc269de8b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:39.969304 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4935c-2338-4c64-a29b-9cc269de8b00 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:39.969592 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4935c-2338-4c64-a29b-9cc269de8b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:39.969873 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4935c-2338-4c64-a29b-9cc269de8b00 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:39.970569 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4935c-2338-4c64-a29b-9cc269de8b00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:39.970963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4935c-2338-4c64-a29b-9cc269de8b00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:39.972341 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4935c-2338-4c64-a29b-9cc269de8b00 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:39.983705 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 524/1047] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:39.990298 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4935c-2338-4c64-a29b-9cc269de8b00 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:39.994259 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007b370-659b-442b-bb16-77034e0c8bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:39.994676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007b370-659b-442b-bb16-77034e0c8bc9 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:39.994996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007b370-659b-442b-bb16-77034e0c8bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:39.995285 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007b370-659b-442b-bb16-77034e0c8bc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:39.996052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007b370-659b-442b-bb16-77034e0c8bc9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:39.997421 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007b370-659b-442b-bb16-77034e0c8bc9 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:40.076316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 524/1048] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:42:39 2022] POST /identity/v3/endpoints => generated 327 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:42:40.100504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4935c-2338-4c64-a29b-9cc269de8b00 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:40.151086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a403bf-fa94-4769-bc2c-7cb6c297cf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:40.152164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a403bf-fa94-4769-bc2c-7cb6c297cf6c None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:40.152667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a403bf-fa94-4769-bc2c-7cb6c297cf6c None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:40.153145 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a403bf-fa94-4769-bc2c-7cb6c297cf6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:40.162340 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a403bf-fa94-4769-bc2c-7cb6c297cf6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:40.164497 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a403bf-fa94-4769-bc2c-7cb6c297cf6c None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:40.177806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-66a403bf-fa94-4769-bc2c-7cb6c297cf6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:40.177806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:40.177806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:40.177806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:40.177806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:40.177806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:40.177806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:40.177806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:40.177806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:40.177806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:40.177806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:40.177806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:40.177806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:42:40.177806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:42:40.177806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:42:40.178774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:42:40.178774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:40.178774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:40.178774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:40.178774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:40.178774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:40.178774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:40.178774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:40.178774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:40.178774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:40.178774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:40.178774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:40.178774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:40.178774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:40.178774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:40.178774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:40.178774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:40.179667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:42:40.179667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:42:40.179667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:42:40.179667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:42:40.179667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:42:40.179667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:42:40.179667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:40.179667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:40.180093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 525/1049] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:42:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:40.186997 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007b370-659b-442b-bb16-77034e0c8bc9 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:40.221992 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:40.304122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007b370-659b-442b-bb16-77034e0c8bc9 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:40.338096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b8210-acfa-4fe4-9ed2-61859830a4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:40.338642 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b8210-acfa-4fe4-9ed2-61859830a4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:40.338951 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b8210-acfa-4fe4-9ed2-61859830a4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:40.339227 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b8210-acfa-4fe4-9ed2-61859830a4d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:40.339975 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b8210-acfa-4fe4-9ed2-61859830a4d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:40.340283 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b8210-acfa-4fe4-9ed2-61859830a4d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:40.341726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b8210-acfa-4fe4-9ed2-61859830a4d3 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:40.354045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 525/1050] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:42:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:40.360349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a403bf-fa94-4769-bc2c-7cb6c297cf6c None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:40.383704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:40.464886 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a403bf-fa94-4769-bc2c-7cb6c297cf6c None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:40.499837 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9d2e4-db28-4835-994f-08edc1fd8ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:40.500456 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9d2e4-db28-4835-994f-08edc1fd8ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:40.500743 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9d2e4-db28-4835-994f-08edc1fd8ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:40.501021 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9d2e4-db28-4835-994f-08edc1fd8ba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:40.501867 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9d2e4-db28-4835-994f-08edc1fd8ba1 None admin] RBAC: Adding query filter params (role.id=68aa1e11e519409289c25ac896f855aa, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=bc939818c9224b0ebe2dbaa1eaaec5e5) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:40.502197 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9d2e4-db28-4835-994f-08edc1fd8ba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:40.503654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9d2e4-db28-4835-994f-08edc1fd8ba1 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:40.514825 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 526/1051] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:42:40 2022] GET /identity/v3/role_assignments?user.id=bc939818c9224b0ebe2dbaa1eaaec5e5&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=68aa1e11e519409289c25ac896f855aa => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:40.978698 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57136160-e0a6-4ad8-96f7-bdfe2094e4ab None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:40.979098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57136160-e0a6-4ad8-96f7-bdfe2094e4ab None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:40.979277 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57136160-e0a6-4ad8-96f7-bdfe2094e4ab None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:40.980677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 526/1052] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:40.985640 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822438f-0a4c-4560-b3da-62b37dcb9274 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:40.985934 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822438f-0a4c-4560-b3da-62b37dcb9274 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:40.986218 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822438f-0a4c-4560-b3da-62b37dcb9274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:41.005226 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-2822438f-0a4c-4560-b3da-62b37dcb9274 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:41.006417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-2822438f-0a4c-4560-b3da-62b37dcb9274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:41.073261 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 527/1053] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:41.096117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57136160-e0a6-4ad8-96f7-bdfe2094e4ab None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:41.183066 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:41.199719 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57136160-e0a6-4ad8-96f7-bdfe2094e4ab None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:41.235296 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8c792-9cbb-4f19-9cd8-c8bc7d0119a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:41.236276 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8c792-9cbb-4f19-9cd8-c8bc7d0119a6 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:41.237512 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8c792-9cbb-4f19-9cd8-c8bc7d0119a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:41.237994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8c792-9cbb-4f19-9cd8-c8bc7d0119a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:41.249878 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8c792-9cbb-4f19-9cd8-c8bc7d0119a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:42:41.255915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-3af8c792-9cbb-4f19-9cd8-c8bc7d0119a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:42:41.255915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:41.255915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:41.255915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:41.255915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:41.255915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:41.255915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:41.255915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:41.255915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:41.255915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:41.255915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:41.255915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:41.255915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:42:41.255915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:42:41.255915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:42:41.255915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:42:41.256829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:42:41.256829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:42:41.256829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:42:41.256829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:42:41.256829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:41.256829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:41.256829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:41.256829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:41.256829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:41.256829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:41.256829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:41.256829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:41.256829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:41.256829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:41.256829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:41.256829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:41.257668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:41.257668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:41.257668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:41.257668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:41.257668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:42:41.257668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:42:41.257668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:42:41.257668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:42:41.257668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:42:41.257668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:42:41.257668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:42:41.257668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:41.260090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 527/1054] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:42:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:41.265693 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822438f-0a4c-4560-b3da-62b37dcb9274 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:41.281449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:41.367090 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822438f-0a4c-4560-b3da-62b37dcb9274 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:41.401112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821dea0-43c9-4513-a6ec-61a1fa762182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:41.404512 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821dea0-43c9-4513-a6ec-61a1fa762182 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:41.404512 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821dea0-43c9-4513-a6ec-61a1fa762182 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:41.404512 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821dea0-43c9-4513-a6ec-61a1fa762182 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:41.404512 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821dea0-43c9-4513-a6ec-61a1fa762182 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:41.404512 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821dea0-43c9-4513-a6ec-61a1fa762182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:41.404887 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821dea0-43c9-4513-a6ec-61a1fa762182 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:41.418297 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 528/1055] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:42:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:41.419882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8c792-9cbb-4f19-9cd8-c8bc7d0119a6 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:41.527195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8c792-9cbb-4f19-9cd8-c8bc7d0119a6 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:41.562590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452b927-d53f-4cdf-83b6-865a86578e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:41.563280 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452b927-d53f-4cdf-83b6-865a86578e28 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:41.563568 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452b927-d53f-4cdf-83b6-865a86578e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:41.563848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452b927-d53f-4cdf-83b6-865a86578e28 None admin] PATH_INFO: `/v3/users/2c82e595b0614ae7a87f6f8002d4759a` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:41.578689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452b927-d53f-4cdf-83b6-865a86578e28 None admin] RBAC: Authorizing `identity:get_user(user_id=2c82e595b0614ae7a87f6f8002d4759a)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:41.580842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452b927-d53f-4cdf-83b6-865a86578e28 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:41.587447 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 528/1056] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:42:41 2022] GET /identity/v3/users/2c82e595b0614ae7a87f6f8002d4759a => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:41.588787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821dea0-43c9-4513-a6ec-61a1fa762182 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:41.671662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:41.694922 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821dea0-43c9-4513-a6ec-61a1fa762182 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:41.728676 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aeaea-0f03-41c1-a22f-4897775782aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:41.729297 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aeaea-0f03-41c1-a22f-4897775782aa None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:41.729583 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aeaea-0f03-41c1-a22f-4897775782aa None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:41.729861 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aeaea-0f03-41c1-a22f-4897775782aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:41.797363 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200aeaea-0f03-41c1-a22f-4897775782aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:41.798761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200aeaea-0f03-41c1-a22f-4897775782aa None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:41.872714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:41.901674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 529/1057] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:42:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:42:41.903576 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452b927-d53f-4cdf-83b6-865a86578e28 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:41.908095 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:42.007647 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452b927-d53f-4cdf-83b6-865a86578e28 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:42.041469 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccab72-2ebc-4054-8033-d0a73c43a278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:42.042115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccab72-2ebc-4054-8033-d0a73c43a278 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:42.042404 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccab72-2ebc-4054-8033-d0a73c43a278 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:42.042683 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccab72-2ebc-4054-8033-d0a73c43a278 None admin] PATH_INFO: `/v3/projects/685677609833439198ef21f0d7d747e8` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:42.043881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccab72-2ebc-4054-8033-d0a73c43a278 None admin] RBAC: Authorizing `identity:get_project(project_id=685677609833439198ef21f0d7d747e8)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:42.045316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccab72-2ebc-4054-8033-d0a73c43a278 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:42.051035 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 529/1058] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:42:41 2022] GET /identity/v3/projects/685677609833439198ef21f0d7d747e8 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:42.054110 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aeaea-0f03-41c1-a22f-4897775782aa None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:42.145065 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162a311-3edc-49d7-814a-397be1c2df5b None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:42.145352 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162a311-3edc-49d7-814a-397be1c2df5b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:42.145628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162a311-3edc-49d7-814a-397be1c2df5b None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:42.147441 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 530/1059] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:42.153995 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fd846-ad32-4a3c-b5b8-ea67f47d3b15 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:42.154563 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fd846-ad32-4a3c-b5b8-ea67f47d3b15 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:42.155364 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fd846-ad32-4a3c-b5b8-ea67f47d3b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:42.158244 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aeaea-0f03-41c1-a22f-4897775782aa None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:42.175061 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-969fd846-ad32-4a3c-b5b8-ea67f47d3b15 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:42.176249 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-969fd846-ad32-4a3c-b5b8-ea67f47d3b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:42.200762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f0437-7b07-4dd0-b3f7-6332d9b4c838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:42.201384 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f0437-7b07-4dd0-b3f7-6332d9b4c838 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:42.201671 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f0437-7b07-4dd0-b3f7-6332d9b4c838 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:42.201952 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f0437-7b07-4dd0-b3f7-6332d9b4c838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:42.202767 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f0437-7b07-4dd0-b3f7-6332d9b4c838 None admin] RBAC: Adding query filter params (role.id=a6d209169b77456f9f1cc3ff53646cfc, scope.project.id=685677609833439198ef21f0d7d747e8, user.id=2c82e595b0614ae7a87f6f8002d4759a) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:42.203096 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f0437-7b07-4dd0-b3f7-6332d9b4c838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:42.204515 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f0437-7b07-4dd0-b3f7-6332d9b4c838 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:42.218764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 530/1060] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:42:42 2022] GET /identity/v3/role_assignments?user.id=2c82e595b0614ae7a87f6f8002d4759a&scope.project.id=685677609833439198ef21f0d7d747e8&role.id=a6d209169b77456f9f1cc3ff53646cfc => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:42.258280 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 531/1061] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:42.280917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f0437-7b07-4dd0-b3f7-6332d9b4c838 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:42.326813 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:42.390637 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f0437-7b07-4dd0-b3f7-6332d9b4c838 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:42.427834 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555077d-d0c9-40cd-8791-8a0560142cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:42.428706 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555077d-d0c9-40cd-8791-8a0560142cde None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:42.429163 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555077d-d0c9-40cd-8791-8a0560142cde None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:42.429591 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555077d-d0c9-40cd-8791-8a0560142cde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:42.512779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c64299-2b39-4722-ba0c-5296277feffa None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:42.513306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c64299-2b39-4722-ba0c-5296277feffa None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:42.513306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c64299-2b39-4722-ba0c-5296277feffa None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:42.514915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 532/1062] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:42:42.519544 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c9c4d-3f1e-4b21-923d-35aad2ae27a4 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:42.519834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c9c4d-3f1e-4b21-923d-35aad2ae27a4 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:42.520114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c9c4d-3f1e-4b21-923d-35aad2ae27a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:42.526386 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:42.539045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-357c9c4d-3f1e-4b21-923d-35aad2ae27a4 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:42.540232 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-357c9c4d-3f1e-4b21-923d-35aad2ae27a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:42.544689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555077d-d0c9-40cd-8791-8a0560142cde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:42.546441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555077d-d0c9-40cd-8791-8a0560142cde None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:42.591583 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:42.609689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 533/1063] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:42.632411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c9c4d-3f1e-4b21-923d-35aad2ae27a4 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:42.658908 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 531/1064] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:42:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:42:42.663349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555077d-d0c9-40cd-8791-8a0560142cde None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:42.737923 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c9c4d-3f1e-4b21-923d-35aad2ae27a4 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:42.765697 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555077d-d0c9-40cd-8791-8a0560142cde None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:42.772629 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:42.780815 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98429ebd-f64a-4ce9-aa6a-43b4fc385cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:42.781466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98429ebd-f64a-4ce9-aa6a-43b4fc385cbe None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:42.782873 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98429ebd-f64a-4ce9-aa6a-43b4fc385cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:42.782873 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98429ebd-f64a-4ce9-aa6a-43b4fc385cbe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:42.793532 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98429ebd-f64a-4ce9-aa6a-43b4fc385cbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:42:42.798475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-98429ebd-f64a-4ce9-aa6a-43b4fc385cbe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:42:42.798475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:42.798475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:42.798475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:42.798475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:42.798475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:42.798475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:42.798475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:42.798475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:42.798475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:42.798475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:42.798475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:42.798475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:42:42.798475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:42:42.798475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:42:42.798475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:42:42.799692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:42:42.799692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:42:42.799692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:42:42.799692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:42:42.799692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:42.799692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:42.799692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:42.799692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:42.799692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:42.799692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:42.799692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:42.799692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:42.799692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:42.799692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:42.799692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:42.799692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:42.800737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:42.800737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:42.800737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:42.800737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:42.800737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:42:42.800737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:42:42.800737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:42:42.800737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:42:42.800737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:42:42.800737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:42:42.800737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:42:42.800737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:42.804588 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 534/1065] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 3 12:42:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:42.805527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98429ebd-f64a-4ce9-aa6a-43b4fc385cbe None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:42.807477 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666dc7e6-2ce7-4848-a593-717aefe7ac00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:42.808137 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666dc7e6-2ce7-4848-a593-717aefe7ac00 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:42.808427 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666dc7e6-2ce7-4848-a593-717aefe7ac00 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:42.808746 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666dc7e6-2ce7-4848-a593-717aefe7ac00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:42.817702 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:42.819853 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666dc7e6-2ce7-4848-a593-717aefe7ac00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:42.821572 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666dc7e6-2ce7-4848-a593-717aefe7ac00 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:42.836892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-666dc7e6-2ce7-4848-a593-717aefe7ac00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:42.836892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:42.836892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:42.836892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:42.836892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:42.836892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:42.836892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:42.836892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:42.836892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:42.836892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:42.836892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:42.836892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:42.836892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:42.836892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:42.836892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:42.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:42.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:42.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:42.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:42.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:42.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:42.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:42.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:42.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:42.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:42.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:42.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:42.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:42.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:42.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:42.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:42.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:42.838704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:42.838704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:42.838704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:42.838704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:42.838704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 532/1066] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:42.843979 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666dc7e6-2ce7-4848-a593-717aefe7ac00 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:42.919609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98429ebd-f64a-4ce9-aa6a-43b4fc385cbe None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:42.951027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666dc7e6-2ce7-4848-a593-717aefe7ac00 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:42.956053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec69c6e-7347-4ff2-aefb-1a37110ca894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:42.956682 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec69c6e-7347-4ff2-aefb-1a37110ca894 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:42.956970 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec69c6e-7347-4ff2-aefb-1a37110ca894 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:42.957251 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec69c6e-7347-4ff2-aefb-1a37110ca894 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:42.957976 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec69c6e-7347-4ff2-aefb-1a37110ca894 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:42.958290 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec69c6e-7347-4ff2-aefb-1a37110ca894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:42.960134 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec69c6e-7347-4ff2-aefb-1a37110ca894 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:42.969796 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 535/1067] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 3 12:42:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:42.975774 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec69c6e-7347-4ff2-aefb-1a37110ca894 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:42.988489 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f7e9b-c741-4c7b-9c1a-a67157408ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:42.989102 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f7e9b-c741-4c7b-9c1a-a67157408ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:42.989382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f7e9b-c741-4c7b-9c1a-a67157408ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:42.989656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f7e9b-c741-4c7b-9c1a-a67157408ad7 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:42.990338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f7e9b-c741-4c7b-9c1a-a67157408ad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:42.990761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f7e9b-c741-4c7b-9c1a-a67157408ad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:42.992054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f7e9b-c741-4c7b-9c1a-a67157408ad7 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:43.004593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 533/1068] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:43.039034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:43.088864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec69c6e-7347-4ff2-aefb-1a37110ca894 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:43.125856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa47c34-de5e-47dc-988d-dbf4e4294c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:43.126433 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa47c34-de5e-47dc-988d-dbf4e4294c74 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:43.126720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa47c34-de5e-47dc-988d-dbf4e4294c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:43.127528 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa47c34-de5e-47dc-988d-dbf4e4294c74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:43.139483 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa47c34-de5e-47dc-988d-dbf4e4294c74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:43.144159 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa47c34-de5e-47dc-988d-dbf4e4294c74 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:43.162257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-6aa47c34-de5e-47dc-988d-dbf4e4294c74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:43.162257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:43.162257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:43.162257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:43.162257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:43.162257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:43.162257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:43.162257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:43.162257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:43.162257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:43.162257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:43.162257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:43.162257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:43.162257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:43.162257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:43.163410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:43.163410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:43.163410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:43.163410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:43.163410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:43.163410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:43.163410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:43.163410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:43.163410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:43.163410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:43.163410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:43.163410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:43.163410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:43.163410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:43.163410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:43.163410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:43.163410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:43.164552 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:43.164552 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:43.164552 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:43.164552 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:43.164552 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 536/1069] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:43.169017 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f7e9b-c741-4c7b-9c1a-a67157408ad7 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:43.228890 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:43.276815 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f7e9b-c741-4c7b-9c1a-a67157408ad7 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:43.313573 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b31d7-c5af-4326-8ed0-a4664bd6c541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:43.314204 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b31d7-c5af-4326-8ed0-a4664bd6c541 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:43.315004 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b31d7-c5af-4326-8ed0-a4664bd6c541 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:43.315281 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b31d7-c5af-4326-8ed0-a4664bd6c541 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:43.315980 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b31d7-c5af-4326-8ed0-a4664bd6c541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:43.316288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b31d7-c5af-4326-8ed0-a4664bd6c541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:43.317655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b31d7-c5af-4326-8ed0-a4664bd6c541 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:43.331054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 534/1070] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:43.336569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa47c34-de5e-47dc-988d-dbf4e4294c74 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:43.434664 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa47c34-de5e-47dc-988d-dbf4e4294c74 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:43.442171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:43.468102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac30b7e-c618-4559-8feb-c708d1dde8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:43.468737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac30b7e-c618-4559-8feb-c708d1dde8f3 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:43.469027 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac30b7e-c618-4559-8feb-c708d1dde8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:43.469309 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac30b7e-c618-4559-8feb-c708d1dde8f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:43.476949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac30b7e-c618-4559-8feb-c708d1dde8f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:43.478380 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac30b7e-c618-4559-8feb-c708d1dde8f3 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:43.490264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-2ac30b7e-c618-4559-8feb-c708d1dde8f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:42:43.490264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:43.490264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:43.490264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:43.490264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:43.490264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:43.490264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:43.490264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:43.490264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:43.490264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:43.490264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:43.490264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:43.490264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:42:43.490264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:42:43.490264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:42:43.490264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:42:43.491402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:43.491402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:43.491402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:42:43.491402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:43.491402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:42:43.491402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:43.491402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:43.491402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:43.491402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:43.491402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:43.491402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:43.491402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:43.491402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:43.491402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:43.491402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:43.491402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:43.491402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:43.491402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:43.492509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:43.492509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:43.492509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:42:43.492509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:42:43.492509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:42:43.492509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:42:43.492509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:42:43.492509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:42:43.492509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:42:43.492509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:43.494885 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 537/1071] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 3 12:42:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:43.497011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b31d7-c5af-4326-8ed0-a4664bd6c541 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:43.595477 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b31d7-c5af-4326-8ed0-a4664bd6c541 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:43.608105 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:43.629391 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d7577-c2b5-470d-b4d5-315cfad73995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:43.630004 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d7577-c2b5-470d-b4d5-315cfad73995 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:43.630343 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d7577-c2b5-470d-b4d5-315cfad73995 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:43.630624 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d7577-c2b5-470d-b4d5-315cfad73995 None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:43.631450 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d7577-c2b5-470d-b4d5-315cfad73995 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:43.631761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d7577-c2b5-470d-b4d5-315cfad73995 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:43.633282 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d7577-c2b5-470d-b4d5-315cfad73995 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:43.650839 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 535/1072] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 3 12:42:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:43.657067 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac30b7e-c618-4559-8feb-c708d1dde8f3 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:43.754177 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac30b7e-c618-4559-8feb-c708d1dde8f3 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:43.786797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311901f9-85ea-4d10-80c2-140784116de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:43.787436 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311901f9-85ea-4d10-80c2-140784116de1 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:43.787718 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311901f9-85ea-4d10-80c2-140784116de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:43.787995 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311901f9-85ea-4d10-80c2-140784116de1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:43.798694 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311901f9-85ea-4d10-80c2-140784116de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:43.800657 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311901f9-85ea-4d10-80c2-140784116de1 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:43.814425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-311901f9-85ea-4d10-80c2-140784116de1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:43.814425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:43.814425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:43.814425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:43.814425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:43.814425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:43.814425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:43.814425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:43.814425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:43.814425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:43.814425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:43.814425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:43.814425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:43.814425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:43.814425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:43.815509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:43.815509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:43.815509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:43.815509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:43.815509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:43.815509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:43.815509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:43.815509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:43.815509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:43.815509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:43.815509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:43.815509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:43.815509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:43.815509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:43.815509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:43.815509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:43.815509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:43.816424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:43.816424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:43.816424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:43.816424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:43.816424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 538/1073] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:43.821202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d7577-c2b5-470d-b4d5-315cfad73995 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:43.918125 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d7577-c2b5-470d-b4d5-315cfad73995 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:43.950972 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818ccd6-6839-409d-b351-f13b7bdd4dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:43.951586 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818ccd6-6839-409d-b351-f13b7bdd4dfb None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:43.951864 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818ccd6-6839-409d-b351-f13b7bdd4dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:43.952135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818ccd6-6839-409d-b351-f13b7bdd4dfb None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:43.952817 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818ccd6-6839-409d-b351-f13b7bdd4dfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:43.953120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818ccd6-6839-409d-b351-f13b7bdd4dfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:43.954471 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818ccd6-6839-409d-b351-f13b7bdd4dfb None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:43.969981 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 536/1074] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:43.971673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311901f9-85ea-4d10-80c2-140784116de1 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:43.991919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:44.069579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311901f9-85ea-4d10-80c2-140784116de1 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:44.102423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dbf79-bd6b-4837-ba94-b020c70b5dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:44.103095 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dbf79-bd6b-4837-ba94-b020c70b5dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:44.103382 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dbf79-bd6b-4837-ba94-b020c70b5dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:44.103663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dbf79-bd6b-4837-ba94-b020c70b5dc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:44.110181 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1dbf79-bd6b-4837-ba94-b020c70b5dc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:44.112384 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1dbf79-bd6b-4837-ba94-b020c70b5dc0 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:44.124102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-8c1dbf79-bd6b-4837-ba94-b020c70b5dc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:44.124102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:44.124102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:44.124102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:44.124102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:44.124102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:44.124102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:44.124102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:44.124102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:44.124102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:44.124102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:44.124102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:44.124102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:42:44.124102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:42:44.124102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:42:44.125147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:42:44.125147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:44.125147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:44.125147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:44.125147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:44.125147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:44.125147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:44.125147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:44.125147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:44.125147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:44.125147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:44.125147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:44.125147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:44.125147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:44.125147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:44.125147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:44.125147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:44.130778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:42:44.130778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:42:44.130778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:42:44.130778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:42:44.130778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:42:44.130778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:42:44.130778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:44.130778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:44.130778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 539/1075] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:42:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:44.131276 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818ccd6-6839-409d-b351-f13b7bdd4dfb None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:44.164942 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:44.192670 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c97190-f912-4ce3-a5ea-1d58a669188e None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:44.192956 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c97190-f912-4ce3-a5ea-1d58a669188e None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:44.193237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c97190-f912-4ce3-a5ea-1d58a669188e None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:44.194697 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 540/1076] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:42:44.199667 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a921258-f88e-408c-8bc0-18f4d3960e8a None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:44.199964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a921258-f88e-408c-8bc0-18f4d3960e8a None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:44.200243 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a921258-f88e-408c-8bc0-18f4d3960e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:44.218092 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-1a921258-f88e-408c-8bc0-18f4d3960e8a None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:44.219309 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-1a921258-f88e-408c-8bc0-18f4d3960e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:44.233027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818ccd6-6839-409d-b351-f13b7bdd4dfb None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:44.266094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a97b40-d7c7-4d4f-be19-e2e6bf62b039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:44.266715 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a97b40-d7c7-4d4f-be19-e2e6bf62b039 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:44.267030 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a97b40-d7c7-4d4f-be19-e2e6bf62b039 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:44.267315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a97b40-d7c7-4d4f-be19-e2e6bf62b039 None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:44.268589 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a97b40-d7c7-4d4f-be19-e2e6bf62b039 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:44.268902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a97b40-d7c7-4d4f-be19-e2e6bf62b039 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:44.270326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a97b40-d7c7-4d4f-be19-e2e6bf62b039 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:44.281999 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 537/1077] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:42:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:44.288869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a97b40-d7c7-4d4f-be19-e2e6bf62b039 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:44.291150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 541/1078] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:44.312696 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a921258-f88e-408c-8bc0-18f4d3960e8a None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:44.322617 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:44.379577 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:44.389031 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a97b40-d7c7-4d4f-be19-e2e6bf62b039 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:44.410266 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a921258-f88e-408c-8bc0-18f4d3960e8a None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:44.424119 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2e4cf-701d-444a-a401-a14258067ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:44.424786 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2e4cf-701d-444a-a401-a14258067ed8 None admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:44.425069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2e4cf-701d-444a-a401-a14258067ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:44.425349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2e4cf-701d-444a-a401-a14258067ed8 None admin] PATH_INFO: `/v3/projects/020d395e82f0448f95789a896703ce98/users/bc939818c9224b0ebe2dbaa1eaaec5e5/roles/68aa1e11e519409289c25ac896f855aa` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:44.427590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2e4cf-701d-444a-a401-a14258067ed8 None admin] RBAC: Authorizing `identity:create_grant(project_id=020d395e82f0448f95789a896703ce98, user_id=bc939818c9224b0ebe2dbaa1eaaec5e5, role_id=68aa1e11e519409289c25ac896f855aa)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:44.429037 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2e4cf-701d-444a-a401-a14258067ed8 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:44.443932 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ec000-58a4-4e6d-87e3-436413121617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:44.446879 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ec000-58a4-4e6d-87e3-436413121617 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:44.446879 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ec000-58a4-4e6d-87e3-436413121617 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:44.446879 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ec000-58a4-4e6d-87e3-436413121617 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:44.455541 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ec000-58a4-4e6d-87e3-436413121617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:42:44.460401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-949ec000-58a4-4e6d-87e3-436413121617 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:42:44.460401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:44.460401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:44.460401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:44.460401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:44.460401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:44.460401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:44.460401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:44.460401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:44.460401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:44.460401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:44.460401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:44.460401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:42:44.460401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:42:44.460401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:42:44.460401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:42:44.461514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:42:44.461514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:42:44.461514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:42:44.461514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:42:44.461514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:44.461514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:44.461514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:44.461514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:44.461514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:44.461514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:44.461514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:44.461514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:44.461514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:44.461514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:44.461514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:44.461514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:44.462573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:44.462573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:44.462573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:44.462573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:44.462573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:42:44.462573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:42:44.462573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:42:44.462573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:42:44.462573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:42:44.462573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:42:44.462573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:42:44.462573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:44.462573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 542/1079] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:42:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:44.467471 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ec000-58a4-4e6d-87e3-436413121617 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:44.497909 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 538/1080] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:42:44 2022] PUT /identity/v3/projects/020d395e82f0448f95789a896703ce98/users/bc939818c9224b0ebe2dbaa1eaaec5e5/roles/68aa1e11e519409289c25ac896f855aa => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:42:44.536963 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:44.575099 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ec000-58a4-4e6d-87e3-436413121617 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:44.611572 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b37c42-73eb-4a38-b21c-ac265469484c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:44.612211 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b37c42-73eb-4a38-b21c-ac265469484c None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:44.612500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b37c42-73eb-4a38-b21c-ac265469484c None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:44.612780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b37c42-73eb-4a38-b21c-ac265469484c None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:44.613521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b37c42-73eb-4a38-b21c-ac265469484c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:44.613832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b37c42-73eb-4a38-b21c-ac265469484c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:44.615268 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b37c42-73eb-4a38-b21c-ac265469484c None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:44.624237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 543/1081] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:42:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:44.631036 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2e4cf-701d-444a-a401-a14258067ed8 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:44.736693 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2e4cf-701d-444a-a401-a14258067ed8 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:44.770283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a06fc-2e63-4834-ad83-f192a1104bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:44.770951 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a06fc-2e63-4834-ad83-f192a1104bbe None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:44.771236 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a06fc-2e63-4834-ad83-f192a1104bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:44.771514 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a06fc-2e63-4834-ad83-f192a1104bbe None admin] PATH_INFO: `/v3/users/2c82e595b0614ae7a87f6f8002d4759a` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:44.772674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a06fc-2e63-4834-ad83-f192a1104bbe None admin] RBAC: Authorizing `identity:get_user(user_id=2c82e595b0614ae7a87f6f8002d4759a)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:44.774100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a06fc-2e63-4834-ad83-f192a1104bbe None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:44.775729 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 539/1082] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:42:44 2022] GET /identity/v3/users/2c82e595b0614ae7a87f6f8002d4759a => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:44.781483 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b37c42-73eb-4a38-b21c-ac265469484c None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:44.878454 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b37c42-73eb-4a38-b21c-ac265469484c None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:44.905746 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:44.913124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ec38a-753f-4a22-97bf-26c2a3552a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:44.914026 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ec38a-753f-4a22-97bf-26c2a3552a1d None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:44.914309 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ec38a-753f-4a22-97bf-26c2a3552a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:44.914584 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ec38a-753f-4a22-97bf-26c2a3552a1d None admin] PATH_INFO: `/v3/projects/685677609833439198ef21f0d7d747e8` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:44.915869 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ec38a-753f-4a22-97bf-26c2a3552a1d None admin] RBAC: Authorizing `identity:get_project(project_id=685677609833439198ef21f0d7d747e8)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:44.922894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ec38a-753f-4a22-97bf-26c2a3552a1d None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:44.922894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 544/1083] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:42:44 2022] GET /identity/v3/projects/685677609833439198ef21f0d7d747e8 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:44.925678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a06fc-2e63-4834-ad83-f192a1104bbe None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:44.946187 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:45.031505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a06fc-2e63-4834-ad83-f192a1104bbe None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:45.065842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8433c92-38ad-4606-9d4c-17d460daf675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:45.066506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8433c92-38ad-4606-9d4c-17d460daf675 None admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:45.066825 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8433c92-38ad-4606-9d4c-17d460daf675 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:45.067106 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8433c92-38ad-4606-9d4c-17d460daf675 None admin] PATH_INFO: `/v3/projects/685677609833439198ef21f0d7d747e8/users/2c82e595b0614ae7a87f6f8002d4759a/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:45.069055 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8433c92-38ad-4606-9d4c-17d460daf675 None admin] RBAC: Authorizing `identity:create_grant(project_id=685677609833439198ef21f0d7d747e8, user_id=2c82e595b0614ae7a87f6f8002d4759a, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:45.070491 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8433c92-38ad-4606-9d4c-17d460daf675 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:45.133290 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 540/1084] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:42:44 2022] PUT /identity/v3/projects/685677609833439198ef21f0d7d747e8/users/2c82e595b0614ae7a87f6f8002d4759a/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:42:46.469819 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39befba7-09de-4918-b08e-860b4ecc20e7 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:46.470389 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39befba7-09de-4918-b08e-860b4ecc20e7 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:46.470389 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39befba7-09de-4918-b08e-860b4ecc20e7 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:46.471781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 545/1085] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:46.476973 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15676c-26e1-431a-901c-65eb0347444b None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:46.477352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15676c-26e1-431a-901c-65eb0347444b None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:46.477547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15676c-26e1-431a-901c-65eb0347444b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:46.495858 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-8f15676c-26e1-431a-901c-65eb0347444b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:46.497051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-8f15676c-26e1-431a-901c-65eb0347444b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:46.562814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 541/1086] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:46.586212 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39befba7-09de-4918-b08e-860b4ecc20e7 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:46.686665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39befba7-09de-4918-b08e-860b4ecc20e7 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:46.719937 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f355c-de89-4521-8e45-b4371dbbb70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:46.720509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f355c-de89-4521-8e45-b4371dbbb70d None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:46.720796 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f355c-de89-4521-8e45-b4371dbbb70d None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:46.721076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f355c-de89-4521-8e45-b4371dbbb70d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:46.731009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f355c-de89-4521-8e45-b4371dbbb70d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:42:46.736484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-133f355c-de89-4521-8e45-b4371dbbb70d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:42:46.736484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:46.736484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:46.736484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:46.736484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:46.736484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:46.736484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:46.736484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:46.736484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:46.736484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:46.736484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:46.736484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:46.736484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:42:46.736484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:42:46.736484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:42:46.736484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:42:46.737451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:42:46.737451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:42:46.737451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:42:46.737451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:42:46.737451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:46.737451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:46.737451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:46.737451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:46.737451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:46.737451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:46.737451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:46.737451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:46.737451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:46.737451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:46.737451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:46.737451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:46.738286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:46.738286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:46.738286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:46.738286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:46.738286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:42:46.738286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:42:46.738286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:42:46.738286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:42:46.738286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:42:46.738286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:42:46.738286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:42:46.738286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:46.738286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 546/1087] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Aug 3 12:42:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:46.743717 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15676c-26e1-431a-901c-65eb0347444b None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:46.753773 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:46.841432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15676c-26e1-431a-901c-65eb0347444b None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:46.873863 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75522223-9724-421b-a6c3-9559d03d6f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:46.874480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75522223-9724-421b-a6c3-9559d03d6f69 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:46.874793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75522223-9724-421b-a6c3-9559d03d6f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:46.875072 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75522223-9724-421b-a6c3-9559d03d6f69 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:46.875789 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75522223-9724-421b-a6c3-9559d03d6f69 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:46.876099 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75522223-9724-421b-a6c3-9559d03d6f69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:46.877991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75522223-9724-421b-a6c3-9559d03d6f69 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:46.885848 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 542/1088] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 3 12:42:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:46.891509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f355c-de89-4521-8e45-b4371dbbb70d None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:46.950260 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:46.990615 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f355c-de89-4521-8e45-b4371dbbb70d None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:47.024250 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f5a8e-aec8-4f8c-9aa2-e19d6cd7c651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:47.024886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f5a8e-aec8-4f8c-9aa2-e19d6cd7c651 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:47.025169 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f5a8e-aec8-4f8c-9aa2-e19d6cd7c651 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:47.025448 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f5a8e-aec8-4f8c-9aa2-e19d6cd7c651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:47.035546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f5a8e-aec8-4f8c-9aa2-e19d6cd7c651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:47.036975 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f5a8e-aec8-4f8c-9aa2-e19d6cd7c651 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:47.051463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-1c5f5a8e-aec8-4f8c-9aa2-e19d6cd7c651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:47.051463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:47.051463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:47.051463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:47.051463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:47.051463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:47.051463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:47.051463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:47.051463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:47.051463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:47.051463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:47.051463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:47.051463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:47.051463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:47.051463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:47.052534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:47.052534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:47.052534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:47.052534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:47.052534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:47.052534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:47.052534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:47.052534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:47.052534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:47.052534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:47.052534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:47.052534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:47.052534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:47.052534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:47.052534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:47.052534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:47.052534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:47.053495 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:47.053495 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:47.053495 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:47.053495 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:47.053495 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 547/1089] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:47.058342 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75522223-9724-421b-a6c3-9559d03d6f69 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:47.101009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c797589-e4d7-41cc-916a-37155c60ea4a None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:47.101299 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c797589-e4d7-41cc-916a-37155c60ea4a None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:47.101581 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c797589-e4d7-41cc-916a-37155c60ea4a None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:47.102978 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 548/1090] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:42:47.108358 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6002c-e0f2-4043-8145-74b8fc941a4d None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:47.108649 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6002c-e0f2-4043-8145-74b8fc941a4d None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:47.108928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6002c-e0f2-4043-8145-74b8fc941a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:47.126500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-94d6002c-e0f2-4043-8145-74b8fc941a4d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:47.127291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:47.128230 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-94d6002c-e0f2-4043-8145-74b8fc941a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:47.160202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75522223-9724-421b-a6c3-9559d03d6f69 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:47.195863 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c9fbd-29bd-454e-8967-ae0903dfb1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:47.196482 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c9fbd-29bd-454e-8967-ae0903dfb1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:47.196767 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c9fbd-29bd-454e-8967-ae0903dfb1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:47.197043 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c9fbd-29bd-454e-8967-ae0903dfb1a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:47.197731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c9fbd-29bd-454e-8967-ae0903dfb1a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:47.198041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c9fbd-29bd-454e-8967-ae0903dfb1a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:47.198483 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 549/1091] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:47.199454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c9fbd-29bd-454e-8967-ae0903dfb1a0 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:47.211249 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 543/1092] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:47.216759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6002c-e0f2-4043-8145-74b8fc941a4d None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:47.220507 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c9fbd-29bd-454e-8967-ae0903dfb1a0 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:47.258789 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:47.316771 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6002c-e0f2-4043-8145-74b8fc941a4d None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:47.318872 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c9fbd-29bd-454e-8967-ae0903dfb1a0 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:47.347546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:47.349649 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93a430-f090-4fbe-bf38-3e24bf378a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:47.350372 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93a430-f090-4fbe-bf38-3e24bf378a81 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:47.350703 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93a430-f090-4fbe-bf38-3e24bf378a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:47.351057 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93a430-f090-4fbe-bf38-3e24bf378a81 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:47.353259 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d66863-a15e-4a09-9f11-6a6d54dfca9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:47.353887 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d66863-a15e-4a09-9f11-6a6d54dfca9b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:47.354166 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d66863-a15e-4a09-9f11-6a6d54dfca9b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:47.354441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d66863-a15e-4a09-9f11-6a6d54dfca9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:47.358122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93a430-f090-4fbe-bf38-3e24bf378a81 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:47.360029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93a430-f090-4fbe-bf38-3e24bf378a81 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:47.364631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d66863-a15e-4a09-9f11-6a6d54dfca9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:42:47.369470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-68d66863-a15e-4a09-9f11-6a6d54dfca9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:42:47.369470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:47.369470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:47.369470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:47.369470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:47.369470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:47.369470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:47.369470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:47.369470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:47.369470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:47.369470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:47.369470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:47.369470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:42:47.369470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:42:47.369470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:42:47.369470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:42:47.370547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:42:47.370547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:42:47.370547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:42:47.370547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:42:47.370547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:47.370547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:47.370547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:47.370547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:47.370547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:47.370547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:47.370547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:47.370547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:47.370547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:47.370547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:47.370547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:47.370547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:47.371432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:47.371432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:47.371432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:47.371432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:47.371432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:42:47.371432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:42:47.371432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:42:47.371432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:42:47.371432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:42:47.371432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:42:47.371432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:42:47.371432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:42:47.371432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 544/1093] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:42:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:47.372116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-0d93a430-f090-4fbe-bf38-3e24bf378a81 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:42:47.372116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:47.372116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:47.372116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:47.372116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:47.372116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:47.372116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:47.372116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:47.372116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:47.372116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:47.372116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:47.372116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:47.372116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:42:47.372116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:42:47.372116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:42:47.372116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:42:47.372949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:47.372949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:47.372949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:42:47.372949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:47.372949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:42:47.372949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:42:47.372949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:47.372949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:47.372949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:47.372949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:47.372949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:47.372949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:47.372949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:47.372949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:47.372949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:47.372949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:47.372949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:47.372949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:47.373883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:47.373883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:47.373883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:42:47.373883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:42:47.373883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:42:47.373883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:42:47.373883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:42:47.373883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:42:47.373883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:42:47.373883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:47.374700 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 550/1094] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Aug 3 12:42:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:47.376520 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d66863-a15e-4a09-9f11-6a6d54dfca9b None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:47.379379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93a430-f090-4fbe-bf38-3e24bf378a81 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:47.473548 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:47.476000 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d66863-a15e-4a09-9f11-6a6d54dfca9b None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:47.476869 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93a430-f090-4fbe-bf38-3e24bf378a81 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:47.510703 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327aadfd-f898-46d6-941f-25dd8b74b77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:47.511269 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327aadfd-f898-46d6-941f-25dd8b74b77f None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:47.511550 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327aadfd-f898-46d6-941f-25dd8b74b77f None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:47.511823 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327aadfd-f898-46d6-941f-25dd8b74b77f None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:47.511972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75c78a-3ead-4f43-960f-e8a934d11f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:47.512531 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327aadfd-f898-46d6-941f-25dd8b74b77f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:47.512627 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75c78a-3ead-4f43-960f-e8a934d11f44 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:47.512833 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327aadfd-f898-46d6-941f-25dd8b74b77f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:47.512926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75c78a-3ead-4f43-960f-e8a934d11f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:47.513128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75c78a-3ead-4f43-960f-e8a934d11f44 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:47.513922 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75c78a-3ead-4f43-960f-e8a934d11f44 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:47.514241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75c78a-3ead-4f43-960f-e8a934d11f44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:47.514345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327aadfd-f898-46d6-941f-25dd8b74b77f None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:47.515686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75c78a-3ead-4f43-960f-e8a934d11f44 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:47.522535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 545/1095] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:42:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:47.528221 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327aadfd-f898-46d6-941f-25dd8b74b77f None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:47.538263 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 551/1096] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Aug 3 12:42:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:47.539526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75c78a-3ead-4f43-960f-e8a934d11f44 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:47.584703 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:47.637028 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327aadfd-f898-46d6-941f-25dd8b74b77f None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:47.638522 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75c78a-3ead-4f43-960f-e8a934d11f44 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:47.669985 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647641b2-59b0-490f-926e-6810f4a5c02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:47.670620 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647641b2-59b0-490f-926e-6810f4a5c02b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:47.670938 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647641b2-59b0-490f-926e-6810f4a5c02b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:47.671222 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647641b2-59b0-490f-926e-6810f4a5c02b None admin] PATH_INFO: `/v3/users/2c82e595b0614ae7a87f6f8002d4759a` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:47.672386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647641b2-59b0-490f-926e-6810f4a5c02b None admin] RBAC: Authorizing `identity:get_user(user_id=2c82e595b0614ae7a87f6f8002d4759a)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:47.672509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71509dc4-6db3-4818-8af0-8a2dea19036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:47.673046 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71509dc4-6db3-4818-8af0-8a2dea19036c None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:47.673332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71509dc4-6db3-4818-8af0-8a2dea19036c None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:47.674178 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71509dc4-6db3-4818-8af0-8a2dea19036c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:47.674446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647641b2-59b0-490f-926e-6810f4a5c02b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:47.676090 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 546/1097] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:42:47 2022] GET /identity/v3/users/2c82e595b0614ae7a87f6f8002d4759a => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:47.681624 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647641b2-59b0-490f-926e-6810f4a5c02b None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:47.705339 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:47.746535 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71509dc4-6db3-4818-8af0-8a2dea19036c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:47.748153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71509dc4-6db3-4818-8af0-8a2dea19036c None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:47.777994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647641b2-59b0-490f-926e-6810f4a5c02b None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:47.798303 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:47.819213 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca7908-f414-472c-90dc-9813193e55ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:47.819837 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca7908-f414-472c-90dc-9813193e55ec None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:47.820123 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca7908-f414-472c-90dc-9813193e55ec None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:47.820401 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca7908-f414-472c-90dc-9813193e55ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:47.850942 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 552/1098] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:42:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 03 12:42:47.856649 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71509dc4-6db3-4818-8af0-8a2dea19036c None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:47.897273 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca7908-f414-472c-90dc-9813193e55ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:47.898774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca7908-f414-472c-90dc-9813193e55ec None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:47.915176 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:47.956730 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71509dc4-6db3-4818-8af0-8a2dea19036c None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:47.990125 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db9d78-6297-426f-b2cb-7208c34fdede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:47.990792 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db9d78-6297-426f-b2cb-7208c34fdede None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:47.991080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db9d78-6297-426f-b2cb-7208c34fdede None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:47.991361 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db9d78-6297-426f-b2cb-7208c34fdede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:47.998215 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 547/1099] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:42:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 03 12:42:48.001827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db9d78-6297-426f-b2cb-7208c34fdede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:48.003307 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db9d78-6297-426f-b2cb-7208c34fdede None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:48.003854 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca7908-f414-472c-90dc-9813193e55ec None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:48.017918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-06db9d78-6297-426f-b2cb-7208c34fdede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:48.017918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:48.017918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:48.017918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:48.017918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:48.017918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:48.017918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:48.017918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:48.017918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:48.017918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:48.017918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:48.017918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:48.017918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:42:48.017918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:42:48.017918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:42:48.018981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:42:48.018981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:48.018981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:48.018981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:48.018981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:48.018981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:48.018981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:48.018981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:48.018981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:48.018981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:48.018981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:48.018981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:48.018981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:48.018981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:48.018981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:48.018981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:48.018981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:48.020003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:42:48.020003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:42:48.020003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:42:48.020003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:48.020003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 553/1100] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:42:48.024519 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db9d78-6297-426f-b2cb-7208c34fdede None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:48.025207 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:48.102771 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca7908-f414-472c-90dc-9813193e55ec None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:48.122207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db9d78-6297-426f-b2cb-7208c34fdede None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:48.132309 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:48.136507 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77434095-0304-4212-bb8f-a231d5712b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:48.137142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77434095-0304-4212-bb8f-a231d5712b5b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:48.137427 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77434095-0304-4212-bb8f-a231d5712b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:48.137707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77434095-0304-4212-bb8f-a231d5712b5b None admin] PATH_INFO: `/v3/projects/685677609833439198ef21f0d7d747e8` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:48.138960 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77434095-0304-4212-bb8f-a231d5712b5b None admin] RBAC: Authorizing `identity:get_project(project_id=685677609833439198ef21f0d7d747e8)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:48.140378 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77434095-0304-4212-bb8f-a231d5712b5b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:48.142824 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 548/1101] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:42:48 2022] GET /identity/v3/projects/685677609833439198ef21f0d7d747e8 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:48.148546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77434095-0304-4212-bb8f-a231d5712b5b None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:48.156163 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ed271-831d-4d0d-a209-e8d95b5e1abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:48.156788 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ed271-831d-4d0d-a209-e8d95b5e1abe None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:48.157073 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ed271-831d-4d0d-a209-e8d95b5e1abe None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:48.157351 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ed271-831d-4d0d-a209-e8d95b5e1abe None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:48.158607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ed271-831d-4d0d-a209-e8d95b5e1abe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:48.158945 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ed271-831d-4d0d-a209-e8d95b5e1abe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:48.160408 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ed271-831d-4d0d-a209-e8d95b5e1abe None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:48.172899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 554/1102] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:48.178856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ed271-831d-4d0d-a209-e8d95b5e1abe None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:48.236113 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:48.247661 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77434095-0304-4212-bb8f-a231d5712b5b None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:48.276653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ed271-831d-4d0d-a209-e8d95b5e1abe None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:48.281273 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2cb84-4762-459d-8a58-8a4cbfa0d8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:48.281888 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2cb84-4762-459d-8a58-8a4cbfa0d8a8 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:48.282171 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2cb84-4762-459d-8a58-8a4cbfa0d8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:48.282448 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2cb84-4762-459d-8a58-8a4cbfa0d8a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:48.283891 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2cb84-4762-459d-8a58-8a4cbfa0d8a8 None admin] RBAC: Adding query filter params (role.id=a6d209169b77456f9f1cc3ff53646cfc, scope.project.id=685677609833439198ef21f0d7d747e8, user.id=2c82e595b0614ae7a87f6f8002d4759a) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:48.284214 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2cb84-4762-459d-8a58-8a4cbfa0d8a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:48.285645 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2cb84-4762-459d-8a58-8a4cbfa0d8a8 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:48.291729 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 549/1103] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:42:48 2022] GET /identity/v3/role_assignments?user.id=2c82e595b0614ae7a87f6f8002d4759a&scope.project.id=685677609833439198ef21f0d7d747e8&role.id=a6d209169b77456f9f1cc3ff53646cfc => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:42:48.311802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26de35-5543-40d8-9a6b-f43227f50929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:48.312480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26de35-5543-40d8-9a6b-f43227f50929 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:48.312767 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26de35-5543-40d8-9a6b-f43227f50929 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:48.313048 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26de35-5543-40d8-9a6b-f43227f50929 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:48.321402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26de35-5543-40d8-9a6b-f43227f50929 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:48.322966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26de35-5543-40d8-9a6b-f43227f50929 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:48.336170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-eb26de35-5543-40d8-9a6b-f43227f50929 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:48.336170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:42:48.336170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:42:48.336170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:42:48.336170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:42:48.336170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:42:48.336170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:42:48.336170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:42:48.336170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:42:48.336170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:42:48.336170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:42:48.336170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:42:48.336170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:42:48.336170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:42:48.336170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:42:48.337164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:42:48.337164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:42:48.337164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:42:48.337164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:42:48.337164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:42:48.337164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:42:48.337164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:42:48.337164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:42:48.337164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:42:48.337164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:42:48.337164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:42:48.337164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:42:48.337164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:42:48.337164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:42:48.337164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:42:48.337164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:42:48.337164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:42:48.338045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:42:48.338045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:42:48.338045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:42:48.338045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:42:48.338045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:42:48.338045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:42:48.338045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:42:48.338045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:42:48.338045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 555/1104] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:42:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:42:48.343744 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2cb84-4762-459d-8a58-8a4cbfa0d8a8 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:48.448289 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2cb84-4762-459d-8a58-8a4cbfa0d8a8 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:48.481895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a50033-eeb0-4b78-89da-5436ebbfb122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:48.482511 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a50033-eeb0-4b78-89da-5436ebbfb122 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:48.482822 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a50033-eeb0-4b78-89da-5436ebbfb122 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:48.483103 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a50033-eeb0-4b78-89da-5436ebbfb122 None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:48.483852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a50033-eeb0-4b78-89da-5436ebbfb122 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:48.484164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a50033-eeb0-4b78-89da-5436ebbfb122 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:48.485602 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a50033-eeb0-4b78-89da-5436ebbfb122 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:48.497736 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 550/1105] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:42:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:48.504290 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26de35-5543-40d8-9a6b-f43227f50929 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:48.534351 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:48.602825 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26de35-5543-40d8-9a6b-f43227f50929 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:48.635861 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632b4af-7db5-489e-ac97-b2b3c28a9ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:48.636478 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632b4af-7db5-489e-ac97-b2b3c28a9ebc None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:48.636761 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632b4af-7db5-489e-ac97-b2b3c28a9ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:48.637037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632b4af-7db5-489e-ac97-b2b3c28a9ebc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:48.637829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632b4af-7db5-489e-ac97-b2b3c28a9ebc None admin] RBAC: Adding query filter params (role.id=68aa1e11e519409289c25ac896f855aa, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=bc939818c9224b0ebe2dbaa1eaaec5e5) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:48.638142 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632b4af-7db5-489e-ac97-b2b3c28a9ebc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:48.639606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632b4af-7db5-489e-ac97-b2b3c28a9ebc None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:48.645879 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 556/1106] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:42:48 2022] GET /identity/v3/role_assignments?user.id=bc939818c9224b0ebe2dbaa1eaaec5e5&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=68aa1e11e519409289c25ac896f855aa => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:50.315410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7ebf0-80ea-4a98-806d-6a3d2ba339bc None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:50.315927 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7ebf0-80ea-4a98-806d-6a3d2ba339bc None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:50.316020 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7ebf0-80ea-4a98-806d-6a3d2ba339bc None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:50.317330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 551/1107] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:50.322419 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8a9b2-6c12-4b78-87fa-b52fc53b6de4 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:50.322878 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8a9b2-6c12-4b78-87fa-b52fc53b6de4 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:50.323027 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8a9b2-6c12-4b78-87fa-b52fc53b6de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:50.340632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-4ae8a9b2-6c12-4b78-87fa-b52fc53b6de4 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:50.341832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-4ae8a9b2-6c12-4b78-87fa-b52fc53b6de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:50.406172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 557/1108] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:50.430932 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7ebf0-80ea-4a98-806d-6a3d2ba339bc None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:50.446180 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:50.529311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7ebf0-80ea-4a98-806d-6a3d2ba339bc None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:50.563444 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6e5ea-7355-4469-8536-ea7dcffe165d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:50.564072 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6e5ea-7355-4469-8536-ea7dcffe165d None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:50.564383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6e5ea-7355-4469-8536-ea7dcffe165d None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:50.564658 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6e5ea-7355-4469-8536-ea7dcffe165d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:50.569826 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6e5ea-7355-4469-8536-ea7dcffe165d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:50.571365 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6e5ea-7355-4469-8536-ea7dcffe165d None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:50.573452 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 552/1109] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:42:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:50.579244 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8a9b2-6c12-4b78-87fa-b52fc53b6de4 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:50.603367 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:50.675246 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8a9b2-6c12-4b78-87fa-b52fc53b6de4 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:50.708133 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcda1e-1c68-4d58-8c71-c265d35b5d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:50.708735 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcda1e-1c68-4d58-8c71-c265d35b5d5d None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:50.709018 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcda1e-1c68-4d58-8c71-c265d35b5d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:50.709297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcda1e-1c68-4d58-8c71-c265d35b5d5d None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:50.709971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcda1e-1c68-4d58-8c71-c265d35b5d5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:50.711419 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcda1e-1c68-4d58-8c71-c265d35b5d5d None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:50.777048 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 558/1110] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 3 12:42:50 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:42:52.795998 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e9820-a587-4bc4-9f15-5b504458738f None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:52.796548 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e9820-a587-4bc4-9f15-5b504458738f None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:52.796548 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e9820-a587-4bc4-9f15-5b504458738f None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:52.797895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 553/1111] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:52.803698 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57180f07-28f4-4f0a-82bb-5288260e1596 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:52.804074 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57180f07-28f4-4f0a-82bb-5288260e1596 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:52.804268 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57180f07-28f4-4f0a-82bb-5288260e1596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:52.821895 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-57180f07-28f4-4f0a-82bb-5288260e1596 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:52.823131 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-57180f07-28f4-4f0a-82bb-5288260e1596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:52.887911 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 559/1112] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:52.911082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e9820-a587-4bc4-9f15-5b504458738f None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:52.992758 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:53.018855 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e9820-a587-4bc4-9f15-5b504458738f None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:53.053634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058206c-d06e-4268-984b-827a1eb18818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:53.054202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058206c-d06e-4268-984b-827a1eb18818 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:53.054481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058206c-d06e-4268-984b-827a1eb18818 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:53.054779 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058206c-d06e-4268-984b-827a1eb18818 None admin] PATH_INFO: `/v3/roles/e39a3afcb14442a08e9a24b8a56d17cf` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:53.056213 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058206c-d06e-4268-984b-827a1eb18818 None admin] RBAC: Authorizing `identity:get_role(role_id=e39a3afcb14442a08e9a24b8a56d17cf)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:53.057579 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058206c-d06e-4268-984b-827a1eb18818 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:53.058931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 554/1113] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:42:52 2022] GET /identity/v3/roles/e39a3afcb14442a08e9a24b8a56d17cf => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:53.064740 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57180f07-28f4-4f0a-82bb-5288260e1596 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:53.075974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:53.160638 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57180f07-28f4-4f0a-82bb-5288260e1596 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:53.193041 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437d1b3-3a02-4470-9168-459dec4fa103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:53.193673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437d1b3-3a02-4470-9168-459dec4fa103 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:53.193956 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437d1b3-3a02-4470-9168-459dec4fa103 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:53.194235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437d1b3-3a02-4470-9168-459dec4fa103 None admin] PATH_INFO: `/v3/users/a3d34d736afe4241a9b76dd602052626` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:53.207272 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437d1b3-3a02-4470-9168-459dec4fa103 None admin] RBAC: Authorizing `identity:get_user(user_id=a3d34d736afe4241a9b76dd602052626)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:53.208700 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437d1b3-3a02-4470-9168-459dec4fa103 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:53.210306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 560/1114] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:42:53 2022] GET /identity/v3/users/a3d34d736afe4241a9b76dd602052626 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:53.216026 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058206c-d06e-4268-984b-827a1eb18818 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:53.314057 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058206c-d06e-4268-984b-827a1eb18818 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:53.346365 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b85755-3a8e-439b-9e11-bfee39dac4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:53.346997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b85755-3a8e-439b-9e11-bfee39dac4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:53.347279 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b85755-3a8e-439b-9e11-bfee39dac4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:53.347554 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b85755-3a8e-439b-9e11-bfee39dac4d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:53.364029 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:53.412230 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b85755-3a8e-439b-9e11-bfee39dac4d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:53.413921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b85755-3a8e-439b-9e11-bfee39dac4d5 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:53.555147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 555/1115] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:42:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:42:53.561167 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437d1b3-3a02-4470-9168-459dec4fa103 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:53.627722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:53.660720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437d1b3-3a02-4470-9168-459dec4fa103 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:53.693936 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a8523-395e-4c6d-968d-a198693d22c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:53.694566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a8523-395e-4c6d-968d-a198693d22c6 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:53.694880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a8523-395e-4c6d-968d-a198693d22c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:53.695159 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a8523-395e-4c6d-968d-a198693d22c6 None admin] PATH_INFO: `/v3/projects/685677609833439198ef21f0d7d747e8` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:53.696305 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a8523-395e-4c6d-968d-a198693d22c6 None admin] RBAC: Authorizing `identity:get_project(project_id=685677609833439198ef21f0d7d747e8)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:53.697718 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a8523-395e-4c6d-968d-a198693d22c6 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:53.699421 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 561/1116] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:42:53 2022] GET /identity/v3/projects/685677609833439198ef21f0d7d747e8 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:53.706004 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b85755-3a8e-439b-9e11-bfee39dac4d5 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:53.754754 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:53.805602 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b85755-3a8e-439b-9e11-bfee39dac4d5 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:53.838896 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f426885-f278-4791-988a-cd9a1bc91e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:53.839503 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f426885-f278-4791-988a-cd9a1bc91e24 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:53.839791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f426885-f278-4791-988a-cd9a1bc91e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:53.840072 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f426885-f278-4791-988a-cd9a1bc91e24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:53.840854 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f426885-f278-4791-988a-cd9a1bc91e24 None admin] RBAC: Adding query filter params (role.id=e39a3afcb14442a08e9a24b8a56d17cf, scope.project.id=685677609833439198ef21f0d7d747e8, user.id=a3d34d736afe4241a9b76dd602052626) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:53.841170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f426885-f278-4791-988a-cd9a1bc91e24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:53.842591 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f426885-f278-4791-988a-cd9a1bc91e24 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:53.848021 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 556/1117] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:42:53 2022] GET /identity/v3/role_assignments?user.id=a3d34d736afe4241a9b76dd602052626&scope.project.id=685677609833439198ef21f0d7d747e8&role.id=e39a3afcb14442a08e9a24b8a56d17cf => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:55.801098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badc925-4e6f-4a6a-abe6-dd43d227c398 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:55.801622 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badc925-4e6f-4a6a-abe6-dd43d227c398 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:55.801734 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badc925-4e6f-4a6a-abe6-dd43d227c398 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:55.803055 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 562/1118] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:55.808192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558b80e-a2b2-481c-a3e8-722df2492a0b None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:55.808617 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558b80e-a2b2-481c-a3e8-722df2492a0b None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:55.808754 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558b80e-a2b2-481c-a3e8-722df2492a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:55.826936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-0558b80e-a2b2-481c-a3e8-722df2492a0b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:55.828122 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-0558b80e-a2b2-481c-a3e8-722df2492a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:55.893810 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 557/1119] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:42:55.915372 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badc925-4e6f-4a6a-abe6-dd43d227c398 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:56.013556 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badc925-4e6f-4a6a-abe6-dd43d227c398 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:56.046039 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb3e21-a184-471f-a258-c62c7b9c955b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:56.046659 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb3e21-a184-471f-a258-c62c7b9c955b None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:56.046966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb3e21-a184-471f-a258-c62c7b9c955b None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:56.047245 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb3e21-a184-471f-a258-c62c7b9c955b None admin] PATH_INFO: `/v3/roles/e39a3afcb14442a08e9a24b8a56d17cf` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:56.048694 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb3e21-a184-471f-a258-c62c7b9c955b None admin] RBAC: Authorizing `identity:get_role(role_id=e39a3afcb14442a08e9a24b8a56d17cf)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:56.050035 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb3e21-a184-471f-a258-c62c7b9c955b None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:56.051423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 563/1120] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:42:55 2022] GET /identity/v3/roles/e39a3afcb14442a08e9a24b8a56d17cf => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:56.056990 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558b80e-a2b2-481c-a3e8-722df2492a0b None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:56.098776 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:56.153681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558b80e-a2b2-481c-a3e8-722df2492a0b None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:56.187470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b68e5-3c54-4de1-9407-280f4e7c271f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:56.188113 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b68e5-3c54-4de1-9407-280f4e7c271f None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:56.188395 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b68e5-3c54-4de1-9407-280f4e7c271f None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:56.189304 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b68e5-3c54-4de1-9407-280f4e7c271f None admin] PATH_INFO: `/v3/users/a3d34d736afe4241a9b76dd602052626` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:56.190467 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b68e5-3c54-4de1-9407-280f4e7c271f None admin] RBAC: Authorizing `identity:get_user(user_id=a3d34d736afe4241a9b76dd602052626)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:56.191925 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b68e5-3c54-4de1-9407-280f4e7c271f None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:56.193515 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 558/1121] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:42:56 2022] GET /identity/v3/users/a3d34d736afe4241a9b76dd602052626 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:56.199199 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb3e21-a184-471f-a258-c62c7b9c955b None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:56.202958 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:56.295112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb3e21-a184-471f-a258-c62c7b9c955b None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:56.328333 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf59aa9-d79d-454b-ba44-62afe29f8ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:56.328907 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf59aa9-d79d-454b-ba44-62afe29f8ffd None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:56.329216 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf59aa9-d79d-454b-ba44-62afe29f8ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:56.329496 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf59aa9-d79d-454b-ba44-62afe29f8ffd None admin] PATH_INFO: `/v3/projects/685677609833439198ef21f0d7d747e8` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:56.330647 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf59aa9-d79d-454b-ba44-62afe29f8ffd None admin] RBAC: Authorizing `identity:get_project(project_id=685677609833439198ef21f0d7d747e8)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:56.332112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf59aa9-d79d-454b-ba44-62afe29f8ffd None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:56.333759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 564/1122] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:42:56 2022] GET /identity/v3/projects/685677609833439198ef21f0d7d747e8 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:56.339613 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b68e5-3c54-4de1-9407-280f4e7c271f None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:56.437409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b68e5-3c54-4de1-9407-280f4e7c271f None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:56.447801 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:56.470019 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246c557-5cac-4bb0-9f2c-ce69c38fa5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:56.470676 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c557-5cac-4bb0-9f2c-ce69c38fa5fc None admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:56.470992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c557-5cac-4bb0-9f2c-ce69c38fa5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:56.471275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c557-5cac-4bb0-9f2c-ce69c38fa5fc None admin] PATH_INFO: `/v3/projects/685677609833439198ef21f0d7d747e8/users/a3d34d736afe4241a9b76dd602052626/roles/e39a3afcb14442a08e9a24b8a56d17cf` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:56.473722 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246c557-5cac-4bb0-9f2c-ce69c38fa5fc None admin] RBAC: Authorizing `identity:create_grant(project_id=685677609833439198ef21f0d7d747e8, user_id=a3d34d736afe4241a9b76dd602052626, role_id=e39a3afcb14442a08e9a24b8a56d17cf)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:56.475435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246c557-5cac-4bb0-9f2c-ce69c38fa5fc None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:56.547365 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 559/1123] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:42:56 2022] PUT /identity/v3/projects/685677609833439198ef21f0d7d747e8/users/a3d34d736afe4241a9b76dd602052626/roles/e39a3afcb14442a08e9a24b8a56d17cf => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:42:58.526847 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73932d5-2672-41eb-b26a-643986ef0bac None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:58.527426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73932d5-2672-41eb-b26a-643986ef0bac None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:58.527426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73932d5-2672-41eb-b26a-643986ef0bac None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:58.528743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 565/1124] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:42:58.533794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116944e-f7e3-4bae-a2cc-a6153f93aea4 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:58.534224 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116944e-f7e3-4bae-a2cc-a6153f93aea4 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:58.534359 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116944e-f7e3-4bae-a2cc-a6153f93aea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:58.552885 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-7116944e-f7e3-4bae-a2cc-a6153f93aea4 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:42:58.554074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-7116944e-f7e3-4bae-a2cc-a6153f93aea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:42:58.618674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 560/1125] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:42:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:42:58.641375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73932d5-2672-41eb-b26a-643986ef0bac None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:58.710522 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:58.739854 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73932d5-2672-41eb-b26a-643986ef0bac None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:58.771931 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b4750-9cbc-46e7-9adf-7940084e4427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:58.772549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b4750-9cbc-46e7-9adf-7940084e4427 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:58.772828 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b4750-9cbc-46e7-9adf-7940084e4427 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:58.773100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b4750-9cbc-46e7-9adf-7940084e4427 None admin] PATH_INFO: `/v3/roles/e39a3afcb14442a08e9a24b8a56d17cf` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:58.774505 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b4750-9cbc-46e7-9adf-7940084e4427 None admin] RBAC: Authorizing `identity:get_role(role_id=e39a3afcb14442a08e9a24b8a56d17cf)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:58.775899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b4750-9cbc-46e7-9adf-7940084e4427 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:58.777243 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 566/1126] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:42:58 2022] GET /identity/v3/roles/e39a3afcb14442a08e9a24b8a56d17cf => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:58.783429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116944e-f7e3-4bae-a2cc-a6153f93aea4 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:58.875956 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:58.878835 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116944e-f7e3-4bae-a2cc-a6153f93aea4 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:58.911694 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066b8ed-0e27-48a6-adf1-91d961cffebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:58.912323 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066b8ed-0e27-48a6-adf1-91d961cffebc None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:58.912611 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066b8ed-0e27-48a6-adf1-91d961cffebc None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:58.912895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066b8ed-0e27-48a6-adf1-91d961cffebc None admin] PATH_INFO: `/v3/users/a3d34d736afe4241a9b76dd602052626` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:58.914327 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066b8ed-0e27-48a6-adf1-91d961cffebc None admin] RBAC: Authorizing `identity:get_user(user_id=a3d34d736afe4241a9b76dd602052626)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:58.915799 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066b8ed-0e27-48a6-adf1-91d961cffebc None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:58.917393 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 561/1127] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:42:58 2022] GET /identity/v3/users/a3d34d736afe4241a9b76dd602052626 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:58.923657 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b4750-9cbc-46e7-9adf-7940084e4427 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:59.020259 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b4750-9cbc-46e7-9adf-7940084e4427 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:59.053220 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab6f6c-c3d7-4713-bb01-7bd9d99a6cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:59.053765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab6f6c-c3d7-4713-bb01-7bd9d99a6cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:59.054050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab6f6c-c3d7-4713-bb01-7bd9d99a6cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:59.054329 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab6f6c-c3d7-4713-bb01-7bd9d99a6cf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:59.064300 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:59.118968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab6f6c-c3d7-4713-bb01-7bd9d99a6cf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:59.120400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab6f6c-c3d7-4713-bb01-7bd9d99a6cf0 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:59.216264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 567/1128] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:42:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:42:59.222701 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066b8ed-0e27-48a6-adf1-91d961cffebc None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:59.322821 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066b8ed-0e27-48a6-adf1-91d961cffebc None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:59.357923 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce5f2c-1d27-4cfb-9fd7-edb3ba0f39b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:59.358558 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce5f2c-1d27-4cfb-9fd7-edb3ba0f39b7 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:59.358874 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce5f2c-1d27-4cfb-9fd7-edb3ba0f39b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:59.359155 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce5f2c-1d27-4cfb-9fd7-edb3ba0f39b7 None admin] PATH_INFO: `/v3/projects/685677609833439198ef21f0d7d747e8` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:59.360360 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce5f2c-1d27-4cfb-9fd7-edb3ba0f39b7 None admin] RBAC: Authorizing `identity:get_project(project_id=685677609833439198ef21f0d7d747e8)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:59.361798 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce5f2c-1d27-4cfb-9fd7-edb3ba0f39b7 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:59.363502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 562/1129] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:42:59 2022] GET /identity/v3/projects/685677609833439198ef21f0d7d747e8 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:42:59.369545 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab6f6c-c3d7-4713-bb01-7bd9d99a6cf0 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:42:59.410032 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:59.466073 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab6f6c-c3d7-4713-bb01-7bd9d99a6cf0 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:59.498975 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e416a37-2531-4db0-aa3e-c73ce00f16ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:59.501281 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e416a37-2531-4db0-aa3e-c73ce00f16ac None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:59.501281 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e416a37-2531-4db0-aa3e-c73ce00f16ac None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:59.501281 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e416a37-2531-4db0-aa3e-c73ce00f16ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:59.501281 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e416a37-2531-4db0-aa3e-c73ce00f16ac None admin] RBAC: Adding query filter params (role.id=e39a3afcb14442a08e9a24b8a56d17cf, scope.project.id=685677609833439198ef21f0d7d747e8, user.id=a3d34d736afe4241a9b76dd602052626) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:42:59.501281 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e416a37-2531-4db0-aa3e-c73ce00f16ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:59.502765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e416a37-2531-4db0-aa3e-c73ce00f16ac None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:59.508517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 568/1130] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:42:59 2022] GET /identity/v3/role_assignments?user.id=a3d34d736afe4241a9b76dd602052626&scope.project.id=685677609833439198ef21f0d7d747e8&role.id=e39a3afcb14442a08e9a24b8a56d17cf => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:01.471095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745f393-1e98-4a6b-8308-b8951f563f94 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:01.478644 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745f393-1e98-4a6b-8308-b8951f563f94 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:01.478644 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745f393-1e98-4a6b-8308-b8951f563f94 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:01.478644 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 563/1131] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:01.478944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ea8a0-670c-456e-890b-752ea28ea979 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:01.478944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ea8a0-670c-456e-890b-752ea28ea979 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:01.478944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ea8a0-670c-456e-890b-752ea28ea979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:01.496799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-bd4ea8a0-670c-456e-890b-752ea28ea979 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:01.498021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-bd4ea8a0-670c-456e-890b-752ea28ea979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:01.564214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 569/1132] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:43:01.586296 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745f393-1e98-4a6b-8308-b8951f563f94 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:01.621211 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:01.683648 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745f393-1e98-4a6b-8308-b8951f563f94 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:01.720034 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35a3af-9078-49e5-ba6e-81abe5b6f272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:01.720662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35a3af-9078-49e5-ba6e-81abe5b6f272 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:01.720945 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35a3af-9078-49e5-ba6e-81abe5b6f272 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:01.721270 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35a3af-9078-49e5-ba6e-81abe5b6f272 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:01.722357 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35a3af-9078-49e5-ba6e-81abe5b6f272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:01.723815 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35a3af-9078-49e5-ba6e-81abe5b6f272 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:01.725385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 564/1133] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:43:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:01.731269 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ea8a0-670c-456e-890b-752ea28ea979 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:01.764544 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:01.828485 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ea8a0-670c-456e-890b-752ea28ea979 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:01.862380 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24f718-64fa-4a20-86ee-7e164570ace7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:01.863012 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24f718-64fa-4a20-86ee-7e164570ace7 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:01.863299 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24f718-64fa-4a20-86ee-7e164570ace7 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:01.863579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24f718-64fa-4a20-86ee-7e164570ace7 None admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:01.864263 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24f718-64fa-4a20-86ee-7e164570ace7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:01.865695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24f718-64fa-4a20-86ee-7e164570ace7 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:01.955653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 570/1134] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 3 12:43:01 2022] POST /identity/v3/projects => generated 311 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:43:03.962360 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648038e9-c2e3-4d46-b059-997f45e484e6 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:03.962912 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648038e9-c2e3-4d46-b059-997f45e484e6 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:03.962912 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648038e9-c2e3-4d46-b059-997f45e484e6 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:03.964285 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 565/1135] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:03.969449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d4994-cbce-49d2-9cd4-8c056a323cf0 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:03.969883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d4994-cbce-49d2-9cd4-8c056a323cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:03.970016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d4994-cbce-49d2-9cd4-8c056a323cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:03.988239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-d96d4994-cbce-49d2-9cd4-8c056a323cf0 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:03.989428 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d96d4994-cbce-49d2-9cd4-8c056a323cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:04.054646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 571/1136] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:43:04.078072 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648038e9-c2e3-4d46-b059-997f45e484e6 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:04.176067 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648038e9-c2e3-4d46-b059-997f45e484e6 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:04.178291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:04.208167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90018a70-ca71-488f-a5a8-aeec620b5bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:04.208821 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90018a70-ca71-488f-a5a8-aeec620b5bab None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:04.209107 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90018a70-ca71-488f-a5a8-aeec620b5bab None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:04.209387 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90018a70-ca71-488f-a5a8-aeec620b5bab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:04.210593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90018a70-ca71-488f-a5a8-aeec620b5bab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:04.212060 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90018a70-ca71-488f-a5a8-aeec620b5bab None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:04.213704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 566/1137] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:43:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:04.219832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d4994-cbce-49d2-9cd4-8c056a323cf0 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:04.237329 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:04.316009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d4994-cbce-49d2-9cd4-8c056a323cf0 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:04.348613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f776572-2517-4b21-981b-9452ccd4cdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:04.349214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f776572-2517-4b21-981b-9452ccd4cdee None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:04.349502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f776572-2517-4b21-981b-9452ccd4cdee None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:04.349778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f776572-2517-4b21-981b-9452ccd4cdee None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:04.350470 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f776572-2517-4b21-981b-9452ccd4cdee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:04.351939 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f776572-2517-4b21-981b-9452ccd4cdee None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:04.434436 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 572/1138] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 3 12:43:04 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:43:06.454315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f9dc6-95a7-4ed2-ad36-226dc65eeaa9 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:06.454876 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f9dc6-95a7-4ed2-ad36-226dc65eeaa9 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:06.454988 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f9dc6-95a7-4ed2-ad36-226dc65eeaa9 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:06.456336 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 567/1139] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:06.461517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec825d-da9d-43cb-966c-9918b3d6563d None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:06.461939 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec825d-da9d-43cb-966c-9918b3d6563d None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:06.462077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec825d-da9d-43cb-966c-9918b3d6563d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:06.479841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-39ec825d-da9d-43cb-966c-9918b3d6563d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:06.481033 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-39ec825d-da9d-43cb-966c-9918b3d6563d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:06.545549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 573/1140] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:43:06.569222 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f9dc6-95a7-4ed2-ad36-226dc65eeaa9 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:06.667719 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f9dc6-95a7-4ed2-ad36-226dc65eeaa9 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:06.702257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775ae04-cd58-407b-95fc-0ccd4f81c8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:06.702918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775ae04-cd58-407b-95fc-0ccd4f81c8ad None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:06.703202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775ae04-cd58-407b-95fc-0ccd4f81c8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:06.703490 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775ae04-cd58-407b-95fc-0ccd4f81c8ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:06.713410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775ae04-cd58-407b-95fc-0ccd4f81c8ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:43:06.718170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-7775ae04-cd58-407b-95fc-0ccd4f81c8ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:43:06.718170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:43:06.718170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:43:06.718170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:43:06.718170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:43:06.718170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:43:06.718170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:43:06.718170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:43:06.718170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:43:06.718170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:43:06.718170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:43:06.718170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:43:06.718170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:43:06.718170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:43:06.718170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:43:06.718170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:43:06.719351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:43:06.719351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:43:06.719351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:43:06.719351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:43:06.719351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:43:06.719351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:43:06.719351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:43:06.719351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:43:06.719351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:43:06.719351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:43:06.719351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:43:06.719351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:43:06.719351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:43:06.719351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:43:06.719351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:43:06.719351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:43:06.720262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:43:06.720262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:43:06.720262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:43:06.720262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:43:06.720262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:43:06.720262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:43:06.720262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:43:06.720262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:43:06.720262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:43:06.720262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:43:06.720262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:43:06.720262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:43:06.720262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 568/1141] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:43:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:43:06.725567 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec825d-da9d-43cb-966c-9918b3d6563d None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:06.727804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:06.822135 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec825d-da9d-43cb-966c-9918b3d6563d None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:06.878722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b621d5-453c-4db8-a14a-0fc869230b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:06.878722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b621d5-453c-4db8-a14a-0fc869230b59 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:06.878722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b621d5-453c-4db8-a14a-0fc869230b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:06.878722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b621d5-453c-4db8-a14a-0fc869230b59 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:06.879628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b621d5-453c-4db8-a14a-0fc869230b59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:43:06.879628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b621d5-453c-4db8-a14a-0fc869230b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:06.879628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b621d5-453c-4db8-a14a-0fc869230b59 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:06.879628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 574/1142] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:43:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:06.879954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775ae04-cd58-407b-95fc-0ccd4f81c8ad None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:06.908074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:06.976313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775ae04-cd58-407b-95fc-0ccd4f81c8ad None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:07.010222 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939f893-6534-4b47-8c4f-8d6654d1b744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:07.010896 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939f893-6534-4b47-8c4f-8d6654d1b744 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:07.011184 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939f893-6534-4b47-8c4f-8d6654d1b744 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:07.011464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939f893-6534-4b47-8c4f-8d6654d1b744 None admin] PATH_INFO: `/v3/users/5494c6540ae54a1aaab5b8e16a614847` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:07.024797 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939f893-6534-4b47-8c4f-8d6654d1b744 None admin] RBAC: Authorizing `identity:get_user(user_id=5494c6540ae54a1aaab5b8e16a614847)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:07.026255 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939f893-6534-4b47-8c4f-8d6654d1b744 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:07.027964 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 569/1143] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:43:06 2022] GET /identity/v3/users/5494c6540ae54a1aaab5b8e16a614847 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:07.034238 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b621d5-453c-4db8-a14a-0fc869230b59 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:07.095093 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:07.131923 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b621d5-453c-4db8-a14a-0fc869230b59 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:07.164948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d07d0-6ee9-428a-9522-a5cbbe6e11df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:07.165570 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d07d0-6ee9-428a-9522-a5cbbe6e11df None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:07.165863 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d07d0-6ee9-428a-9522-a5cbbe6e11df None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:07.166143 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d07d0-6ee9-428a-9522-a5cbbe6e11df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:07.231198 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d07d0-6ee9-428a-9522-a5cbbe6e11df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:07.232572 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d07d0-6ee9-428a-9522-a5cbbe6e11df None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:07.291386 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:07.329058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 575/1144] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:43:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:43:07.335058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939f893-6534-4b47-8c4f-8d6654d1b744 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:07.427177 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:07.436325 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939f893-6534-4b47-8c4f-8d6654d1b744 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:07.469771 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c5c62-9266-4d2b-9952-43e9b3322f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:07.470487 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c5c62-9266-4d2b-9952-43e9b3322f8b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:07.470723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c5c62-9266-4d2b-9952-43e9b3322f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:07.471031 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c5c62-9266-4d2b-9952-43e9b3322f8b None admin] PATH_INFO: `/v3/projects/4cad58891e984c4480e3cf4b822902d7` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:07.472244 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c5c62-9266-4d2b-9952-43e9b3322f8b None admin] RBAC: Authorizing `identity:get_project(project_id=4cad58891e984c4480e3cf4b822902d7)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:07.473684 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c5c62-9266-4d2b-9952-43e9b3322f8b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:07.475386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 570/1145] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:43:07 2022] GET /identity/v3/projects/4cad58891e984c4480e3cf4b822902d7 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:07.481716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d07d0-6ee9-428a-9522-a5cbbe6e11df None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:07.577395 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d07d0-6ee9-428a-9522-a5cbbe6e11df None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:07.611122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253186f4-8968-4bb1-a8da-00b9e13ce786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:07.611726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253186f4-8968-4bb1-a8da-00b9e13ce786 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:07.612010 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253186f4-8968-4bb1-a8da-00b9e13ce786 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:07.612290 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253186f4-8968-4bb1-a8da-00b9e13ce786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:07.613074 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253186f4-8968-4bb1-a8da-00b9e13ce786 None admin] RBAC: Adding query filter params (role.id=a6d209169b77456f9f1cc3ff53646cfc, scope.project.id=4cad58891e984c4480e3cf4b822902d7, user.id=5494c6540ae54a1aaab5b8e16a614847) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:43:07.613390 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253186f4-8968-4bb1-a8da-00b9e13ce786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:07.614827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253186f4-8968-4bb1-a8da-00b9e13ce786 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:07.620200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 576/1146] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:43:07 2022] GET /identity/v3/role_assignments?user.id=5494c6540ae54a1aaab5b8e16a614847&scope.project.id=4cad58891e984c4480e3cf4b822902d7&role.id=a6d209169b77456f9f1cc3ff53646cfc => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:09.594264 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ac85c-d8dc-4f62-978f-2265bfcdbb7a None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:09.594842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ac85c-d8dc-4f62-978f-2265bfcdbb7a None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:09.594842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ac85c-d8dc-4f62-978f-2265bfcdbb7a None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:09.596210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 571/1147] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:09.601430 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68b851-e065-4bcd-abf6-2a2a6385c3a0 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:09.601849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68b851-e065-4bcd-abf6-2a2a6385c3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:09.601977 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68b851-e065-4bcd-abf6-2a2a6385c3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:09.619480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-ee68b851-e065-4bcd-abf6-2a2a6385c3a0 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:09.620656 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ee68b851-e065-4bcd-abf6-2a2a6385c3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:09.643507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:09.687521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 577/1148] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:43:09.710010 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ac85c-d8dc-4f62-978f-2265bfcdbb7a None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:09.809488 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ac85c-d8dc-4f62-978f-2265bfcdbb7a None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:09.842267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118b0df-333f-43e4-bba1-4e44559c9c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:09.842926 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118b0df-333f-43e4-bba1-4e44559c9c39 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:09.843214 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118b0df-333f-43e4-bba1-4e44559c9c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:09.843493 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118b0df-333f-43e4-bba1-4e44559c9c39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:09.853290 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118b0df-333f-43e4-bba1-4e44559c9c39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:43:09.858082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-9118b0df-333f-43e4-bba1-4e44559c9c39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:43:09.858082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:43:09.858082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:43:09.858082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:43:09.858082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:43:09.858082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:43:09.858082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:43:09.858082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:43:09.858082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:43:09.858082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:43:09.858082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:43:09.858082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:43:09.858082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:43:09.858082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:43:09.858082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:43:09.858082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:43:09.859192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:43:09.859192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:43:09.859192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:43:09.859192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:43:09.859192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:43:09.859192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:43:09.859192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:43:09.859192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:43:09.859192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:43:09.859192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:43:09.859192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:43:09.859192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:43:09.859192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:43:09.859192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:43:09.859192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:43:09.859192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:43:09.860720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:43:09.860720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:43:09.860720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:43:09.860720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:43:09.860720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:43:09.860720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:43:09.860720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:43:09.860720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:43:09.860720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:43:09.860720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:43:09.860720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:43:09.860720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:43:09.860720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 572/1149] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:43:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:43:09.865737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68b851-e065-4bcd-abf6-2a2a6385c3a0 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:09.961371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68b851-e065-4bcd-abf6-2a2a6385c3a0 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:09.995318 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8d5fb-4fe2-447d-853c-d8604c350adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:09.995930 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8d5fb-4fe2-447d-853c-d8604c350adb None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:09.996215 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8d5fb-4fe2-447d-853c-d8604c350adb None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:09.996495 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8d5fb-4fe2-447d-853c-d8604c350adb None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:09.997233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8d5fb-4fe2-447d-853c-d8604c350adb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:43:09.997544 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8d5fb-4fe2-447d-853c-d8604c350adb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:09.998932 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8d5fb-4fe2-447d-853c-d8604c350adb None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:10.007446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 578/1150] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:43:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:10.013052 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118b0df-333f-43e4-bba1-4e44559c9c39 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:10.032354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:10.114380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118b0df-333f-43e4-bba1-4e44559c9c39 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:10.147226 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6278c-7d23-4284-93b9-c1e06b305c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:10.147863 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6278c-7d23-4284-93b9-c1e06b305c00 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:10.148142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6278c-7d23-4284-93b9-c1e06b305c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:10.148414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6278c-7d23-4284-93b9-c1e06b305c00 None admin] PATH_INFO: `/v3/users/5494c6540ae54a1aaab5b8e16a614847` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:10.149571 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6278c-7d23-4284-93b9-c1e06b305c00 None admin] RBAC: Authorizing `identity:get_user(user_id=5494c6540ae54a1aaab5b8e16a614847)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:10.151036 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6278c-7d23-4284-93b9-c1e06b305c00 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:10.152649 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 573/1151] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:43:10 2022] GET /identity/v3/users/5494c6540ae54a1aaab5b8e16a614847 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:10.158984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8d5fb-4fe2-447d-853c-d8604c350adb None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:10.184385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:10.261934 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8d5fb-4fe2-447d-853c-d8604c350adb None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:10.295221 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b4ae7-79b0-4c58-b7e1-66a84330acee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:10.295858 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b4ae7-79b0-4c58-b7e1-66a84330acee None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:10.296144 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b4ae7-79b0-4c58-b7e1-66a84330acee None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:10.296688 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b4ae7-79b0-4c58-b7e1-66a84330acee None admin] PATH_INFO: `/v3/projects/4cad58891e984c4480e3cf4b822902d7` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:10.298244 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b4ae7-79b0-4c58-b7e1-66a84330acee None admin] RBAC: Authorizing `identity:get_project(project_id=4cad58891e984c4480e3cf4b822902d7)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:10.299696 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b4ae7-79b0-4c58-b7e1-66a84330acee None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:10.301351 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 579/1152] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:43:10 2022] GET /identity/v3/projects/4cad58891e984c4480e3cf4b822902d7 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:10.307441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6278c-7d23-4284-93b9-c1e06b305c00 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:10.389366 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:10.404148 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6278c-7d23-4284-93b9-c1e06b305c00 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:10.443442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b60f1-3605-45f1-8ff6-dc698ca288bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:10.444126 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b60f1-3605-45f1-8ff6-dc698ca288bd None admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:10.444412 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b60f1-3605-45f1-8ff6-dc698ca288bd None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:10.444686 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b60f1-3605-45f1-8ff6-dc698ca288bd None admin] PATH_INFO: `/v3/projects/4cad58891e984c4480e3cf4b822902d7/users/5494c6540ae54a1aaab5b8e16a614847/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:10.446641 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b60f1-3605-45f1-8ff6-dc698ca288bd None admin] RBAC: Authorizing `identity:create_grant(project_id=4cad58891e984c4480e3cf4b822902d7, user_id=5494c6540ae54a1aaab5b8e16a614847, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:10.448096 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b60f1-3605-45f1-8ff6-dc698ca288bd None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:10.537345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 574/1153] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:43:10 2022] PUT /identity/v3/projects/4cad58891e984c4480e3cf4b822902d7/users/5494c6540ae54a1aaab5b8e16a614847/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:43:12.540832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f90ddf-33ae-4a1a-a343-abe816147ce2 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:12.541361 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f90ddf-33ae-4a1a-a343-abe816147ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:12.541470 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f90ddf-33ae-4a1a-a343-abe816147ce2 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:12.542741 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 580/1154] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:12.547990 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787186e2-89ec-452a-975a-53c988675968 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:12.548433 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787186e2-89ec-452a-975a-53c988675968 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:12.548538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787186e2-89ec-452a-975a-53c988675968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:12.566671 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-787186e2-89ec-452a-975a-53c988675968 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:12.567895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-787186e2-89ec-452a-975a-53c988675968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:12.631395 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 575/1155] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:43:12.654413 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f90ddf-33ae-4a1a-a343-abe816147ce2 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:12.739299 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:12.752011 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f90ddf-33ae-4a1a-a343-abe816147ce2 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:12.785982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c49ac-3c26-42d0-95fd-987e6adc4ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:12.786604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c49ac-3c26-42d0-95fd-987e6adc4ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:12.786917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c49ac-3c26-42d0-95fd-987e6adc4ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:12.787194 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c49ac-3c26-42d0-95fd-987e6adc4ce7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:12.797191 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c49ac-3c26-42d0-95fd-987e6adc4ce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:43:12.801952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-525c49ac-3c26-42d0-95fd-987e6adc4ce7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:43:12.801952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:43:12.801952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:43:12.801952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:43:12.801952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:43:12.801952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:43:12.801952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:43:12.801952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:43:12.801952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:43:12.801952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:43:12.801952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:43:12.801952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:43:12.801952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:43:12.801952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:43:12.801952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:43:12.801952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:43:12.803151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:43:12.803151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:43:12.803151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:43:12.803151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:43:12.803151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:43:12.803151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:43:12.803151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:43:12.803151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:43:12.803151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:43:12.803151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:43:12.803151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:43:12.803151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:43:12.803151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:43:12.803151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:43:12.803151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:43:12.803151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:43:12.804292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:43:12.804292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:43:12.804292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:43:12.804292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:43:12.804292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:43:12.804292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:43:12.804292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:43:12.804292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:43:12.804292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:43:12.804292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:43:12.804292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:43:12.804292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:43:12.806898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 581/1156] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:43:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:43:12.809035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787186e2-89ec-452a-975a-53c988675968 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:12.882185 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:12.904282 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787186e2-89ec-452a-975a-53c988675968 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:12.937617 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9c2c5-81fa-423a-8714-9e6ad8d17d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:12.938218 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9c2c5-81fa-423a-8714-9e6ad8d17d91 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:12.938502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9c2c5-81fa-423a-8714-9e6ad8d17d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:12.938804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9c2c5-81fa-423a-8714-9e6ad8d17d91 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:12.939518 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9c2c5-81fa-423a-8714-9e6ad8d17d91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:43:12.939827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9c2c5-81fa-423a-8714-9e6ad8d17d91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:12.941196 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9c2c5-81fa-423a-8714-9e6ad8d17d91 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:12.948972 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 576/1157] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:43:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:12.955257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c49ac-3c26-42d0-95fd-987e6adc4ce7 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:13.052773 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c49ac-3c26-42d0-95fd-987e6adc4ce7 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:13.085885 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcedec-da2c-42e3-9b02-7e4d00419601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:13.086514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcedec-da2c-42e3-9b02-7e4d00419601 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:13.086827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcedec-da2c-42e3-9b02-7e4d00419601 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:13.087109 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcedec-da2c-42e3-9b02-7e4d00419601 None admin] PATH_INFO: `/v3/users/5494c6540ae54a1aaab5b8e16a614847` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:13.088270 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcedec-da2c-42e3-9b02-7e4d00419601 None admin] RBAC: Authorizing `identity:get_user(user_id=5494c6540ae54a1aaab5b8e16a614847)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:13.089692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcedec-da2c-42e3-9b02-7e4d00419601 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:13.091294 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 582/1158] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:43:12 2022] GET /identity/v3/users/5494c6540ae54a1aaab5b8e16a614847 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:13.096825 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9c2c5-81fa-423a-8714-9e6ad8d17d91 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:13.196367 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9c2c5-81fa-423a-8714-9e6ad8d17d91 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:13.228339 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d8664-8d42-4719-9613-e7fedbaf3977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:13.228944 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d8664-8d42-4719-9613-e7fedbaf3977 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:13.229224 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d8664-8d42-4719-9613-e7fedbaf3977 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:13.229495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d8664-8d42-4719-9613-e7fedbaf3977 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:13.237679 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:13.293935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d8664-8d42-4719-9613-e7fedbaf3977 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:13.295397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d8664-8d42-4719-9613-e7fedbaf3977 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:13.388173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 577/1159] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:43:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:43:13.395009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcedec-da2c-42e3-9b02-7e4d00419601 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:13.413214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:13.493227 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcedec-da2c-42e3-9b02-7e4d00419601 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:13.526310 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929d1d3-c84d-4726-bdb9-c2853169214b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:13.526957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929d1d3-c84d-4726-bdb9-c2853169214b None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:13.527238 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929d1d3-c84d-4726-bdb9-c2853169214b None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:13.527512 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929d1d3-c84d-4726-bdb9-c2853169214b None admin] PATH_INFO: `/v3/projects/4cad58891e984c4480e3cf4b822902d7` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:13.528652 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929d1d3-c84d-4726-bdb9-c2853169214b None admin] RBAC: Authorizing `identity:get_project(project_id=4cad58891e984c4480e3cf4b822902d7)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:13.530127 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929d1d3-c84d-4726-bdb9-c2853169214b None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:13.531785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 583/1160] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:43:13 2022] GET /identity/v3/projects/4cad58891e984c4480e3cf4b822902d7 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:13.538045 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d8664-8d42-4719-9613-e7fedbaf3977 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:13.579906 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:13.638062 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d8664-8d42-4719-9613-e7fedbaf3977 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:13.670488 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4b87e-c001-48f1-b295-36c9817c55c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:13.671118 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4b87e-c001-48f1-b295-36c9817c55c0 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:13.671404 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4b87e-c001-48f1-b295-36c9817c55c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:13.671673 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4b87e-c001-48f1-b295-36c9817c55c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:13.672936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4b87e-c001-48f1-b295-36c9817c55c0 None admin] RBAC: Adding query filter params (role.id=a6d209169b77456f9f1cc3ff53646cfc, scope.project.id=4cad58891e984c4480e3cf4b822902d7, user.id=5494c6540ae54a1aaab5b8e16a614847) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:43:13.673241 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4b87e-c001-48f1-b295-36c9817c55c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:13.674645 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4b87e-c001-48f1-b295-36c9817c55c0 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:13.680241 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 578/1161] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:43:13 2022] GET /identity/v3/role_assignments?user.id=5494c6540ae54a1aaab5b8e16a614847&scope.project.id=4cad58891e984c4480e3cf4b822902d7&role.id=a6d209169b77456f9f1cc3ff53646cfc => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:15.655090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e9c5e-391a-4f8e-8b1d-e4e692c21ca0 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:15.655639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e9c5e-391a-4f8e-8b1d-e4e692c21ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:15.655639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e9c5e-391a-4f8e-8b1d-e4e692c21ca0 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:15.657569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 584/1162] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:15.663029 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513de17-85b3-4201-80e4-dd53c787d798 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:15.663423 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513de17-85b3-4201-80e4-dd53c787d798 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:15.663592 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513de17-85b3-4201-80e4-dd53c787d798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:15.681160 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-c513de17-85b3-4201-80e4-dd53c787d798 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:15.682349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-c513de17-85b3-4201-80e4-dd53c787d798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:15.746070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 579/1163] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:43:15.768102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e9c5e-391a-4f8e-8b1d-e4e692c21ca0 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:15.853609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:15.869950 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e9c5e-391a-4f8e-8b1d-e4e692c21ca0 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:15.903511 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf57af-5b22-4066-86d4-4f278abfa866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:15.904123 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf57af-5b22-4066-86d4-4f278abfa866 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:15.904411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf57af-5b22-4066-86d4-4f278abfa866 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:15.904691 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf57af-5b22-4066-86d4-4f278abfa866 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:15.971570 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf57af-5b22-4066-86d4-4f278abfa866 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:15.973011 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf57af-5b22-4066-86d4-4f278abfa866 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:16.052132 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:16.067993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 585/1164] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:43:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:43:16.073985 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513de17-85b3-4201-80e4-dd53c787d798 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:16.103902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:16.169917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513de17-85b3-4201-80e4-dd53c787d798 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:16.202689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5657e-b24d-4a6a-949b-353dce3e0e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:16.203942 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5657e-b24d-4a6a-949b-353dce3e0e5e None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:16.204226 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5657e-b24d-4a6a-949b-353dce3e0e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:16.204504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5657e-b24d-4a6a-949b-353dce3e0e5e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:16.211101 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5657e-b24d-4a6a-949b-353dce3e0e5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:16.212542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5657e-b24d-4a6a-949b-353dce3e0e5e None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:16.223731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-d2c5657e-b24d-4a6a-949b-353dce3e0e5e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 03 12:43:16.223731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:43:16.223731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 03 12:43:16.223731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 03 12:43:16.223731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:43:16.223731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:43:16.223731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:43:16.223731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:43:16.223731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 03 12:43:16.223731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:43:16.223731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:43:16.223731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:43:16.223731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:43:16.223731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:43:16.223731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:43:16.223731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:43:16.223731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:43:16.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:43:16.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:43:16.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:43:16.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:43:16.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:43:16.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:43:16.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:43:16.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:43:16.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:43:16.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:43:16.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:43:16.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:43:16.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:43:16.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:43:16.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:43:16.224733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:43:16.225634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:43:16.225634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:43:16.225634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:43:16.225634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:43:16.225634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:43:16.225634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:43:16.225634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:43:16.225634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:43:16.225634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:43:16.225634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:43:16.225634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 03 12:43:16.225634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:43:16.225634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 03 12:43:16.225634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:43:16.225634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 580/1165] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 3 12:43:16 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:43:16.230773 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf57af-5b22-4066-86d4-4f278abfa866 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:16.324671 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf57af-5b22-4066-86d4-4f278abfa866 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:16.357518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d02c02-353f-413b-9083-930e8259c919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:16.358117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d02c02-353f-413b-9083-930e8259c919 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:16.358398 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d02c02-353f-413b-9083-930e8259c919 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:16.358671 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d02c02-353f-413b-9083-930e8259c919 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:16.359408 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d02c02-353f-413b-9083-930e8259c919 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:43:16.359709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d02c02-353f-413b-9083-930e8259c919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:16.361052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d02c02-353f-413b-9083-930e8259c919 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:16.367953 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 586/1166] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Aug 3 12:43:16 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:18.323941 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e72ca-6ba5-4d60-bdf4-4908a14cc641 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:18.324483 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e72ca-6ba5-4d60-bdf4-4908a14cc641 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:18.324483 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e72ca-6ba5-4d60-bdf4-4908a14cc641 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:18.325861 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 581/1167] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:18.331096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d0e19-96a4-4a40-94c4-eb28c80a8186 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:18.331471 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d0e19-96a4-4a40-94c4-eb28c80a8186 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:18.331659 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d0e19-96a4-4a40-94c4-eb28c80a8186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:18.349689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-357d0e19-96a4-4a40-94c4-eb28c80a8186 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:18.350913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-357d0e19-96a4-4a40-94c4-eb28c80a8186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:18.392695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:18.415229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 587/1168] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:43:18.437743 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e72ca-6ba5-4d60-bdf4-4908a14cc641 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:18.527595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:18.537305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e72ca-6ba5-4d60-bdf4-4908a14cc641 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:18.570393 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ceae9-680b-4a29-8075-20056bdf2b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:18.571024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ceae9-680b-4a29-8075-20056bdf2b85 None admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:18.571311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ceae9-680b-4a29-8075-20056bdf2b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:18.571591 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ceae9-680b-4a29-8075-20056bdf2b85 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:18.572298 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ceae9-680b-4a29-8075-20056bdf2b85 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:18.573665 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ceae9-680b-4a29-8075-20056bdf2b85 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:18.697929 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 582/1169] 10.222.0.64 () {60 vars in 1138 bytes} [Wed Aug 3 12:43:18 2022] POST /identity/v3/domains => generated 267 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:43:20.677262 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b1473-5691-4c9e-951a-3f6238f87f28 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:20.677792 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b1473-5691-4c9e-951a-3f6238f87f28 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:20.677905 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b1473-5691-4c9e-951a-3f6238f87f28 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:20.679206 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 588/1170] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:20.684316 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c0125-5982-4f22-bca0-dacfc792836b None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:20.684759 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c0125-5982-4f22-bca0-dacfc792836b None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:20.684879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c0125-5982-4f22-bca0-dacfc792836b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:20.702432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-ef2c0125-5982-4f22-bca0-dacfc792836b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:20.703651 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-ef2c0125-5982-4f22-bca0-dacfc792836b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:20.767411 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 583/1171] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:43:20.790548 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b1473-5691-4c9e-951a-3f6238f87f28 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:20.887875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b1473-5691-4c9e-951a-3f6238f87f28 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:20.921056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6f6b2-8af4-4fa6-9258-3c9499f90a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:20.921715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6f6b2-8af4-4fa6-9258-3c9499f90a6a None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:20.921995 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6f6b2-8af4-4fa6-9258-3c9499f90a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:20.922270 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6f6b2-8af4-4fa6-9258-3c9499f90a6a None admin] PATH_INFO: `/v3/domains/86837c784c54493290f36f99e6a669aa` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:20.932283 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6f6b2-8af4-4fa6-9258-3c9499f90a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=86837c784c54493290f36f99e6a669aa)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:20.933650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6f6b2-8af4-4fa6-9258-3c9499f90a6a None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:20.935246 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 589/1172] 10.222.0.64 () {56 vars in 1183 bytes} [Wed Aug 3 12:43:20 2022] GET /identity/v3/domains/86837c784c54493290f36f99e6a669aa => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:20.941336 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c0125-5982-4f22-bca0-dacfc792836b None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:21.020306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:21.038315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c0125-5982-4f22-bca0-dacfc792836b None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:21.070630 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1522e70-899d-4325-97be-141e20d99131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:21.071258 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1522e70-899d-4325-97be-141e20d99131 None admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:21.071541 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1522e70-899d-4325-97be-141e20d99131 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:21.071828 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1522e70-899d-4325-97be-141e20d99131 None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:21.072728 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1522e70-899d-4325-97be-141e20d99131 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:21.074427 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1522e70-899d-4325-97be-141e20d99131 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:21.160517 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 584/1173] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 3 12:43:20 2022] POST /identity/v3/projects => generated 361 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:43:23.162386 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a5de4-313e-45f3-8625-027f276efd26 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:23.163135 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a5de4-313e-45f3-8625-027f276efd26 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:23.163242 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a5de4-313e-45f3-8625-027f276efd26 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:23.164564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 590/1174] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:23.169552 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb50561-55e7-431c-b16f-9698528a733e None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:23.169923 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb50561-55e7-431c-b16f-9698528a733e None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:23.170108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb50561-55e7-431c-b16f-9698528a733e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:23.188814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-beb50561-55e7-431c-b16f-9698528a733e None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:23.189989 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-beb50561-55e7-431c-b16f-9698528a733e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:23.253800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 585/1175] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:43:23.278132 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a5de4-313e-45f3-8625-027f276efd26 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:23.332176 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:23.394697 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a5de4-313e-45f3-8625-027f276efd26 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:23.427633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4b927-4556-4a22-a1e1-7fc90ece8865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:23.428266 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4b927-4556-4a22-a1e1-7fc90ece8865 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:23.428548 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4b927-4556-4a22-a1e1-7fc90ece8865 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:23.428824 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4b927-4556-4a22-a1e1-7fc90ece8865 None admin] PATH_INFO: `/v3/domains/86837c784c54493290f36f99e6a669aa` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:23.429969 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4b927-4556-4a22-a1e1-7fc90ece8865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=86837c784c54493290f36f99e6a669aa)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:23.431432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4b927-4556-4a22-a1e1-7fc90ece8865 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:23.433009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 591/1176] 10.222.0.64 () {56 vars in 1183 bytes} [Wed Aug 3 12:43:23 2022] GET /identity/v3/domains/86837c784c54493290f36f99e6a669aa => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:23.439439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb50561-55e7-431c-b16f-9698528a733e None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:23.497252 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:23.533818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb50561-55e7-431c-b16f-9698528a733e None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:23.566487 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dff44e-b041-4794-9913-4784930ec9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:23.567112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dff44e-b041-4794-9913-4784930ec9b9 None admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:23.567394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dff44e-b041-4794-9913-4784930ec9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:23.567668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dff44e-b041-4794-9913-4784930ec9b9 None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:23.568343 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dff44e-b041-4794-9913-4784930ec9b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:23.569793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dff44e-b041-4794-9913-4784930ec9b9 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:23.645023 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 586/1177] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 3 12:43:23 2022] POST /identity/v3/users => generated 311 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:43:25.676774 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f4c28-a615-4916-9ec3-15888e62c3b8 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:25.677296 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f4c28-a615-4916-9ec3-15888e62c3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:25.677382 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f4c28-a615-4916-9ec3-15888e62c3b8 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:25.678995 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 592/1178] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:25.684091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cf22d-4ce0-41d1-a675-8cec22429e52 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:25.684500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cf22d-4ce0-41d1-a675-8cec22429e52 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:25.684686 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cf22d-4ce0-41d1-a675-8cec22429e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:25.703219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-cb6cf22d-4ce0-41d1-a675-8cec22429e52 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:25.704418 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-cb6cf22d-4ce0-41d1-a675-8cec22429e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:25.771804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 587/1179] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:43:25.795821 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f4c28-a615-4916-9ec3-15888e62c3b8 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:25.897547 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f4c28-a615-4916-9ec3-15888e62c3b8 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:25.904672 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:25.932416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580b050-186b-4003-81d2-6dfc357927e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:25.932993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580b050-186b-4003-81d2-6dfc357927e8 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:25.933281 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580b050-186b-4003-81d2-6dfc357927e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:25.933561 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580b050-186b-4003-81d2-6dfc357927e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:25.944778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580b050-186b-4003-81d2-6dfc357927e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:43:25.949707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-8580b050-186b-4003-81d2-6dfc357927e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:43:25.949707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:43:25.949707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:43:25.949707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:43:25.949707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:43:25.949707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:43:25.949707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:43:25.949707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:43:25.949707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:43:25.949707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:43:25.949707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:43:25.949707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:43:25.949707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:43:25.949707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:43:25.949707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:43:25.949707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:43:25.950769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:43:25.950769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:43:25.950769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:43:25.950769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:43:25.950769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:43:25.950769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:43:25.950769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:43:25.950769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:43:25.950769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:43:25.950769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:43:25.950769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:43:25.950769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:43:25.950769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:43:25.950769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:43:25.950769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:43:25.950769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:43:25.952034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:43:25.952034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:43:25.952034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:43:25.952034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:43:25.952034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:43:25.952034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:43:25.952034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:43:25.952034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:43:25.952034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:43:25.952034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:43:25.952034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:43:25.952034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:43:25.952034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 593/1180] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:43:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:43:25.957610 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cf22d-4ce0-41d1-a675-8cec22429e52 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:26.007028 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:26.057347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cf22d-4ce0-41d1-a675-8cec22429e52 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:26.090189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092740d-eb9d-49ce-80ab-4c6fc9226021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:26.090826 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092740d-eb9d-49ce-80ab-4c6fc9226021 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:26.091115 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092740d-eb9d-49ce-80ab-4c6fc9226021 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:26.091391 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092740d-eb9d-49ce-80ab-4c6fc9226021 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:26.092103 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092740d-eb9d-49ce-80ab-4c6fc9226021 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:43:26.092412 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092740d-eb9d-49ce-80ab-4c6fc9226021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:26.093772 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092740d-eb9d-49ce-80ab-4c6fc9226021 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:26.101987 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 588/1181] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:43:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:26.107911 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580b050-186b-4003-81d2-6dfc357927e8 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:26.205483 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580b050-186b-4003-81d2-6dfc357927e8 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:26.237604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245b3c8-a2d9-49e2-b92f-9ff9945fd9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:26.238237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245b3c8-a2d9-49e2-b92f-9ff9945fd9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:26.238520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245b3c8-a2d9-49e2-b92f-9ff9945fd9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:26.238826 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245b3c8-a2d9-49e2-b92f-9ff9945fd9c3 None admin] PATH_INFO: `/v3/users/7c3807f31dcd45f09af91d87b480e54a` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:26.252536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245b3c8-a2d9-49e2-b92f-9ff9945fd9c3 None admin] RBAC: Authorizing `identity:get_user(user_id=7c3807f31dcd45f09af91d87b480e54a)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:26.253977 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245b3c8-a2d9-49e2-b92f-9ff9945fd9c3 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:26.255592 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 594/1182] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:43:26 2022] GET /identity/v3/users/7c3807f31dcd45f09af91d87b480e54a => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:26.261340 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092740d-eb9d-49ce-80ab-4c6fc9226021 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:26.357255 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092740d-eb9d-49ce-80ab-4c6fc9226021 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:26.370391 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:26.396250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a23d5-2acd-497e-aa12-ffdeaa119464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:26.396882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a23d5-2acd-497e-aa12-ffdeaa119464 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:26.397345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a23d5-2acd-497e-aa12-ffdeaa119464 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:26.397771 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a23d5-2acd-497e-aa12-ffdeaa119464 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:26.463717 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a23d5-2acd-497e-aa12-ffdeaa119464 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:26.465158 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a23d5-2acd-497e-aa12-ffdeaa119464 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:26.561157 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 589/1183] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:43:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:43:26.567069 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245b3c8-a2d9-49e2-b92f-9ff9945fd9c3 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:26.591399 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:26.664508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245b3c8-a2d9-49e2-b92f-9ff9945fd9c3 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:26.697560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceb06e-5ec1-413c-8e4f-a41a901a0d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:26.698192 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceb06e-5ec1-413c-8e4f-a41a901a0d46 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:26.698479 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceb06e-5ec1-413c-8e4f-a41a901a0d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:26.698782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceb06e-5ec1-413c-8e4f-a41a901a0d46 None admin] PATH_INFO: `/v3/projects/76c7f67555bc4202a69d7255801398e5` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:26.699946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bceb06e-5ec1-413c-8e4f-a41a901a0d46 None admin] RBAC: Authorizing `identity:get_project(project_id=76c7f67555bc4202a69d7255801398e5)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:26.701365 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bceb06e-5ec1-413c-8e4f-a41a901a0d46 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:26.703069 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 595/1184] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:43:26 2022] GET /identity/v3/projects/76c7f67555bc4202a69d7255801398e5 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:26.709086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a23d5-2acd-497e-aa12-ffdeaa119464 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:26.723377 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:26.807051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a23d5-2acd-497e-aa12-ffdeaa119464 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:26.838744 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c5ce7-60a1-47f1-ab47-0d7b9fa23d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:26.839375 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c5ce7-60a1-47f1-ab47-0d7b9fa23d49 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:26.839657 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c5ce7-60a1-47f1-ab47-0d7b9fa23d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:26.839931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c5ce7-60a1-47f1-ab47-0d7b9fa23d49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:26.840704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c5ce7-60a1-47f1-ab47-0d7b9fa23d49 None admin] RBAC: Adding query filter params (role.id=a6d209169b77456f9f1cc3ff53646cfc, scope.project.id=76c7f67555bc4202a69d7255801398e5, user.id=7c3807f31dcd45f09af91d87b480e54a) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:43:26.841015 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c5ce7-60a1-47f1-ab47-0d7b9fa23d49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:26.842434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c5ce7-60a1-47f1-ab47-0d7b9fa23d49 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:26.848255 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 590/1185] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:43:26 2022] GET /identity/v3/role_assignments?user.id=7c3807f31dcd45f09af91d87b480e54a&scope.project.id=76c7f67555bc4202a69d7255801398e5&role.id=a6d209169b77456f9f1cc3ff53646cfc => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:28.809673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fdd08-dc3e-4f16-9a13-752c4a044219 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:28.810229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fdd08-dc3e-4f16-9a13-752c4a044219 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:28.810229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fdd08-dc3e-4f16-9a13-752c4a044219 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:28.812317 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 596/1186] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:43:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:28.817352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40f0ed-325a-4416-8166-02576b6c5a7c None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:28.817758 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40f0ed-325a-4416-8166-02576b6c5a7c None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:28.817912 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40f0ed-325a-4416-8166-02576b6c5a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:28.836262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-3d40f0ed-325a-4416-8166-02576b6c5a7c None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:28.837453 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3d40f0ed-325a-4416-8166-02576b6c5a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:28.905073 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 591/1187] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:43:28.927712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fdd08-dc3e-4f16-9a13-752c4a044219 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:29.016963 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:29.026183 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fdd08-dc3e-4f16-9a13-752c4a044219 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:29.058628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484450e2-e07e-4fc5-9541-7d4fbf6ebe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:29.059277 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484450e2-e07e-4fc5-9541-7d4fbf6ebe42 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:29.059555 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484450e2-e07e-4fc5-9541-7d4fbf6ebe42 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:29.059871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484450e2-e07e-4fc5-9541-7d4fbf6ebe42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:29.070008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484450e2-e07e-4fc5-9541-7d4fbf6ebe42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:43:29.074827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-484450e2-e07e-4fc5-9541-7d4fbf6ebe42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:43:29.074827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:43:29.074827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:43:29.074827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:43:29.074827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:43:29.074827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:43:29.074827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:43:29.074827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:43:29.074827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:43:29.074827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:43:29.074827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:43:29.074827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:43:29.074827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:43:29.074827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:43:29.074827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:43:29.074827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:43:29.076006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:43:29.076006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:43:29.076006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:43:29.076006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:43:29.076006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:43:29.076006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:43:29.076006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:43:29.076006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:43:29.076006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:43:29.076006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:43:29.076006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:43:29.076006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:43:29.076006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:43:29.076006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:43:29.076006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:43:29.076006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:43:29.077906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:43:29.077906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:43:29.077906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:43:29.077906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:43:29.077906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:43:29.077906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:43:29.077906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:43:29.077906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:43:29.077906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:43:29.077906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:43:29.077906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:43:29.077906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:43:29.077906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 597/1188] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:43:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:43:29.082257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40f0ed-325a-4416-8166-02576b6c5a7c None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:29.090273 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:29.179536 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40f0ed-325a-4416-8166-02576b6c5a7c None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:29.212524 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10efb75-b66e-4daf-9d68-489fdb59af56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:29.213136 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10efb75-b66e-4daf-9d68-489fdb59af56 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:29.213422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10efb75-b66e-4daf-9d68-489fdb59af56 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:29.213701 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10efb75-b66e-4daf-9d68-489fdb59af56 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:29.214415 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10efb75-b66e-4daf-9d68-489fdb59af56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:43:29.214723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10efb75-b66e-4daf-9d68-489fdb59af56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:29.216120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10efb75-b66e-4daf-9d68-489fdb59af56 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:29.224007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 592/1189] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:43:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:43:29.229765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484450e2-e07e-4fc5-9541-7d4fbf6ebe42 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:29.328498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484450e2-e07e-4fc5-9541-7d4fbf6ebe42 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:29.360562 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72bbcc-8b76-42ff-9396-28f532673918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:29.361183 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72bbcc-8b76-42ff-9396-28f532673918 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:29.361467 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72bbcc-8b76-42ff-9396-28f532673918 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:29.361746 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72bbcc-8b76-42ff-9396-28f532673918 None admin] PATH_INFO: `/v3/users/7c3807f31dcd45f09af91d87b480e54a` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:29.362925 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72bbcc-8b76-42ff-9396-28f532673918 None admin] RBAC: Authorizing `identity:get_user(user_id=7c3807f31dcd45f09af91d87b480e54a)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:29.364369 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72bbcc-8b76-42ff-9396-28f532673918 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:29.365943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 598/1190] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:43:29 2022] GET /identity/v3/users/7c3807f31dcd45f09af91d87b480e54a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:29.371487 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10efb75-b66e-4daf-9d68-489fdb59af56 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:29.437669 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:29.469453 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10efb75-b66e-4daf-9d68-489fdb59af56 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:29.501639 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abfa5f-8edc-4e4c-850f-11ed6460662a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:29.502255 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abfa5f-8edc-4e4c-850f-11ed6460662a None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:29.502536 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abfa5f-8edc-4e4c-850f-11ed6460662a None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:29.502835 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abfa5f-8edc-4e4c-850f-11ed6460662a None admin] PATH_INFO: `/v3/projects/76c7f67555bc4202a69d7255801398e5` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:29.503972 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abfa5f-8edc-4e4c-850f-11ed6460662a None admin] RBAC: Authorizing `identity:get_project(project_id=76c7f67555bc4202a69d7255801398e5)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:29.505382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abfa5f-8edc-4e4c-850f-11ed6460662a None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:29.507037 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 593/1191] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:43:29 2022] GET /identity/v3/projects/76c7f67555bc4202a69d7255801398e5 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:29.513368 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72bbcc-8b76-42ff-9396-28f532673918 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:29.535681 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:29.612143 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72bbcc-8b76-42ff-9396-28f532673918 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:29.644414 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0caa13-1253-406b-a121-7d104538c6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:29.645067 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0caa13-1253-406b-a121-7d104538c6c0 None admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:29.645354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0caa13-1253-406b-a121-7d104538c6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:29.645635 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0caa13-1253-406b-a121-7d104538c6c0 None admin] PATH_INFO: `/v3/projects/76c7f67555bc4202a69d7255801398e5/users/7c3807f31dcd45f09af91d87b480e54a/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:29.647583 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0caa13-1253-406b-a121-7d104538c6c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=76c7f67555bc4202a69d7255801398e5, user_id=7c3807f31dcd45f09af91d87b480e54a, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:29.649010 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0caa13-1253-406b-a121-7d104538c6c0 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:29.695435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 599/1192] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:43:29 2022] PUT /identity/v3/projects/76c7f67555bc4202a69d7255801398e5/users/7c3807f31dcd45f09af91d87b480e54a/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:43:31.663694 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa64730-fe83-453a-9edb-ad0c76077cb3 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:31.664233 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa64730-fe83-453a-9edb-ad0c76077cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:31.664233 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa64730-fe83-453a-9edb-ad0c76077cb3 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:31.665593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 594/1193] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:31.670610 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab596259-7c27-47ad-886c-32652b064106 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:31.671494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab596259-7c27-47ad-886c-32652b064106 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:31.671724 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab596259-7c27-47ad-886c-32652b064106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:31.689968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-ab596259-7c27-47ad-886c-32652b064106 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:31.691189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ab596259-7c27-47ad-886c-32652b064106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:31.755765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 600/1194] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:43:31.778159 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa64730-fe83-453a-9edb-ad0c76077cb3 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:31.878742 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa64730-fe83-453a-9edb-ad0c76077cb3 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:31.910849 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f36d1-0c86-41c9-b872-f2a5ec26cc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:31.911471 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f36d1-0c86-41c9-b872-f2a5ec26cc00 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:31.911750 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f36d1-0c86-41c9-b872-f2a5ec26cc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:31.912021 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f36d1-0c86-41c9-b872-f2a5ec26cc00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:31.914888 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:31.923197 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f36d1-0c86-41c9-b872-f2a5ec26cc00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:43:31.928095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-058f36d1-0c86-41c9-b872-f2a5ec26cc00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:43:31.928095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:43:31.928095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:43:31.928095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:43:31.928095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:43:31.928095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:43:31.928095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:43:31.928095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:43:31.928095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:43:31.928095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:43:31.928095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:43:31.928095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:43:31.928095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:43:31.928095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:43:31.928095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:43:31.928095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:43:31.929133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:43:31.929133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:43:31.929133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:43:31.929133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:43:31.929133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:43:31.929133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:43:31.929133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:43:31.929133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:43:31.929133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:43:31.929133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:43:31.929133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:43:31.929133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:43:31.929133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:43:31.929133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:43:31.929133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:43:31.929133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:43:31.929991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:43:31.929991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:43:31.929991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:43:31.929991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:43:31.929991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:43:31.929991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:43:31.929991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:43:31.929991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:43:31.929991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:43:31.929991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:43:31.929991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:43:31.929991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:43:31.929991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 595/1195] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:43:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:43:31.935413 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab596259-7c27-47ad-886c-32652b064106 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:31.946768 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:32.035017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab596259-7c27-47ad-886c-32652b064106 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:32.067814 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74b002-92ea-4ba4-9c2b-6d205379c997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:32.068421 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74b002-92ea-4ba4-9c2b-6d205379c997 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:32.068706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74b002-92ea-4ba4-9c2b-6d205379c997 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:32.068983 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74b002-92ea-4ba4-9c2b-6d205379c997 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:32.069694 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74b002-92ea-4ba4-9c2b-6d205379c997 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:43:32.069999 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74b002-92ea-4ba4-9c2b-6d205379c997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:32.071395 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74b002-92ea-4ba4-9c2b-6d205379c997 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:32.079174 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 601/1196] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:43:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:32.084867 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f36d1-0c86-41c9-b872-f2a5ec26cc00 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:32.183169 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f36d1-0c86-41c9-b872-f2a5ec26cc00 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:32.216063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398ec8d-07fd-4860-b291-d830891f7cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:32.216695 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398ec8d-07fd-4860-b291-d830891f7cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:32.216976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398ec8d-07fd-4860-b291-d830891f7cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:32.217250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398ec8d-07fd-4860-b291-d830891f7cf5 None admin] PATH_INFO: `/v3/users/7c3807f31dcd45f09af91d87b480e54a` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:32.219031 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398ec8d-07fd-4860-b291-d830891f7cf5 None admin] RBAC: Authorizing `identity:get_user(user_id=7c3807f31dcd45f09af91d87b480e54a)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:32.220458 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398ec8d-07fd-4860-b291-d830891f7cf5 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:32.222039 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 596/1197] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Aug 3 12:43:32 2022] GET /identity/v3/users/7c3807f31dcd45f09af91d87b480e54a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:32.227787 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74b002-92ea-4ba4-9c2b-6d205379c997 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:32.294959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:32.324454 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74b002-92ea-4ba4-9c2b-6d205379c997 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:32.355704 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b976b12-696f-408f-b53d-af4ae26edf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:32.356300 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b976b12-696f-408f-b53d-af4ae26edf30 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:32.356579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b976b12-696f-408f-b53d-af4ae26edf30 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:32.356851 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b976b12-696f-408f-b53d-af4ae26edf30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:32.422529 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b976b12-696f-408f-b53d-af4ae26edf30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:32.424035 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b976b12-696f-408f-b53d-af4ae26edf30 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:32.489074 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:32.518991 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 602/1198] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:43:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:43:32.524842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398ec8d-07fd-4860-b291-d830891f7cf5 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:32.585084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:32.622062 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398ec8d-07fd-4860-b291-d830891f7cf5 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:32.654414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca70662-8f32-404b-b995-5bdba55a5e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:32.655586 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca70662-8f32-404b-b995-5bdba55a5e87 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:32.655866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca70662-8f32-404b-b995-5bdba55a5e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:32.656140 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca70662-8f32-404b-b995-5bdba55a5e87 None admin] PATH_INFO: `/v3/projects/76c7f67555bc4202a69d7255801398e5` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:32.657282 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca70662-8f32-404b-b995-5bdba55a5e87 None admin] RBAC: Authorizing `identity:get_project(project_id=76c7f67555bc4202a69d7255801398e5)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:32.658700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca70662-8f32-404b-b995-5bdba55a5e87 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:32.660836 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 597/1199] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Aug 3 12:43:32 2022] GET /identity/v3/projects/76c7f67555bc4202a69d7255801398e5 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:43:32.666668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b976b12-696f-408f-b53d-af4ae26edf30 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:32.762034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b976b12-696f-408f-b53d-af4ae26edf30 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:32.794953 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34878172-fe81-4418-8731-60e7de58f37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:32.795554 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34878172-fe81-4418-8731-60e7de58f37e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:32.796399 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34878172-fe81-4418-8731-60e7de58f37e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:32.796674 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34878172-fe81-4418-8731-60e7de58f37e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:32.797457 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34878172-fe81-4418-8731-60e7de58f37e None admin] RBAC: Adding query filter params (role.id=a6d209169b77456f9f1cc3ff53646cfc, scope.project.id=76c7f67555bc4202a69d7255801398e5, user.id=7c3807f31dcd45f09af91d87b480e54a) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:43:32.797762 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34878172-fe81-4418-8731-60e7de58f37e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:32.799196 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34878172-fe81-4418-8731-60e7de58f37e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:32.804758 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 603/1200] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:43:32 2022] GET /identity/v3/role_assignments?user.id=7c3807f31dcd45f09af91d87b480e54a&scope.project.id=76c7f67555bc4202a69d7255801398e5&role.id=a6d209169b77456f9f1cc3ff53646cfc => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:43:42.650335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=34 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:42.802247 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=82 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:43.703028 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef481e82-cb4d-46e6-8195-a5b4ef737be6 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:43.703610 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef481e82-cb4d-46e6-8195-a5b4ef737be6 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:43.703610 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef481e82-cb4d-46e6-8195-a5b4ef737be6 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:43.704984 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 598/1201] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:43.710025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d400a-871e-47cc-a84c-400f385a5849 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:43.711715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d400a-871e-47cc-a84c-400f385a5849 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:43.711715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d400a-871e-47cc-a84c-400f385a5849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:43.728471 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-168d400a-871e-47cc-a84c-400f385a5849 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:43.730166 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-168d400a-871e-47cc-a84c-400f385a5849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:43.797013 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 604/1202] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:44:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:44:43.820843 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef481e82-cb4d-46e6-8195-a5b4ef737be6 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:43.921727 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef481e82-cb4d-46e6-8195-a5b4ef737be6 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:43.957244 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57784efb-4c14-4770-9348-31887d5e6259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:43.957819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57784efb-4c14-4770-9348-31887d5e6259 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:43.958104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57784efb-4c14-4770-9348-31887d5e6259 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:43.958382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57784efb-4c14-4770-9348-31887d5e6259 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:43.969138 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57784efb-4c14-4770-9348-31887d5e6259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:43.971519 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57784efb-4c14-4770-9348-31887d5e6259 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:43.985454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-57784efb-4c14-4770-9348-31887d5e6259 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:44:43.985454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:44:43.985454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:44:43.985454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:44:43.985454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:44:43.985454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:44:43.985454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:44:43.985454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:44:43.985454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:44:43.985454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:44:43.985454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:44:43.985454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:44:43.985454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:44:43.985454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:44:43.985454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:44:43.986481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:44:43.986481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:44:43.986481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:44:43.986481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:44:43.986481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:44:43.986481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:44:43.986481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:44:43.986481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:44:43.986481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:44:43.986481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:44:43.986481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:44:43.986481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:44:43.986481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:44:43.986481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:44:43.986481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:44:43.986481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:44:43.986481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:44:43.987497 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:44:43.987497 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:44:43.987497 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:44:43.987497 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:44:43.987497 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 599/1203] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:44:43.992676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d400a-871e-47cc-a84c-400f385a5849 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:44.088938 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d400a-871e-47cc-a84c-400f385a5849 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:44.117415 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:44.123184 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ed392-0de2-4184-9282-07cf3bbb6706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:44.123798 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ed392-0de2-4184-9282-07cf3bbb6706 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:44.124084 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ed392-0de2-4184-9282-07cf3bbb6706 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:44.124365 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ed392-0de2-4184-9282-07cf3bbb6706 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:44.125064 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ed392-0de2-4184-9282-07cf3bbb6706 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:44:44.125366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ed392-0de2-4184-9282-07cf3bbb6706 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:44.126769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ed392-0de2-4184-9282-07cf3bbb6706 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:44.138107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 605/1204] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:44:44.143805 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57784efb-4c14-4770-9348-31887d5e6259 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:44.197116 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:44.246072 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57784efb-4c14-4770-9348-31887d5e6259 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:44.280240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e199e-0c6b-4f85-81d6-fc71a41516f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:44.280855 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e199e-0c6b-4f85-81d6-fc71a41516f8 None admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:44.281139 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e199e-0c6b-4f85-81d6-fc71a41516f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:44.281471 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e199e-0c6b-4f85-81d6-fc71a41516f8 None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:44.282193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e199e-0c6b-4f85-81d6-fc71a41516f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:44.283689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e199e-0c6b-4f85-81d6-fc71a41516f8 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:44.343908 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 600/1205] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Aug 3 12:44:44 2022] POST /identity/v3/users => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:44:46.364641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8e95d-45ee-40ef-80a2-3704d6b904aa None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:46.365183 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8e95d-45ee-40ef-80a2-3704d6b904aa None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:46.365183 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8e95d-45ee-40ef-80a2-3704d6b904aa None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:46.366530 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 606/1206] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:46.371746 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51046f1-659a-400b-8274-9d9f0a369b39 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:46.372144 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51046f1-659a-400b-8274-9d9f0a369b39 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:46.372320 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51046f1-659a-400b-8274-9d9f0a369b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:46.390631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-e51046f1-659a-400b-8274-9d9f0a369b39 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:46.391859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e51046f1-659a-400b-8274-9d9f0a369b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:46.457404 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 601/1207] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:44:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:44:46.480870 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8e95d-45ee-40ef-80a2-3704d6b904aa None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:46.584002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8e95d-45ee-40ef-80a2-3704d6b904aa None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:46.618395 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ac583-ed76-4022-9ab2-cee7e6d9280d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:46.619068 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ac583-ed76-4022-9ab2-cee7e6d9280d None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:46.619370 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ac583-ed76-4022-9ab2-cee7e6d9280d None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:46.619644 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ac583-ed76-4022-9ab2-cee7e6d9280d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:46.629484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ac583-ed76-4022-9ab2-cee7e6d9280d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:44:46.634393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-055ac583-ed76-4022-9ab2-cee7e6d9280d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:44:46.634393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:44:46.634393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:44:46.634393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:44:46.634393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:44:46.634393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:44:46.634393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:44:46.634393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:44:46.634393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:44:46.634393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:44:46.634393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:44:46.634393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:44:46.634393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:44:46.634393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:44:46.634393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:44:46.634393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:44:46.637643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:44:46.637643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:44:46.637643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:44:46.637643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:44:46.637643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:44:46.637643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:44:46.637643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:44:46.637643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:44:46.637643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:44:46.637643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:44:46.637643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:44:46.637643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:44:46.637643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:44:46.637643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:44:46.637643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:44:46.637643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:44:46.638500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:44:46.638500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:44:46.638500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:44:46.638500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:44:46.638500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:44:46.638500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:44:46.638500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:44:46.638500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:44:46.638500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:44:46.638500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:44:46.638500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:44:46.638500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:44:46.638500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 607/1208] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:44:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:44:46.642157 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51046f1-659a-400b-8274-9d9f0a369b39 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:46.685813 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:46.746308 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51046f1-659a-400b-8274-9d9f0a369b39 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:46.781737 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61116d1-f8b0-4a9e-a788-f56a1d0f34c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:46.782360 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61116d1-f8b0-4a9e-a788-f56a1d0f34c4 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:46.782651 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61116d1-f8b0-4a9e-a788-f56a1d0f34c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:46.782960 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61116d1-f8b0-4a9e-a788-f56a1d0f34c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:46.783707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61116d1-f8b0-4a9e-a788-f56a1d0f34c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:44:46.784018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61116d1-f8b0-4a9e-a788-f56a1d0f34c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:46.785386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61116d1-f8b0-4a9e-a788-f56a1d0f34c4 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:46.793526 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 602/1209] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 3 12:44:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:44:46.799265 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ac583-ed76-4022-9ab2-cee7e6d9280d None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:46.848349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:46.896799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ac583-ed76-4022-9ab2-cee7e6d9280d None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:46.929952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c1f3a-ad0f-423c-a169-409e0b1ddfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:46.930589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c1f3a-ad0f-423c-a169-409e0b1ddfff None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:46.930908 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c1f3a-ad0f-423c-a169-409e0b1ddfff None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:46.931194 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c1f3a-ad0f-423c-a169-409e0b1ddfff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:46.941644 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c1f3a-ad0f-423c-a169-409e0b1ddfff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:46.943160 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c1f3a-ad0f-423c-a169-409e0b1ddfff None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:46.958063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-be0c1f3a-ad0f-423c-a169-409e0b1ddfff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:44:46.958063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:44:46.958063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:44:46.958063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:44:46.958063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:44:46.958063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:44:46.958063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:44:46.958063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:44:46.958063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:44:46.958063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:44:46.958063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:44:46.958063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:44:46.958063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:44:46.958063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:44:46.958063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:44:46.959231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:44:46.959231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:44:46.959231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:44:46.959231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:44:46.959231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:44:46.959231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:44:46.959231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:44:46.959231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:44:46.959231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:44:46.959231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:44:46.959231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:44:46.959231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:44:46.959231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:44:46.959231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:44:46.959231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:44:46.959231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:44:46.959231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:44:46.960677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:44:46.960677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:44:46.960677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:44:46.960677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:44:46.960677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 608/1210] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:44:46.965126 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61116d1-f8b0-4a9e-a788-f56a1d0f34c4 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:47.061933 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:47.064701 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61116d1-f8b0-4a9e-a788-f56a1d0f34c4 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:47.096957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67082921-1773-43c0-85a4-9cf01ba77d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:47.097597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67082921-1773-43c0-85a4-9cf01ba77d6a None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:47.097878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67082921-1773-43c0-85a4-9cf01ba77d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:47.098150 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67082921-1773-43c0-85a4-9cf01ba77d6a None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:47.098860 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67082921-1773-43c0-85a4-9cf01ba77d6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:44:47.099162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67082921-1773-43c0-85a4-9cf01ba77d6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:47.101225 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67082921-1773-43c0-85a4-9cf01ba77d6a None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:47.114593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 603/1211] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:44:47.120959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c1f3a-ad0f-423c-a169-409e0b1ddfff None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:47.226209 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c1f3a-ad0f-423c-a169-409e0b1ddfff None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:47.227899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:47.261429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199db1f1-226d-4d19-b85d-faa19e4e833e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:47.262101 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199db1f1-226d-4d19-b85d-faa19e4e833e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:47.262388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199db1f1-226d-4d19-b85d-faa19e4e833e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:47.262664 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199db1f1-226d-4d19-b85d-faa19e4e833e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:47.269627 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199db1f1-226d-4d19-b85d-faa19e4e833e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:47.271093 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199db1f1-226d-4d19-b85d-faa19e4e833e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:47.282689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-199db1f1-226d-4d19-b85d-faa19e4e833e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:44:47.282689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:44:47.282689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:44:47.282689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:44:47.282689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:44:47.282689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:44:47.282689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:44:47.282689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:44:47.282689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:44:47.282689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:44:47.282689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:44:47.282689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:44:47.282689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:44:47.282689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:44:47.282689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:44:47.282689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:44:47.283834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:44:47.283834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:44:47.283834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:44:47.283834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:44:47.283834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:44:47.283834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:44:47.283834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:44:47.283834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:44:47.283834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:44:47.283834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:44:47.283834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:44:47.283834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:44:47.283834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:44:47.283834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:44:47.283834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:44:47.283834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:44:47.283834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:44:47.283834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:44:47.284841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:44:47.284841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:44:47.284841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:44:47.284841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:44:47.284841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:44:47.284841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:44:47.284841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:44:47.284841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:44:47.284841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:44:47.284841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:44:47.284841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 609/1212] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:44:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:44:47.289986 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67082921-1773-43c0-85a4-9cf01ba77d6a None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:47.390006 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67082921-1773-43c0-85a4-9cf01ba77d6a None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:47.423952 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435b945-89df-46a3-a7a6-e77819c3e236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:47.424572 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435b945-89df-46a3-a7a6-e77819c3e236 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:47.424859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435b945-89df-46a3-a7a6-e77819c3e236 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:47.425137 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435b945-89df-46a3-a7a6-e77819c3e236 None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:47.425942 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435b945-89df-46a3-a7a6-e77819c3e236 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:44:47.426251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435b945-89df-46a3-a7a6-e77819c3e236 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:47.427715 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435b945-89df-46a3-a7a6-e77819c3e236 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:47.445855 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 604/1213] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 3 12:44:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:44:47.451691 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199db1f1-226d-4d19-b85d-faa19e4e833e None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:47.553450 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199db1f1-226d-4d19-b85d-faa19e4e833e None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:47.586336 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591c12a-2d80-4c4b-8a83-539508d5b1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:47.586985 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591c12a-2d80-4c4b-8a83-539508d5b1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:47.587270 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591c12a-2d80-4c4b-8a83-539508d5b1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:47.587547 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591c12a-2d80-4c4b-8a83-539508d5b1c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:47.620757 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:47.660967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591c12a-2d80-4c4b-8a83-539508d5b1c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:47.662580 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591c12a-2d80-4c4b-8a83-539508d5b1c9 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:47.760812 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 610/1214] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:44:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:44:47.766644 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435b945-89df-46a3-a7a6-e77819c3e236 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:47.786557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:47.866521 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435b945-89df-46a3-a7a6-e77819c3e236 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:47.900283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d45b1-9d7c-4229-b3d1-113071370220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:47.901459 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d45b1-9d7c-4229-b3d1-113071370220 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:47.901740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d45b1-9d7c-4229-b3d1-113071370220 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:47.902014 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d45b1-9d7c-4229-b3d1-113071370220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:47.912620 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d45b1-9d7c-4229-b3d1-113071370220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:47.913990 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d45b1-9d7c-4229-b3d1-113071370220 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:47.928266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-862d45b1-9d7c-4229-b3d1-113071370220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:44:47.928266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:44:47.928266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:44:47.928266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:44:47.928266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:44:47.928266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:44:47.928266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:44:47.928266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:44:47.928266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:44:47.928266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:44:47.928266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:44:47.928266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:44:47.928266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:44:47.928266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:44:47.928266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:44:47.929417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:44:47.929417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:44:47.929417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:44:47.929417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:44:47.929417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:44:47.929417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:44:47.929417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:44:47.929417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:44:47.929417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:44:47.929417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:44:47.929417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:44:47.929417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:44:47.929417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:44:47.929417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:44:47.929417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:44:47.929417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:44:47.929417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:44:47.930324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:44:47.930324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:44:47.930324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:44:47.930324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:44:47.930324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 605/1215] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:44:47.935258 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591c12a-2d80-4c4b-8a83-539508d5b1c9 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:47.996051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:48.035812 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591c12a-2d80-4c4b-8a83-539508d5b1c9 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:48.067427 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83585055-ae1e-44ed-bf1f-0d0590ca8687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:48.068070 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83585055-ae1e-44ed-bf1f-0d0590ca8687 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:48.068357 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83585055-ae1e-44ed-bf1f-0d0590ca8687 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:48.068640 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83585055-ae1e-44ed-bf1f-0d0590ca8687 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:48.069332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83585055-ae1e-44ed-bf1f-0d0590ca8687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:44:48.069638 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83585055-ae1e-44ed-bf1f-0d0590ca8687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:48.071032 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83585055-ae1e-44ed-bf1f-0d0590ca8687 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:48.083092 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 611/1216] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:44:48.089287 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d45b1-9d7c-4229-b3d1-113071370220 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:48.158609 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:48.191638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d45b1-9d7c-4229-b3d1-113071370220 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:48.225499 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bde9bc-0d8c-4cba-b077-6e93392b30ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:48.226168 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bde9bc-0d8c-4cba-b077-6e93392b30ea None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:48.226460 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bde9bc-0d8c-4cba-b077-6e93392b30ea None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:48.226764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bde9bc-0d8c-4cba-b077-6e93392b30ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:48.233740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bde9bc-0d8c-4cba-b077-6e93392b30ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:48.235233 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bde9bc-0d8c-4cba-b077-6e93392b30ea None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:48.246421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-29bde9bc-0d8c-4cba-b077-6e93392b30ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:44:48.246421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:44:48.246421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:44:48.246421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:44:48.246421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:44:48.246421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:44:48.246421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:44:48.246421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:44:48.246421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:44:48.246421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:44:48.246421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:44:48.246421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:44:48.246421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:44:48.246421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:44:48.246421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:44:48.247557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:44:48.247557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:44:48.247557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:44:48.247557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:44:48.247557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:44:48.247557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:44:48.247557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:44:48.247557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:44:48.247557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:44:48.247557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:44:48.247557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:44:48.247557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:44:48.247557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:44:48.247557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:44:48.247557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:44:48.247557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:44:48.247557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:44:48.248862 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:44:48.248862 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:44:48.248862 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:44:48.248862 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:44:48.248862 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:44:48.248862 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:44:48.248862 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:44:48.248862 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:44:48.248862 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 606/1217] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:44:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:44:48.253408 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83585055-ae1e-44ed-bf1f-0d0590ca8687 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:48.352318 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83585055-ae1e-44ed-bf1f-0d0590ca8687 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:48.375066 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:48.386934 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc96d2-ebf2-4619-9187-44f670bd7ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:48.387543 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc96d2-ebf2-4619-9187-44f670bd7ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:48.387826 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc96d2-ebf2-4619-9187-44f670bd7ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:48.388099 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc96d2-ebf2-4619-9187-44f670bd7ca5 None admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:48.388866 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc96d2-ebf2-4619-9187-44f670bd7ca5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:44:48.389170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc96d2-ebf2-4619-9187-44f670bd7ca5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:48.390620 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc96d2-ebf2-4619-9187-44f670bd7ca5 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:48.401729 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 612/1218] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:44:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:44:48.407974 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bde9bc-0d8c-4cba-b077-6e93392b30ea None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:48.509724 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bde9bc-0d8c-4cba-b077-6e93392b30ea None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:48.540025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:48.546381 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b450f1-fe00-48aa-8782-1322d4935c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:48.547022 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b450f1-fe00-48aa-8782-1322d4935c68 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:48.547309 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b450f1-fe00-48aa-8782-1322d4935c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:48.547589 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b450f1-fe00-48aa-8782-1322d4935c68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:48.548414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b450f1-fe00-48aa-8782-1322d4935c68 None admin] RBAC: Adding query filter params (role.id=72fab3a91c004428b7e615dac55116cd, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=de27d25fad634658a1abcb776d9a7b6e) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:44:48.548729 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b450f1-fe00-48aa-8782-1322d4935c68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:48.550169 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b450f1-fe00-48aa-8782-1322d4935c68 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:48.555708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 607/1219] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:44:48 2022] GET /identity/v3/role_assignments?user.id=de27d25fad634658a1abcb776d9a7b6e&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=72fab3a91c004428b7e615dac55116cd => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:44:50.541040 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42252794-ab06-4586-87cc-0fba857dfe10 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:50.541591 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42252794-ab06-4586-87cc-0fba857dfe10 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:50.541591 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42252794-ab06-4586-87cc-0fba857dfe10 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:50.543033 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 613/1220] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:50.548078 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a4c1a-e9e5-4c6b-8305-be486c043dd6 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:50.548499 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a4c1a-e9e5-4c6b-8305-be486c043dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:50.548635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a4c1a-e9e5-4c6b-8305-be486c043dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:50.567080 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-2a4a4c1a-e9e5-4c6b-8305-be486c043dd6 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:50.568290 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-2a4a4c1a-e9e5-4c6b-8305-be486c043dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:50.632869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 608/1221] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:44:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:44:50.655560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42252794-ab06-4586-87cc-0fba857dfe10 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:50.759060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42252794-ab06-4586-87cc-0fba857dfe10 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:50.797154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d638de-2100-446d-a390-c6e62cb45471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:50.797154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d638de-2100-446d-a390-c6e62cb45471 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:50.797154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d638de-2100-446d-a390-c6e62cb45471 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:50.797154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d638de-2100-446d-a390-c6e62cb45471 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:50.806333 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d638de-2100-446d-a390-c6e62cb45471 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:44:50.811837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-53d638de-2100-446d-a390-c6e62cb45471 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:44:50.811837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:44:50.811837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:44:50.811837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:44:50.811837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:44:50.811837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:44:50.811837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:44:50.811837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:44:50.811837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:44:50.811837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:44:50.811837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:44:50.811837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:44:50.811837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:44:50.811837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:44:50.811837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:44:50.811837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:44:50.812982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:44:50.812982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:44:50.812982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:44:50.812982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:44:50.812982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:44:50.812982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:44:50.812982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:44:50.812982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:44:50.812982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:44:50.812982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:44:50.812982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:44:50.812982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:44:50.812982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:44:50.812982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:44:50.812982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:44:50.812982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:44:50.814175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:44:50.814175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:44:50.814175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:44:50.814175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:44:50.814175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:44:50.814175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:44:50.814175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:44:50.814175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:44:50.814175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:44:50.814175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:44:50.814175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:44:50.814175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:44:50.814175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 614/1222] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:44:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:44:50.819150 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a4c1a-e9e5-4c6b-8305-be486c043dd6 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:50.917794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a4c1a-e9e5-4c6b-8305-be486c043dd6 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:50.941247 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:50.951692 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d847aa5-def9-4ec3-af4d-846b34142128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:50.952316 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d847aa5-def9-4ec3-af4d-846b34142128 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:50.952603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d847aa5-def9-4ec3-af4d-846b34142128 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:50.952880 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d847aa5-def9-4ec3-af4d-846b34142128 None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:50.953598 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d847aa5-def9-4ec3-af4d-846b34142128 None admin] RBAC: Adding query filter params (name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:44:50.953914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d847aa5-def9-4ec3-af4d-846b34142128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:50.955341 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d847aa5-def9-4ec3-af4d-846b34142128 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:50.963059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 609/1223] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 3 12:44:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:44:50.968777 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d638de-2100-446d-a390-c6e62cb45471 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:51.012007 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:51.069251 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d638de-2100-446d-a390-c6e62cb45471 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:51.102948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256a088-993f-4a4c-9bd6-94b7e4f76931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:51.104126 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256a088-993f-4a4c-9bd6-94b7e4f76931 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:51.104398 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256a088-993f-4a4c-9bd6-94b7e4f76931 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:51.104674 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256a088-993f-4a4c-9bd6-94b7e4f76931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:51.115327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256a088-993f-4a4c-9bd6-94b7e4f76931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:51.116864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256a088-993f-4a4c-9bd6-94b7e4f76931 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:51.131553 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-2256a088-993f-4a4c-9bd6-94b7e4f76931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:44:51.131553 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:44:51.131553 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:44:51.131553 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:44:51.131553 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:44:51.131553 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:44:51.131553 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:44:51.131553 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:44:51.131553 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:44:51.131553 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:44:51.131553 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:44:51.131553 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:44:51.131553 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:44:51.131553 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:44:51.131553 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:44:51.132604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:44:51.132604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:44:51.132604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:44:51.132604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:44:51.132604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:44:51.132604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:44:51.132604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:44:51.132604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:44:51.132604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:44:51.132604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:44:51.132604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:44:51.132604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:44:51.132604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:44:51.132604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:44:51.132604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:44:51.132604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:44:51.132604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:44:51.133865 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:44:51.133865 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:44:51.133865 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:44:51.133865 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:44:51.133865 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 615/1224] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:44:51.138518 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d847aa5-def9-4ec3-af4d-846b34142128 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:51.236938 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d847aa5-def9-4ec3-af4d-846b34142128 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:51.270070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe69c7-4949-4aaa-8a20-0fe7fe672eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:51.270685 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe69c7-4949-4aaa-8a20-0fe7fe672eec None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:51.271001 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe69c7-4949-4aaa-8a20-0fe7fe672eec None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:51.271283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe69c7-4949-4aaa-8a20-0fe7fe672eec None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:51.271981 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe69c7-4949-4aaa-8a20-0fe7fe672eec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:44:51.272292 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe69c7-4949-4aaa-8a20-0fe7fe672eec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:51.273700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe69c7-4949-4aaa-8a20-0fe7fe672eec None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:51.285550 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 610/1225] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:44:51.291294 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256a088-993f-4a4c-9bd6-94b7e4f76931 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:51.385712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:51.392410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256a088-993f-4a4c-9bd6-94b7e4f76931 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:51.426311 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efc4d4-0bfb-44a3-b64b-52e927c7aaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:51.426981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efc4d4-0bfb-44a3-b64b-52e927c7aaf3 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:51.427264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efc4d4-0bfb-44a3-b64b-52e927c7aaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:51.427538 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efc4d4-0bfb-44a3-b64b-52e927c7aaf3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:51.434331 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efc4d4-0bfb-44a3-b64b-52e927c7aaf3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:51.436075 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efc4d4-0bfb-44a3-b64b-52e927c7aaf3 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:51.447894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-a9efc4d4-0bfb-44a3-b64b-52e927c7aaf3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:44:51.447894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:44:51.447894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:44:51.447894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:44:51.447894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:44:51.447894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:44:51.447894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:44:51.447894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:44:51.447894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:44:51.447894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:44:51.447894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:44:51.447894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:44:51.447894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:44:51.447894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:44:51.447894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:44:51.447894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:44:51.449021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:44:51.449021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:44:51.449021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:44:51.449021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:44:51.449021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:44:51.449021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:44:51.449021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:44:51.449021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:44:51.449021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:44:51.449021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:44:51.449021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:44:51.449021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:44:51.449021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:44:51.449021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:44:51.449021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:44:51.449021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:44:51.449021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:44:51.449021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:44:51.450510 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:44:51.450510 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:44:51.450510 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:44:51.450510 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:44:51.450510 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:44:51.450510 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:44:51.450510 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:44:51.450510 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:44:51.450510 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:44:51.450510 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:44:51.450510 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 616/1226] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:44:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:44:51.455062 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe69c7-4949-4aaa-8a20-0fe7fe672eec None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:51.501276 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:51.552807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe69c7-4949-4aaa-8a20-0fe7fe672eec None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:51.586152 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f6174-a5df-411e-b71d-90681beaf896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:51.586784 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f6174-a5df-411e-b71d-90681beaf896 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:51.587125 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f6174-a5df-411e-b71d-90681beaf896 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:51.587407 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f6174-a5df-411e-b71d-90681beaf896 None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:51.588784 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f6174-a5df-411e-b71d-90681beaf896 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:44:51.589093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f6174-a5df-411e-b71d-90681beaf896 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:51.591385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f6174-a5df-411e-b71d-90681beaf896 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:51.609080 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 611/1227] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 3 12:44:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:44:51.614856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efc4d4-0bfb-44a3-b64b-52e927c7aaf3 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:51.717828 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efc4d4-0bfb-44a3-b64b-52e927c7aaf3 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:51.749626 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceda03-8c55-414b-a63d-719e180d2835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:51.750251 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceda03-8c55-414b-a63d-719e180d2835 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:51.750539 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceda03-8c55-414b-a63d-719e180d2835 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:51.750840 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceda03-8c55-414b-a63d-719e180d2835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:51.761467 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceda03-8c55-414b-a63d-719e180d2835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:51.762925 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceda03-8c55-414b-a63d-719e180d2835 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:51.777236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-51ceda03-8c55-414b-a63d-719e180d2835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:44:51.777236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:44:51.777236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:44:51.777236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:44:51.777236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:44:51.777236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:44:51.777236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:44:51.777236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:44:51.777236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:44:51.777236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:44:51.777236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:44:51.777236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:44:51.777236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:44:51.777236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:44:51.777236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:44:51.785107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:44:51.785107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:44:51.785107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:44:51.785107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:44:51.785107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:44:51.785107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:44:51.785107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:44:51.785107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:44:51.785107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:44:51.785107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:44:51.785107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:44:51.785107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:44:51.785107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:44:51.785107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:44:51.785107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:44:51.785107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:44:51.785107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:44:51.786508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:44:51.786508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:44:51.786508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:44:51.786508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:44:51.786508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 617/1228] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:44:51.786905 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f6174-a5df-411e-b71d-90681beaf896 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:51.881533 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f6174-a5df-411e-b71d-90681beaf896 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:51.883819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:51.915483 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372e53e-b4d2-4ae6-bc13-56d31cd50b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:51.916089 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372e53e-b4d2-4ae6-bc13-56d31cd50b87 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:51.916371 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372e53e-b4d2-4ae6-bc13-56d31cd50b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:51.916646 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372e53e-b4d2-4ae6-bc13-56d31cd50b87 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:51.917334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372e53e-b4d2-4ae6-bc13-56d31cd50b87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:44:51.917641 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372e53e-b4d2-4ae6-bc13-56d31cd50b87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:51.919311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372e53e-b4d2-4ae6-bc13-56d31cd50b87 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:51.929929 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 612/1229] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:44:51.935742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceda03-8c55-414b-a63d-719e180d2835 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:51.945611 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:52.036223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceda03-8c55-414b-a63d-719e180d2835 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:52.069835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b55a6-d51c-41b7-9bd8-7685457fdc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:52.070469 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b55a6-d51c-41b7-9bd8-7685457fdc8a None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:52.070783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b55a6-d51c-41b7-9bd8-7685457fdc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:52.071068 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b55a6-d51c-41b7-9bd8-7685457fdc8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:52.078524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b55a6-d51c-41b7-9bd8-7685457fdc8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:52.080118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b55a6-d51c-41b7-9bd8-7685457fdc8a None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:52.091466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-5a9b55a6-d51c-41b7-9bd8-7685457fdc8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:44:52.091466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:44:52.091466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:44:52.091466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:44:52.091466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:44:52.091466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:44:52.091466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:44:52.091466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:44:52.091466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:44:52.091466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:44:52.091466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:44:52.091466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:44:52.091466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:44:52.091466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:44:52.091466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:44:52.092633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:44:52.092633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:44:52.092633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:44:52.092633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:44:52.092633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:44:52.092633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:44:52.092633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:44:52.092633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:44:52.092633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:44:52.092633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:44:52.092633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:44:52.092633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:44:52.092633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:44:52.092633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:44:52.092633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:44:52.092633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:44:52.092633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:44:52.093686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:44:52.093686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:44:52.093686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:44:52.093686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:44:52.093686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:44:52.093686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:44:52.093686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:44:52.093686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:44:52.093686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 618/1230] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:44:52.098654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372e53e-b4d2-4ae6-bc13-56d31cd50b87 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:52.199962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372e53e-b4d2-4ae6-bc13-56d31cd50b87 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:52.232325 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a40606-b205-411e-8c91-127ba32aa4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:52.232994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a40606-b205-411e-8c91-127ba32aa4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:52.233281 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a40606-b205-411e-8c91-127ba32aa4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:52.233562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a40606-b205-411e-8c91-127ba32aa4e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:52.234314 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a40606-b205-411e-8c91-127ba32aa4e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:44:52.234625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a40606-b205-411e-8c91-127ba32aa4e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:52.236082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a40606-b205-411e-8c91-127ba32aa4e0 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:52.249141 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 613/1231] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:44:52.255363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b55a6-d51c-41b7-9bd8-7685457fdc8a None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:52.320091 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:52.353215 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b55a6-d51c-41b7-9bd8-7685457fdc8a None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:52.388521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf35eb1-481a-4c87-9bba-78db1004c12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:52.389187 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf35eb1-481a-4c87-9bba-78db1004c12f None admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:52.389472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf35eb1-481a-4c87-9bba-78db1004c12f None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:52.389749 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf35eb1-481a-4c87-9bba-78db1004c12f None admin] PATH_INFO: `/v3/projects/020d395e82f0448f95789a896703ce98/users/de27d25fad634658a1abcb776d9a7b6e/roles/72fab3a91c004428b7e615dac55116cd` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:52.403585 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf35eb1-481a-4c87-9bba-78db1004c12f None admin] RBAC: Authorizing `identity:create_grant(project_id=020d395e82f0448f95789a896703ce98, user_id=de27d25fad634658a1abcb776d9a7b6e, role_id=72fab3a91c004428b7e615dac55116cd)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:52.405040 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf35eb1-481a-4c87-9bba-78db1004c12f None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:52.457344 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 619/1232] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:44:52 2022] PUT /identity/v3/projects/020d395e82f0448f95789a896703ce98/users/de27d25fad634658a1abcb776d9a7b6e/roles/72fab3a91c004428b7e615dac55116cd => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:44:54.420291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133528e-91a4-48ac-b122-9bdfa6280ed4 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:54.420844 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133528e-91a4-48ac-b122-9bdfa6280ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:54.420964 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133528e-91a4-48ac-b122-9bdfa6280ed4 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:54.422249 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 614/1233] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:54.427372 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdde10-3c2c-4dcf-a6fc-d145a450913b None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:54.427753 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdde10-3c2c-4dcf-a6fc-d145a450913b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:54.427921 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdde10-3c2c-4dcf-a6fc-d145a450913b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:54.445924 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-d9bdde10-3c2c-4dcf-a6fc-d145a450913b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:54.447756 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d9bdde10-3c2c-4dcf-a6fc-d145a450913b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:54.522183 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 620/1234] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:44:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:44:54.545323 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133528e-91a4-48ac-b122-9bdfa6280ed4 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:54.570518 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:54.647262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133528e-91a4-48ac-b122-9bdfa6280ed4 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:54.682181 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639019fb-c5db-4e46-895c-f1e5607d68b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:54.682783 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639019fb-c5db-4e46-895c-f1e5607d68b7 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:54.683068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639019fb-c5db-4e46-895c-f1e5607d68b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:54.683343 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639019fb-c5db-4e46-895c-f1e5607d68b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:54.693315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639019fb-c5db-4e46-895c-f1e5607d68b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:44:54.698295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-639019fb-c5db-4e46-895c-f1e5607d68b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:44:54.698295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:44:54.698295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:44:54.698295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:44:54.698295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:44:54.698295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:44:54.698295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:44:54.698295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:44:54.698295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:44:54.698295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:44:54.698295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:44:54.698295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:44:54.698295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:44:54.698295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:44:54.698295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:44:54.698295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:44:54.699480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:44:54.699480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:44:54.699480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:44:54.699480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:44:54.699480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:44:54.699480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:44:54.699480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:44:54.699480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:44:54.699480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:44:54.699480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:44:54.699480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:44:54.699480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:44:54.699480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:44:54.699480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:44:54.699480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:44:54.699480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:44:54.700352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:44:54.700352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:44:54.700352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:44:54.700352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:44:54.700352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:44:54.700352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:44:54.700352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:44:54.700352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:44:54.700352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:44:54.700352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:44:54.700352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:44:54.700352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:44:54.700352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 615/1235] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Aug 3 12:44:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:44:54.705584 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdde10-3c2c-4dcf-a6fc-d145a450913b None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:54.751668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:54.809335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdde10-3c2c-4dcf-a6fc-d145a450913b None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:54.842352 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bdb25-8c32-4394-87b2-d9e0588c8ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:54.842993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bdb25-8c32-4394-87b2-d9e0588c8ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:54.843274 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bdb25-8c32-4394-87b2-d9e0588c8ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:54.843547 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bdb25-8c32-4394-87b2-d9e0588c8ca9 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:54.844260 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bdb25-8c32-4394-87b2-d9e0588c8ca9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:44:54.844563 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bdb25-8c32-4394-87b2-d9e0588c8ca9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:54.845985 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bdb25-8c32-4394-87b2-d9e0588c8ca9 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:54.854141 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 621/1236] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Aug 3 12:44:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:44:54.859914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639019fb-c5db-4e46-895c-f1e5607d68b7 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:54.949614 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:54.965056 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639019fb-c5db-4e46-895c-f1e5607d68b7 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:54.998657 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c97d7b-4221-475d-a697-d0923737ba7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:54.999331 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c97d7b-4221-475d-a697-d0923737ba7e None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:54.999617 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c97d7b-4221-475d-a697-d0923737ba7e None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:54.999896 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c97d7b-4221-475d-a697-d0923737ba7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:55.009598 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c97d7b-4221-475d-a697-d0923737ba7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:55.011088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c97d7b-4221-475d-a697-d0923737ba7e None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:55.025681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-16c97d7b-4221-475d-a697-d0923737ba7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:44:55.025681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:44:55.025681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:44:55.025681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:44:55.025681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:44:55.025681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:44:55.025681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:44:55.025681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:44:55.025681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:44:55.025681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:44:55.025681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:44:55.025681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:44:55.025681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:44:55.025681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:44:55.025681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:44:55.026574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:44:55.026574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:44:55.026574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:44:55.026574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:44:55.026574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:44:55.026574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:44:55.026574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:44:55.026574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:44:55.026574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:44:55.026574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:44:55.026574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:44:55.026574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:44:55.026574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:44:55.026574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:44:55.026574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:44:55.026574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:44:55.026574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:44:55.027551 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:44:55.027551 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:44:55.027551 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:44:55.027551 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:44:55.027551 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 616/1237] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:44:55.032729 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bdb25-8c32-4394-87b2-d9e0588c8ca9 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:55.131709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bdb25-8c32-4394-87b2-d9e0588c8ca9 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:55.142108 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:55.172210 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660f112-ee90-4eb0-97a5-3628b3e975df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:55.172835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660f112-ee90-4eb0-97a5-3628b3e975df None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:55.173124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660f112-ee90-4eb0-97a5-3628b3e975df None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:55.173408 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660f112-ee90-4eb0-97a5-3628b3e975df None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:55.174103 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660f112-ee90-4eb0-97a5-3628b3e975df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:44:55.174413 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660f112-ee90-4eb0-97a5-3628b3e975df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:55.175845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660f112-ee90-4eb0-97a5-3628b3e975df None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:55.188091 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 622/1238] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:44:55.193786 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c97d7b-4221-475d-a697-d0923737ba7e None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:55.293506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c97d7b-4221-475d-a697-d0923737ba7e None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:55.325965 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21eced-0ecc-4d08-9bc2-c028b394726b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:55.326606 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21eced-0ecc-4d08-9bc2-c028b394726b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:55.326922 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21eced-0ecc-4d08-9bc2-c028b394726b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:55.327202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21eced-0ecc-4d08-9bc2-c028b394726b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:55.329828 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:55.334639 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21eced-0ecc-4d08-9bc2-c028b394726b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:55.336113 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21eced-0ecc-4d08-9bc2-c028b394726b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:55.347845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-ab21eced-0ecc-4d08-9bc2-c028b394726b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:44:55.347845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:44:55.347845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:44:55.347845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:44:55.347845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:44:55.347845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:44:55.347845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:44:55.347845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:44:55.347845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:44:55.347845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:44:55.347845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:44:55.347845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:44:55.347845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:44:55.347845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:44:55.347845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:44:55.347845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:44:55.351505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:44:55.351505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:44:55.351505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:44:55.351505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:44:55.351505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:44:55.351505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:44:55.351505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:44:55.351505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:44:55.351505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:44:55.351505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:44:55.351505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:44:55.351505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:44:55.351505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:44:55.351505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:44:55.351505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:44:55.351505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:44:55.351505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:44:55.351505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:44:55.352544 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:44:55.352544 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:44:55.352544 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:44:55.352544 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:44:55.352544 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:44:55.352544 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:44:55.352544 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:44:55.352544 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:44:55.352544 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:44:55.352544 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:44:55.352544 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 617/1239] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:44:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:44:55.355455 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660f112-ee90-4eb0-97a5-3628b3e975df None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:55.461435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660f112-ee90-4eb0-97a5-3628b3e975df None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:55.496873 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3c947-97d7-4e98-b968-43669fb9d5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:55.497490 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3c947-97d7-4e98-b968-43669fb9d5ea None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:55.497776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3c947-97d7-4e98-b968-43669fb9d5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:55.498066 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3c947-97d7-4e98-b968-43669fb9d5ea None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:55.498883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3c947-97d7-4e98-b968-43669fb9d5ea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:44:55.499194 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3c947-97d7-4e98-b968-43669fb9d5ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:55.500626 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3c947-97d7-4e98-b968-43669fb9d5ea None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:55.517755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 623/1240] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 3 12:44:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:44:55.523742 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21eced-0ecc-4d08-9bc2-c028b394726b None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:55.622651 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21eced-0ecc-4d08-9bc2-c028b394726b None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:55.656662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e44789-3c81-482a-b351-3bd77f5f48ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:55.657274 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e44789-3c81-482a-b351-3bd77f5f48ff None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:55.657559 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e44789-3c81-482a-b351-3bd77f5f48ff None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:55.657836 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e44789-3c81-482a-b351-3bd77f5f48ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:55.718233 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:55.724528 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e44789-3c81-482a-b351-3bd77f5f48ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:55.725977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e44789-3c81-482a-b351-3bd77f5f48ff None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:55.826232 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 618/1241] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:44:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:44:55.832096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3c947-97d7-4e98-b968-43669fb9d5ea None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:55.859007 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:55.929984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3c947-97d7-4e98-b968-43669fb9d5ea None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:55.964832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d87fee-f51d-461b-b7d8-4834303d69d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:55.965463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d87fee-f51d-461b-b7d8-4834303d69d7 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:55.965743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d87fee-f51d-461b-b7d8-4834303d69d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:55.966016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d87fee-f51d-461b-b7d8-4834303d69d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:55.975817 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d87fee-f51d-461b-b7d8-4834303d69d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:55.977239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d87fee-f51d-461b-b7d8-4834303d69d7 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:55.991613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-82d87fee-f51d-461b-b7d8-4834303d69d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:44:55.991613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:44:55.991613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:44:55.991613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:44:55.991613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:44:55.991613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:44:55.991613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:44:55.991613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:44:55.991613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:44:55.991613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:44:55.991613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:44:55.991613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:44:55.991613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:44:55.991613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:44:55.991613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:44:55.992713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:44:55.992713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:44:55.992713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:44:55.992713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:44:55.992713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:44:55.992713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:44:55.992713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:44:55.992713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:44:55.992713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:44:55.992713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:44:55.992713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:44:55.992713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:44:55.992713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:44:55.992713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:44:55.992713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:44:55.992713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:44:55.992713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:44:55.994416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:44:55.994416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:44:55.994416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:44:55.994416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:44:55.994416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 624/1242] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:44:55.999190 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e44789-3c81-482a-b351-3bd77f5f48ff None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:56.091841 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:56.097494 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e44789-3c81-482a-b351-3bd77f5f48ff None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:56.133260 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53be5c-f880-42a9-8218-b407187b2c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:56.133878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53be5c-f880-42a9-8218-b407187b2c93 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:56.134162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53be5c-f880-42a9-8218-b407187b2c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:56.134481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53be5c-f880-42a9-8218-b407187b2c93 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:56.135757 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53be5c-f880-42a9-8218-b407187b2c93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:44:56.136065 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53be5c-f880-42a9-8218-b407187b2c93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:56.137438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53be5c-f880-42a9-8218-b407187b2c93 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:56.151091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 619/1243] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:44:56.156796 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d87fee-f51d-461b-b7d8-4834303d69d7 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:56.237344 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:56.260055 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d87fee-f51d-461b-b7d8-4834303d69d7 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:56.293839 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16333596-ccdf-4f2b-a8c9-6b16c195c4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:56.294474 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16333596-ccdf-4f2b-a8c9-6b16c195c4cf None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:56.294782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16333596-ccdf-4f2b-a8c9-6b16c195c4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:56.295062 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16333596-ccdf-4f2b-a8c9-6b16c195c4cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:56.301569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16333596-ccdf-4f2b-a8c9-6b16c195c4cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:56.303033 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16333596-ccdf-4f2b-a8c9-6b16c195c4cf None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:56.314918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-16333596-ccdf-4f2b-a8c9-6b16c195c4cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:44:56.314918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:44:56.314918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:44:56.314918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:44:56.314918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:44:56.314918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:44:56.314918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:44:56.314918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:44:56.314918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:44:56.314918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:44:56.314918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:44:56.314918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:44:56.314918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:44:56.314918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:44:56.314918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:44:56.315845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:44:56.315845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:44:56.315845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:44:56.315845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:44:56.315845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:44:56.315845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:44:56.315845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:44:56.315845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:44:56.315845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:44:56.315845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:44:56.315845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:44:56.315845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:44:56.315845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:44:56.315845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:44:56.315845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:44:56.315845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:44:56.315845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:44:56.316899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:44:56.316899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:44:56.316899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:44:56.316899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:44:56.316899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:44:56.316899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:44:56.316899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:44:56.316899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:44:56.316899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 625/1244] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:44:56.321935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53be5c-f880-42a9-8218-b407187b2c93 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:56.421359 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53be5c-f880-42a9-8218-b407187b2c93 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:56.454413 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e343b8-56a1-42ac-9d21-ead0909bbad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:56.455065 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e343b8-56a1-42ac-9d21-ead0909bbad5 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:56.455355 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e343b8-56a1-42ac-9d21-ead0909bbad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:56.455691 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e343b8-56a1-42ac-9d21-ead0909bbad5 None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:56.456489 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e343b8-56a1-42ac-9d21-ead0909bbad5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:44:56.456735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e343b8-56a1-42ac-9d21-ead0909bbad5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:56.458168 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e343b8-56a1-42ac-9d21-ead0909bbad5 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:56.470613 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 620/1245] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:44:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:44:56.476681 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16333596-ccdf-4f2b-a8c9-6b16c195c4cf None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:56.576126 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16333596-ccdf-4f2b-a8c9-6b16c195c4cf None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:56.609494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354460a1-d8c8-487e-9c05-85e6932b5307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:56.610089 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354460a1-d8c8-487e-9c05-85e6932b5307 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:56.610373 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354460a1-d8c8-487e-9c05-85e6932b5307 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:56.610653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354460a1-d8c8-487e-9c05-85e6932b5307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:56.611491 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354460a1-d8c8-487e-9c05-85e6932b5307 None admin] RBAC: Adding query filter params (role.id=72fab3a91c004428b7e615dac55116cd, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=de27d25fad634658a1abcb776d9a7b6e) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:44:56.611809 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354460a1-d8c8-487e-9c05-85e6932b5307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:56.613323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354460a1-d8c8-487e-9c05-85e6932b5307 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:56.619162 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 626/1246] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:44:56 2022] GET /identity/v3/role_assignments?user.id=de27d25fad634658a1abcb776d9a7b6e&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=72fab3a91c004428b7e615dac55116cd => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:44:58.676244 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc71a6-1f32-4740-927a-2ed024bd8075 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:58.676774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc71a6-1f32-4740-927a-2ed024bd8075 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:58.676774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc71a6-1f32-4740-927a-2ed024bd8075 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:58.678185 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 621/1247] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:58.683948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3012d1-bb6d-4938-b605-0f4b6b51a205 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:58.684364 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3012d1-bb6d-4938-b605-0f4b6b51a205 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:58.684516 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3012d1-bb6d-4938-b605-0f4b6b51a205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:58.691044 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:58.702914 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-1c3012d1-bb6d-4938-b605-0f4b6b51a205 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:58.704115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-1c3012d1-bb6d-4938-b605-0f4b6b51a205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:58.769242 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 627/1248] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:44:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:44:58.793767 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc71a6-1f32-4740-927a-2ed024bd8075 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:58.811749 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:58.895658 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc71a6-1f32-4740-927a-2ed024bd8075 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:58.931731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32d845-1bfd-4af2-b37b-0df886d9046a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:58.932546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32d845-1bfd-4af2-b37b-0df886d9046a None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:58.932920 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32d845-1bfd-4af2-b37b-0df886d9046a None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:58.933284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32d845-1bfd-4af2-b37b-0df886d9046a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:58.943480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32d845-1bfd-4af2-b37b-0df886d9046a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:44:58.948362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-7e32d845-1bfd-4af2-b37b-0df886d9046a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:44:58.948362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:44:58.948362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:44:58.948362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:44:58.948362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:44:58.948362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:44:58.948362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:44:58.948362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:44:58.948362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:44:58.948362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:44:58.948362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:44:58.948362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:44:58.948362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:44:58.948362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:44:58.948362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:44:58.948362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:44:58.949429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:44:58.949429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:44:58.949429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:44:58.949429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:44:58.949429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:44:58.949429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:44:58.949429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:44:58.949429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:44:58.949429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:44:58.949429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:44:58.949429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:44:58.949429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:44:58.949429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:44:58.949429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:44:58.949429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:44:58.949429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:44:58.950317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:44:58.950317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:44:58.950317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:44:58.950317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:44:58.950317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:44:58.950317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:44:58.950317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:44:58.950317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:44:58.950317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:44:58.950317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:44:58.950317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:44:58.950317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:44:58.950317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 622/1249] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:44:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:44:58.955690 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3012d1-bb6d-4938-b605-0f4b6b51a205 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:59.053600 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3012d1-bb6d-4938-b605-0f4b6b51a205 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:59.082976 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:59.088580 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b2f6b-59ba-4d36-a09d-c91410cf0447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:59.089193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b2f6b-59ba-4d36-a09d-c91410cf0447 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:59.089480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b2f6b-59ba-4d36-a09d-c91410cf0447 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:59.089759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b2f6b-59ba-4d36-a09d-c91410cf0447 None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:59.090481 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b2f6b-59ba-4d36-a09d-c91410cf0447 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:44:59.090817 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b2f6b-59ba-4d36-a09d-c91410cf0447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:59.092194 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b2f6b-59ba-4d36-a09d-c91410cf0447 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:59.100072 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 628/1250] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:44:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:44:59.106545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32d845-1bfd-4af2-b37b-0df886d9046a None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:59.185736 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:59.208383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32d845-1bfd-4af2-b37b-0df886d9046a None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:59.242420 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea824133-38cb-4d8e-816c-be2890f6de49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:59.243113 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea824133-38cb-4d8e-816c-be2890f6de49 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:59.243402 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea824133-38cb-4d8e-816c-be2890f6de49 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:59.243701 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea824133-38cb-4d8e-816c-be2890f6de49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:59.253436 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea824133-38cb-4d8e-816c-be2890f6de49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:59.254912 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea824133-38cb-4d8e-816c-be2890f6de49 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:59.269733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-ea824133-38cb-4d8e-816c-be2890f6de49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:44:59.269733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:44:59.269733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:44:59.269733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:44:59.269733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:44:59.269733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:44:59.269733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:44:59.269733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:44:59.269733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:44:59.269733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:44:59.269733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:44:59.269733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:44:59.269733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:44:59.269733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:44:59.269733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:44:59.270832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:44:59.270832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:44:59.270832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:44:59.270832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:44:59.270832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:44:59.270832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:44:59.270832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:44:59.270832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:44:59.270832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:44:59.270832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:44:59.270832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:44:59.270832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:44:59.270832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:44:59.270832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:44:59.270832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:44:59.270832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:44:59.270832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:44:59.272139 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:44:59.272139 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:44:59.272139 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:44:59.272139 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:44:59.272139 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 623/1251] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:44:59.279866 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b2f6b-59ba-4d36-a09d-c91410cf0447 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:59.377195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b2f6b-59ba-4d36-a09d-c91410cf0447 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:59.411802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507588af-8335-4721-9ca0-5fe7c1069abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:59.412427 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507588af-8335-4721-9ca0-5fe7c1069abf None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:59.412712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507588af-8335-4721-9ca0-5fe7c1069abf None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:59.412992 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507588af-8335-4721-9ca0-5fe7c1069abf None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:59.413709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507588af-8335-4721-9ca0-5fe7c1069abf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:44:59.414020 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507588af-8335-4721-9ca0-5fe7c1069abf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:59.415432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507588af-8335-4721-9ca0-5fe7c1069abf None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:59.426936 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 629/1252] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:44:59.432802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea824133-38cb-4d8e-816c-be2890f6de49 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:59.531014 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea824133-38cb-4d8e-816c-be2890f6de49 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:59.555765 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:59.563921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ed89e-6722-43f4-8123-1c9728ed8732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:59.564559 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ed89e-6722-43f4-8123-1c9728ed8732 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:59.564962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ed89e-6722-43f4-8123-1c9728ed8732 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:59.565246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ed89e-6722-43f4-8123-1c9728ed8732 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:59.573121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ed89e-6722-43f4-8123-1c9728ed8732 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:59.576408 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ed89e-6722-43f4-8123-1c9728ed8732 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:59.585584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-233ed89e-6722-43f4-8123-1c9728ed8732 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:44:59.585584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:44:59.585584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:44:59.585584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:44:59.585584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:44:59.585584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:44:59.585584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:44:59.585584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:44:59.585584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:44:59.585584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:44:59.585584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:44:59.585584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:44:59.585584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:44:59.585584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:44:59.585584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:44:59.585584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:44:59.586678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:44:59.586678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:44:59.586678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:44:59.586678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:44:59.586678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:44:59.586678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:44:59.586678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:44:59.586678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:44:59.586678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:44:59.586678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:44:59.586678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:44:59.586678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:44:59.586678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:44:59.586678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:44:59.586678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:44:59.586678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:44:59.586678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:44:59.586678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:44:59.587950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:44:59.587950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:44:59.587950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:44:59.587950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:44:59.587950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:44:59.587950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:44:59.587950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:44:59.587950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:44:59.587950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:44:59.587950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:44:59.587950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 624/1253] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:44:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:44:59.592630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507588af-8335-4721-9ca0-5fe7c1069abf None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:59.647530 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:59.690652 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507588af-8335-4721-9ca0-5fe7c1069abf None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:59.724081 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5656b79-07c9-4912-a71b-68dcbd448542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:59.724745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5656b79-07c9-4912-a71b-68dcbd448542 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:59.725038 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5656b79-07c9-4912-a71b-68dcbd448542 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:59.725312 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5656b79-07c9-4912-a71b-68dcbd448542 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:59.726103 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5656b79-07c9-4912-a71b-68dcbd448542 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:44:59.726417 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5656b79-07c9-4912-a71b-68dcbd448542 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:59.727905 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5656b79-07c9-4912-a71b-68dcbd448542 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:59.744884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 630/1254] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 3 12:44:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:44:59.750819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ed89e-6722-43f4-8123-1c9728ed8732 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:59.849361 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ed89e-6722-43f4-8123-1c9728ed8732 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:59.882117 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4d538-3b48-4b1f-9057-ff8f0189fd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:59.882725 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4d538-3b48-4b1f-9057-ff8f0189fd28 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:59.883031 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4d538-3b48-4b1f-9057-ff8f0189fd28 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:59.883306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4d538-3b48-4b1f-9057-ff8f0189fd28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:59.936923 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:59.948658 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4d538-3b48-4b1f-9057-ff8f0189fd28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:59.950161 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4d538-3b48-4b1f-9057-ff8f0189fd28 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:00.047490 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 625/1255] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:44:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:45:00.053402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5656b79-07c9-4912-a71b-68dcbd448542 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:00.154218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5656b79-07c9-4912-a71b-68dcbd448542 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:00.169169 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:00.190257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0321a39-360a-49e8-8d57-6d20aa71a73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:00.190937 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0321a39-360a-49e8-8d57-6d20aa71a73a None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:00.191224 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0321a39-360a-49e8-8d57-6d20aa71a73a None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:00.191501 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0321a39-360a-49e8-8d57-6d20aa71a73a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:00.201591 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0321a39-360a-49e8-8d57-6d20aa71a73a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:00.203060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0321a39-360a-49e8-8d57-6d20aa71a73a None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:00.217848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-c0321a39-360a-49e8-8d57-6d20aa71a73a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:45:00.217848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:45:00.217848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:45:00.217848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:45:00.217848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:45:00.217848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:45:00.217848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:45:00.217848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:45:00.217848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:45:00.217848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:45:00.217848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:45:00.217848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:45:00.217848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:45:00.217848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:45:00.217848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:45:00.218944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:45:00.218944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:45:00.218944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:45:00.218944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:45:00.218944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:45:00.218944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:45:00.218944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:45:00.218944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:45:00.218944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:45:00.218944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:45:00.218944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:45:00.218944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:45:00.218944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:45:00.218944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:45:00.218944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:45:00.218944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:45:00.218944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:45:00.219969 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:45:00.219969 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:45:00.219969 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:45:00.219969 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:45:00.219969 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 631/1256] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:45:00.224827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4d538-3b48-4b1f-9057-ff8f0189fd28 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:00.316405 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:00.328131 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4d538-3b48-4b1f-9057-ff8f0189fd28 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:00.361463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc903a0-718f-4fa5-b7a5-ea15981dae2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:00.362094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc903a0-718f-4fa5-b7a5-ea15981dae2b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:00.362420 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc903a0-718f-4fa5-b7a5-ea15981dae2b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:00.362642 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc903a0-718f-4fa5-b7a5-ea15981dae2b None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:00.369706 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc903a0-718f-4fa5-b7a5-ea15981dae2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:45:00.369706 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc903a0-718f-4fa5-b7a5-ea15981dae2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:00.369706 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc903a0-718f-4fa5-b7a5-ea15981dae2b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:00.376157 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 626/1257] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:45:00.381896 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0321a39-360a-49e8-8d57-6d20aa71a73a None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:00.481090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0321a39-360a-49e8-8d57-6d20aa71a73a None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:00.513850 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae3228-7c63-4c83-aef6-5bc5833de4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:00.514491 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae3228-7c63-4c83-aef6-5bc5833de4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:00.514800 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae3228-7c63-4c83-aef6-5bc5833de4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:00.515082 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae3228-7c63-4c83-aef6-5bc5833de4c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:00.521546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae3228-7c63-4c83-aef6-5bc5833de4c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:00.523004 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae3228-7c63-4c83-aef6-5bc5833de4c3 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:00.534564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-41ae3228-7c63-4c83-aef6-5bc5833de4c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:45:00.534564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:45:00.534564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:45:00.534564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:45:00.534564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:45:00.534564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:45:00.534564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:45:00.534564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:45:00.534564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:45:00.534564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:45:00.534564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:45:00.534564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:45:00.534564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:45:00.534564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:45:00.534564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:45:00.535918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:45:00.535918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:45:00.535918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:45:00.535918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:45:00.535918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:45:00.535918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:45:00.535918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:45:00.535918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:45:00.535918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:45:00.535918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:45:00.535918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:45:00.535918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:45:00.535918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:45:00.535918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:45:00.535918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:45:00.535918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:45:00.535918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:45:00.537224 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:45:00.537224 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:45:00.537224 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:45:00.537224 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:45:00.537224 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:45:00.537224 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:45:00.537224 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:45:00.537224 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:45:00.537224 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 632/1258] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:45:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:45:00.542425 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc903a0-718f-4fa5-b7a5-ea15981dae2b None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:00.641130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc903a0-718f-4fa5-b7a5-ea15981dae2b None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:00.674317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5adcbf-426d-43de-b0e7-aec1d04256d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:00.674992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5adcbf-426d-43de-b0e7-aec1d04256d9 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:00.675272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5adcbf-426d-43de-b0e7-aec1d04256d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:00.675544 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5adcbf-426d-43de-b0e7-aec1d04256d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:00.676282 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5adcbf-426d-43de-b0e7-aec1d04256d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:45:00.676586 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5adcbf-426d-43de-b0e7-aec1d04256d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:00.678044 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5adcbf-426d-43de-b0e7-aec1d04256d9 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:00.689902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 627/1259] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:45:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:45:00.696294 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae3228-7c63-4c83-aef6-5bc5833de4c3 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:00.722704 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:00.795524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae3228-7c63-4c83-aef6-5bc5833de4c3 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:00.829527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2e05f-f2b4-46fa-a0d8-f1cf02fa3192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:00.830143 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2e05f-f2b4-46fa-a0d8-f1cf02fa3192 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:00.830429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2e05f-f2b4-46fa-a0d8-f1cf02fa3192 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:00.830709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2e05f-f2b4-46fa-a0d8-f1cf02fa3192 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:00.831529 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2e05f-f2b4-46fa-a0d8-f1cf02fa3192 None admin] RBAC: Adding query filter params (role.id=a6d209169b77456f9f1cc3ff53646cfc, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=de27d25fad634658a1abcb776d9a7b6e) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:45:00.840485 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2e05f-f2b4-46fa-a0d8-f1cf02fa3192 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:00.840485 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2e05f-f2b4-46fa-a0d8-f1cf02fa3192 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:00.840485 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 633/1260] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:45:00 2022] GET /identity/v3/role_assignments?user.id=de27d25fad634658a1abcb776d9a7b6e&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=a6d209169b77456f9f1cc3ff53646cfc => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:45:02.809285 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db0e34-a4b9-494c-a193-abfc9b138fa4 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:02.809870 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db0e34-a4b9-494c-a193-abfc9b138fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:02.809870 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db0e34-a4b9-494c-a193-abfc9b138fa4 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:02.811242 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 628/1261] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:02.816571 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dfd55-7b04-4fa2-ae21-01c9a0986730 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:02.817012 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dfd55-7b04-4fa2-ae21-01c9a0986730 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:02.817122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dfd55-7b04-4fa2-ae21-01c9a0986730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:02.835561 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-c90dfd55-7b04-4fa2-ae21-01c9a0986730 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:02.836756 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-c90dfd55-7b04-4fa2-ae21-01c9a0986730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:02.908374 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 634/1262] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:45:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:45:02.933289 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db0e34-a4b9-494c-a193-abfc9b138fa4 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:02.944254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:03.033604 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db0e34-a4b9-494c-a193-abfc9b138fa4 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:03.069032 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055dbf8-8928-46f0-8c1d-34c42a161f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:03.069594 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055dbf8-8928-46f0-8c1d-34c42a161f67 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:03.069883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055dbf8-8928-46f0-8c1d-34c42a161f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:03.070165 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055dbf8-8928-46f0-8c1d-34c42a161f67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:03.080201 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055dbf8-8928-46f0-8c1d-34c42a161f67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:45:03.085091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-a055dbf8-8928-46f0-8c1d-34c42a161f67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:45:03.085091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:45:03.085091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:45:03.085091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:45:03.085091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:45:03.085091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:45:03.085091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:45:03.085091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:45:03.085091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:45:03.085091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:45:03.085091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:45:03.085091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:45:03.085091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:45:03.085091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:45:03.085091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:45:03.085091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:45:03.086638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:45:03.086638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:45:03.086638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:45:03.086638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:45:03.086638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:45:03.086638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:45:03.086638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:45:03.086638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:45:03.086638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:45:03.086638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:45:03.086638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:45:03.086638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:45:03.086638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:45:03.086638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:45:03.086638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:45:03.086638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:45:03.087631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:45:03.087631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:45:03.087631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:45:03.087631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:45:03.087631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:45:03.087631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:45:03.087631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:45:03.087631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:45:03.087631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:45:03.087631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:45:03.087631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:45:03.087631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:45:03.087631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 629/1263] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:45:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:45:03.092270 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dfd55-7b04-4fa2-ae21-01c9a0986730 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:03.117556 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:03.197442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dfd55-7b04-4fa2-ae21-01c9a0986730 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:03.231718 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c94c87-4011-4e02-aade-6eb7c45d2d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:03.232338 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c94c87-4011-4e02-aade-6eb7c45d2d4b None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:03.232627 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c94c87-4011-4e02-aade-6eb7c45d2d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:03.232906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c94c87-4011-4e02-aade-6eb7c45d2d4b None admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:03.233666 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c94c87-4011-4e02-aade-6eb7c45d2d4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:45:03.233977 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c94c87-4011-4e02-aade-6eb7c45d2d4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:03.235505 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c94c87-4011-4e02-aade-6eb7c45d2d4b None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:03.244019 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 635/1264] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:45:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:45:03.249948 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055dbf8-8928-46f0-8c1d-34c42a161f67 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:03.317361 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:03.349506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055dbf8-8928-46f0-8c1d-34c42a161f67 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:03.381913 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b692705-c3dc-48c3-aea0-04a2137d7ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:03.382550 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b692705-c3dc-48c3-aea0-04a2137d7ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:03.382871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b692705-c3dc-48c3-aea0-04a2137d7ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:03.383153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b692705-c3dc-48c3-aea0-04a2137d7ec0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:03.393782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b692705-c3dc-48c3-aea0-04a2137d7ec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:03.395327 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b692705-c3dc-48c3-aea0-04a2137d7ec0 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:03.411733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-6b692705-c3dc-48c3-aea0-04a2137d7ec0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:45:03.411733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:45:03.411733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:45:03.411733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:45:03.411733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:45:03.411733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:45:03.411733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:45:03.411733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:45:03.411733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:45:03.411733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:45:03.411733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:45:03.411733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:45:03.411733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:45:03.411733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:45:03.411733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:45:03.412961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:45:03.412961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:45:03.412961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:45:03.412961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:45:03.412961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:45:03.412961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:45:03.412961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:45:03.412961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:45:03.412961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:45:03.412961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:45:03.412961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:45:03.412961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:45:03.412961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:45:03.412961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:45:03.412961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:45:03.412961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:45:03.412961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:45:03.414114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:45:03.414114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:45:03.414114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:45:03.414114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:45:03.414114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 630/1265] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:45:03.419481 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c94c87-4011-4e02-aade-6eb7c45d2d4b None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:03.499889 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:03.518238 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c94c87-4011-4e02-aade-6eb7c45d2d4b None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:03.552753 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35654625-9179-4e6a-9b39-dfe81f9f82af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:03.553366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35654625-9179-4e6a-9b39-dfe81f9f82af None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:03.553700 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35654625-9179-4e6a-9b39-dfe81f9f82af None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:03.554024 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35654625-9179-4e6a-9b39-dfe81f9f82af None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:03.554716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35654625-9179-4e6a-9b39-dfe81f9f82af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:45:03.555058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35654625-9179-4e6a-9b39-dfe81f9f82af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:03.556464 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35654625-9179-4e6a-9b39-dfe81f9f82af None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:03.567293 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 636/1266] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:45:03.572952 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b692705-c3dc-48c3-aea0-04a2137d7ec0 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:03.672239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b692705-c3dc-48c3-aea0-04a2137d7ec0 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:03.690951 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:03.705636 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84d785-dcb3-4ff6-a759-0893a1f44195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:03.706267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84d785-dcb3-4ff6-a759-0893a1f44195 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:03.706549 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84d785-dcb3-4ff6-a759-0893a1f44195 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:03.706852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84d785-dcb3-4ff6-a759-0893a1f44195 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:03.714654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84d785-dcb3-4ff6-a759-0893a1f44195 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:03.720089 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84d785-dcb3-4ff6-a759-0893a1f44195 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:03.726994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-ba84d785-dcb3-4ff6-a759-0893a1f44195 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:45:03.726994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:45:03.726994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:45:03.726994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:45:03.726994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:45:03.726994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:45:03.726994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:45:03.726994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:45:03.726994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:45:03.726994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:45:03.726994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:45:03.726994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:45:03.726994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:45:03.726994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:45:03.726994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:45:03.726994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:45:03.728120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:45:03.728120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:45:03.728120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:45:03.728120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:45:03.728120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:45:03.728120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:45:03.728120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:45:03.728120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:45:03.728120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:45:03.728120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:45:03.728120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:45:03.728120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:45:03.728120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:45:03.728120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:45:03.728120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:45:03.728120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:45:03.728120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:45:03.728120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:45:03.729310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:45:03.729310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:45:03.729310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:45:03.729310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:45:03.729310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:45:03.729310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:45:03.729310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:45:03.729310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:45:03.729310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:45:03.729310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:45:03.729310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 631/1267] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:45:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:45:03.734089 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35654625-9179-4e6a-9b39-dfe81f9f82af None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:03.831754 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35654625-9179-4e6a-9b39-dfe81f9f82af None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:03.864621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458da09-92b1-4637-9266-8f54603d9a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:03.865228 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458da09-92b1-4637-9266-8f54603d9a82 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:03.865513 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458da09-92b1-4637-9266-8f54603d9a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:03.865790 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458da09-92b1-4637-9266-8f54603d9a82 None admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:03.866623 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458da09-92b1-4637-9266-8f54603d9a82 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:45:03.866962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458da09-92b1-4637-9266-8f54603d9a82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:03.868423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458da09-92b1-4637-9266-8f54603d9a82 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:03.880830 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:03.890071 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 637/1268] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 3 12:45:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:45:03.896027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84d785-dcb3-4ff6-a759-0893a1f44195 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:03.995311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84d785-dcb3-4ff6-a759-0893a1f44195 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:04.030969 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55f7d1-e21e-4407-8237-3f7ed525ee6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:04.031609 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55f7d1-e21e-4407-8237-3f7ed525ee6a None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:04.031897 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55f7d1-e21e-4407-8237-3f7ed525ee6a None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:04.032174 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55f7d1-e21e-4407-8237-3f7ed525ee6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:04.042758 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55f7d1-e21e-4407-8237-3f7ed525ee6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:04.044202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55f7d1-e21e-4407-8237-3f7ed525ee6a None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:04.058782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-7e55f7d1-e21e-4407-8237-3f7ed525ee6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:45:04.058782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:45:04.058782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:45:04.058782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:45:04.058782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:45:04.058782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:45:04.058782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:45:04.058782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:45:04.058782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:45:04.058782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:45:04.058782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:45:04.058782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:45:04.058782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:45:04.058782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:45:04.058782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:45:04.059793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:45:04.059793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:45:04.059793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:45:04.059793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:45:04.059793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:45:04.059793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:45:04.059793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:45:04.059793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:45:04.059793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:45:04.059793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:45:04.059793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:45:04.059793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:45:04.059793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:45:04.059793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:45:04.059793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:45:04.059793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:45:04.059793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:45:04.060943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:45:04.060943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:45:04.060943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:45:04.060943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:45:04.060943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 632/1269] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:45:04.065674 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458da09-92b1-4637-9266-8f54603d9a82 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:04.165539 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458da09-92b1-4637-9266-8f54603d9a82 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:04.202982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ceefd-23bb-4f81-8e34-b311f8db6241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:04.203629 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ceefd-23bb-4f81-8e34-b311f8db6241 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:04.203914 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ceefd-23bb-4f81-8e34-b311f8db6241 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:04.204191 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ceefd-23bb-4f81-8e34-b311f8db6241 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:04.204982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ceefd-23bb-4f81-8e34-b311f8db6241 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:45:04.205292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ceefd-23bb-4f81-8e34-b311f8db6241 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:04.206653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ceefd-23bb-4f81-8e34-b311f8db6241 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:04.218032 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 638/1270] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:45:04.223888 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55f7d1-e21e-4407-8237-3f7ed525ee6a None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:04.255590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:04.325865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55f7d1-e21e-4407-8237-3f7ed525ee6a None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:04.358388 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec839de3-3b16-4504-a912-ff424a52b813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:04.359046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec839de3-3b16-4504-a912-ff424a52b813 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:04.359330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec839de3-3b16-4504-a912-ff424a52b813 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:04.359607 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec839de3-3b16-4504-a912-ff424a52b813 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:04.366054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec839de3-3b16-4504-a912-ff424a52b813 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:04.367506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec839de3-3b16-4504-a912-ff424a52b813 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:04.378962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-ec839de3-3b16-4504-a912-ff424a52b813 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:45:04.378962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:45:04.378962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:45:04.378962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:45:04.378962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:45:04.378962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:45:04.378962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:45:04.378962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:45:04.378962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:45:04.378962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:45:04.378962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:45:04.378962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:45:04.378962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:45:04.378962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:45:04.378962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:45:04.381899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:45:04.381899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:45:04.381899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:45:04.381899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:45:04.381899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:45:04.381899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:45:04.381899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:45:04.381899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:45:04.381899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:45:04.381899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:45:04.381899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:45:04.381899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:45:04.381899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:45:04.381899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:45:04.381899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:45:04.381899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:45:04.381899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:45:04.383064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:45:04.383064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:45:04.383064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:45:04.383064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:45:04.383064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:45:04.383064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:45:04.383064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:45:04.383064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:45:04.383064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 633/1271] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:45:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:45:04.386694 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ceefd-23bb-4f81-8e34-b311f8db6241 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:04.444719 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:04.485672 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ceefd-23bb-4f81-8e34-b311f8db6241 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:04.519632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00d007-0764-4fb5-8782-c4caebdefaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:04.520178 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00d007-0764-4fb5-8782-c4caebdefaaf None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:04.520464 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00d007-0764-4fb5-8782-c4caebdefaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:04.520743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00d007-0764-4fb5-8782-c4caebdefaaf None admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:04.521496 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00d007-0764-4fb5-8782-c4caebdefaaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:45:04.521809 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00d007-0764-4fb5-8782-c4caebdefaaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:04.523271 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00d007-0764-4fb5-8782-c4caebdefaaf None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:04.535257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 639/1272] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:45:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:45:04.542093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec839de3-3b16-4504-a912-ff424a52b813 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:04.633578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:04.641788 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec839de3-3b16-4504-a912-ff424a52b813 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:04.674322 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e587d-b033-4f5d-a73f-27a786e67d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:04.675007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e587d-b033-4f5d-a73f-27a786e67d78 None admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:04.675288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e587d-b033-4f5d-a73f-27a786e67d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:04.675567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e587d-b033-4f5d-a73f-27a786e67d78 None admin] PATH_INFO: `/v3/projects/020d395e82f0448f95789a896703ce98/users/de27d25fad634658a1abcb776d9a7b6e/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:04.677469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e587d-b033-4f5d-a73f-27a786e67d78 None admin] RBAC: Authorizing `identity:create_grant(project_id=020d395e82f0448f95789a896703ce98, user_id=de27d25fad634658a1abcb776d9a7b6e, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:04.678932 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e587d-b033-4f5d-a73f-27a786e67d78 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:04.801030 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 634/1273] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Aug 3 12:45:04 2022] PUT /identity/v3/projects/020d395e82f0448f95789a896703ce98/users/de27d25fad634658a1abcb776d9a7b6e/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:45:06.787449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66b1d5-cefc-4d2c-849c-182b32a7c240 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:06.788007 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66b1d5-cefc-4d2c-849c-182b32a7c240 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:06.788007 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66b1d5-cefc-4d2c-849c-182b32a7c240 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:06.789368 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 640/1274] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:06.794701 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cc0fd-7cb5-4dec-a5e0-785416ac4cfc None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:06.795159 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cc0fd-7cb5-4dec-a5e0-785416ac4cfc None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:06.795289 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cc0fd-7cb5-4dec-a5e0-785416ac4cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:06.813107 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-7a5cc0fd-7cb5-4dec-a5e0-785416ac4cfc None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:06.814301 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-7a5cc0fd-7cb5-4dec-a5e0-785416ac4cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:06.880357 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 635/1275] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:45:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:45:06.904004 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66b1d5-cefc-4d2c-849c-182b32a7c240 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:07.005642 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66b1d5-cefc-4d2c-849c-182b32a7c240 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:07.022776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:07.039520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8e008-dfc8-427c-a605-6811410445f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:07.040116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8e008-dfc8-427c-a605-6811410445f0 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:07.040396 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8e008-dfc8-427c-a605-6811410445f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:07.040668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8e008-dfc8-427c-a605-6811410445f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:07.050423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8e008-dfc8-427c-a605-6811410445f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:45:07.055388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-dae8e008-dfc8-427c-a605-6811410445f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:45:07.055388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:45:07.055388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:45:07.055388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:45:07.055388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:45:07.055388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:45:07.055388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:45:07.055388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:45:07.055388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:45:07.055388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:45:07.055388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:45:07.055388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:45:07.055388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:45:07.055388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:45:07.055388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:45:07.055388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:45:07.057029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:45:07.057029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:45:07.057029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:45:07.057029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:45:07.057029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:45:07.057029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:45:07.057029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:45:07.057029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:45:07.057029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:45:07.057029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:45:07.057029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:45:07.057029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:45:07.057029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:45:07.057029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:45:07.057029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:45:07.057029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:45:07.058112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:45:07.058112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:45:07.058112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:45:07.058112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:45:07.058112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:45:07.058112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:45:07.058112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:45:07.058112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:45:07.058112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:45:07.058112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:45:07.058112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:45:07.058112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:45:07.058112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 641/1276] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Aug 3 12:45:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:45:07.063153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cc0fd-7cb5-4dec-a5e0-785416ac4cfc None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:07.143313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:07.161132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cc0fd-7cb5-4dec-a5e0-785416ac4cfc None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:07.195271 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43779099-e6ab-45e4-9b78-39e8ba90567d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:07.195889 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43779099-e6ab-45e4-9b78-39e8ba90567d None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:07.196778 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43779099-e6ab-45e4-9b78-39e8ba90567d None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:07.197060 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43779099-e6ab-45e4-9b78-39e8ba90567d None admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:07.197782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43779099-e6ab-45e4-9b78-39e8ba90567d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:45:07.198097 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43779099-e6ab-45e4-9b78-39e8ba90567d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:07.199528 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43779099-e6ab-45e4-9b78-39e8ba90567d None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:07.207389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 636/1277] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Aug 3 12:45:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:45:07.213297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8e008-dfc8-427c-a605-6811410445f0 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:07.313433 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8e008-dfc8-427c-a605-6811410445f0 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:07.346716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08572750-179f-4eee-8149-259ddc298e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:07.347422 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08572750-179f-4eee-8149-259ddc298e19 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:07.347709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08572750-179f-4eee-8149-259ddc298e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:07.347987 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08572750-179f-4eee-8149-259ddc298e19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:07.357898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08572750-179f-4eee-8149-259ddc298e19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:07.359458 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08572750-179f-4eee-8149-259ddc298e19 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:07.374286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-08572750-179f-4eee-8149-259ddc298e19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:45:07.374286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:45:07.374286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:45:07.374286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:45:07.374286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:45:07.374286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:45:07.374286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:45:07.374286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:45:07.374286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:45:07.374286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:45:07.374286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:45:07.374286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:45:07.374286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:45:07.374286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:45:07.374286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:45:07.375354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:45:07.375354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:45:07.375354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:45:07.375354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:45:07.375354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:45:07.375354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:45:07.375354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:45:07.375354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:45:07.375354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:45:07.375354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:45:07.375354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:45:07.375354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:45:07.375354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:45:07.375354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:45:07.375354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:45:07.375354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:45:07.375354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:45:07.376292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:45:07.376292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:45:07.376292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:45:07.376292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:45:07.376292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 642/1278] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:45:07.381528 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43779099-e6ab-45e4-9b78-39e8ba90567d None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:07.488635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43779099-e6ab-45e4-9b78-39e8ba90567d None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:07.522554 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a70b5-cbe4-46f5-bb3d-5b7f37a2b6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:07.523207 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a70b5-cbe4-46f5-bb3d-5b7f37a2b6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:07.523494 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a70b5-cbe4-46f5-bb3d-5b7f37a2b6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:07.523774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a70b5-cbe4-46f5-bb3d-5b7f37a2b6d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:07.524564 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a70b5-cbe4-46f5-bb3d-5b7f37a2b6d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:45:07.524874 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a70b5-cbe4-46f5-bb3d-5b7f37a2b6d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:07.526239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a70b5-cbe4-46f5-bb3d-5b7f37a2b6d1 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:07.538087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 637/1279] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:45:07.544541 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08572750-179f-4eee-8149-259ddc298e19 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:07.575362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:07.642488 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08572750-179f-4eee-8149-259ddc298e19 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:07.675242 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90123faa-2ea2-4845-b8ae-9bff1a6db522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:07.675871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90123faa-2ea2-4845-b8ae-9bff1a6db522 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:07.676154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90123faa-2ea2-4845-b8ae-9bff1a6db522 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:07.676427 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90123faa-2ea2-4845-b8ae-9bff1a6db522 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:07.684501 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90123faa-2ea2-4845-b8ae-9bff1a6db522 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:07.688019 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90123faa-2ea2-4845-b8ae-9bff1a6db522 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:07.697297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-90123faa-2ea2-4845-b8ae-9bff1a6db522 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:45:07.697297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:45:07.697297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:45:07.697297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:45:07.697297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:45:07.697297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:45:07.697297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:45:07.697297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:45:07.697297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:45:07.697297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:45:07.697297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:45:07.697297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:45:07.697297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:45:07.697297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:45:07.697297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:45:07.697297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:45:07.698456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:45:07.698456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:45:07.698456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:45:07.698456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:45:07.698456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:45:07.698456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:45:07.698456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:45:07.698456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:45:07.698456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:45:07.698456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:45:07.698456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:45:07.698456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:45:07.698456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:45:07.698456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:45:07.698456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:45:07.698456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:45:07.698456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:45:07.698456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:45:07.699678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:45:07.699678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:45:07.699678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:45:07.699678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:45:07.699678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:45:07.699678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:45:07.699678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:45:07.699678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:45:07.699678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:45:07.699678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:45:07.699678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 643/1280] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:45:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:45:07.704436 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a70b5-cbe4-46f5-bb3d-5b7f37a2b6d1 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:07.708264 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:07.804786 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a70b5-cbe4-46f5-bb3d-5b7f37a2b6d1 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:07.838512 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c646237-e771-4ad9-994d-42b30f7f8013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:07.839092 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c646237-e771-4ad9-994d-42b30f7f8013 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:07.839381 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c646237-e771-4ad9-994d-42b30f7f8013 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:07.839663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c646237-e771-4ad9-994d-42b30f7f8013 None admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:07.840455 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c646237-e771-4ad9-994d-42b30f7f8013 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:45:07.840768 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c646237-e771-4ad9-994d-42b30f7f8013 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:07.842200 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c646237-e771-4ad9-994d-42b30f7f8013 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:07.859738 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 638/1281] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Aug 3 12:45:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:45:07.865778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90123faa-2ea2-4845-b8ae-9bff1a6db522 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:07.962550 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:07.972139 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90123faa-2ea2-4845-b8ae-9bff1a6db522 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:08.008629 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0326dc-6df5-420e-bf82-4028fdbee73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:08.009252 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0326dc-6df5-420e-bf82-4028fdbee73e None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:08.009563 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0326dc-6df5-420e-bf82-4028fdbee73e None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:08.009854 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0326dc-6df5-420e-bf82-4028fdbee73e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:08.077168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0326dc-6df5-420e-bf82-4028fdbee73e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:08.078632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0326dc-6df5-420e-bf82-4028fdbee73e None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:08.169344 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:08.179764 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 644/1282] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Aug 3 12:45:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:45:08.185649 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c646237-e771-4ad9-994d-42b30f7f8013 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:08.249765 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:08.292368 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c646237-e771-4ad9-994d-42b30f7f8013 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:08.331022 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cd2af-09f8-492b-87b7-7fa6abc1e8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:08.331693 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cd2af-09f8-492b-87b7-7fa6abc1e8ab None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:08.331987 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cd2af-09f8-492b-87b7-7fa6abc1e8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:08.332297 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cd2af-09f8-492b-87b7-7fa6abc1e8ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:08.346374 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1cd2af-09f8-492b-87b7-7fa6abc1e8ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:08.347935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1cd2af-09f8-492b-87b7-7fa6abc1e8ab None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:08.363502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-fa1cd2af-09f8-492b-87b7-7fa6abc1e8ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:45:08.363502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:45:08.363502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:45:08.363502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:45:08.363502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:45:08.363502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:45:08.363502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:45:08.363502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:45:08.363502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:45:08.363502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:45:08.363502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:45:08.363502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:45:08.363502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:45:08.363502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:45:08.363502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:45:08.364561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:45:08.364561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:45:08.364561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:45:08.364561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:45:08.364561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:45:08.364561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:45:08.364561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:45:08.364561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:45:08.364561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:45:08.364561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:45:08.364561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:45:08.364561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:45:08.364561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:45:08.364561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:45:08.364561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:45:08.364561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:45:08.364561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:45:08.365631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:45:08.365631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:45:08.365631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:45:08.365631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:45:08.365631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 639/1283] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:45:08.370677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0326dc-6df5-420e-bf82-4028fdbee73e None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:08.475718 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0326dc-6df5-420e-bf82-4028fdbee73e None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:08.516701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a982d35-bd8b-4c3a-a1c4-3df6621f1e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:08.517339 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a982d35-bd8b-4c3a-a1c4-3df6621f1e96 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:08.517624 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a982d35-bd8b-4c3a-a1c4-3df6621f1e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:08.517904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a982d35-bd8b-4c3a-a1c4-3df6621f1e96 None admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:08.518699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a982d35-bd8b-4c3a-a1c4-3df6621f1e96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:45:08.519249 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a982d35-bd8b-4c3a-a1c4-3df6621f1e96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:08.520640 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a982d35-bd8b-4c3a-a1c4-3df6621f1e96 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:08.539242 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 645/1284] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Aug 3 12:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:45:08.540500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cd2af-09f8-492b-87b7-7fa6abc1e8ab None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:08.647708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cd2af-09f8-492b-87b7-7fa6abc1e8ab None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:08.663542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:08.684118 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6a326-ba7b-4073-8263-c63052a0c009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:08.684685 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6a326-ba7b-4073-8263-c63052a0c009 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:08.684972 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6a326-ba7b-4073-8263-c63052a0c009 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:08.685253 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6a326-ba7b-4073-8263-c63052a0c009 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:08.691936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6a326-ba7b-4073-8263-c63052a0c009 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:08.693394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6a326-ba7b-4073-8263-c63052a0c009 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:08.705735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application [None req-a6c6a326-ba7b-4073-8263-c63052a0c009 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:45:08.705735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:45:08.705735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:45:08.705735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:45:08.705735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:45:08.705735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:45:08.705735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:45:08.705735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:45:08.705735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:45:08.705735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:45:08.705735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:45:08.705735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:45:08.705735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:45:08.705735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:45:08.705735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:45:08.706947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:45:08.706947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:45:08.706947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:45:08.706947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:45:08.706947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:45:08.706947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:45:08.706947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:45:08.706947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:45:08.706947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application with Lock( Aug 03 12:45:08.706947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:45:08.706947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:45:08.706947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:45:08.706947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:45:08.706947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:45:08.706947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:45:08.706947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:45:08.706947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:45:08.707950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:45:08.707950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:45:08.707950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:45:08.707950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:45:08.707950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:45:08.707950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:45:08.707950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:45:08.707950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: ERROR keystone.server.flask.application Aug 03 12:45:08.707950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 640/1285] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Aug 3 12:45:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:45:08.714548 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a982d35-bd8b-4c3a-a1c4-3df6621f1e96 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:08.769163 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:08.817506 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a982d35-bd8b-4c3a-a1c4-3df6621f1e96 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:08.851108 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e5669-497a-4d92-a13d-31ebf4720a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:08.851724 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e5669-497a-4d92-a13d-31ebf4720a50 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:08.852007 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e5669-497a-4d92-a13d-31ebf4720a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:08.852312 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e5669-497a-4d92-a13d-31ebf4720a50 None admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:08.853063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e5669-497a-4d92-a13d-31ebf4720a50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:45:08.853375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e5669-497a-4d92-a13d-31ebf4720a50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:08.854881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e5669-497a-4d92-a13d-31ebf4720a50 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:08.866763 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 646/1286] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Aug 3 12:45:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:45:08.873502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6a326-ba7b-4073-8263-c63052a0c009 None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:08.972416 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6a326-ba7b-4073-8263-c63052a0c009 None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:09.007071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e0815-f920-4bbc-9672-c7676538a36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:09.007686 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e0815-f920-4bbc-9672-c7676538a36b None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:09.007971 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e0815-f920-4bbc-9672-c7676538a36b None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:09.008251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e0815-f920-4bbc-9672-c7676538a36b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:09.009100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e0815-f920-4bbc-9672-c7676538a36b None admin] RBAC: Adding query filter params (role.id=a6d209169b77456f9f1cc3ff53646cfc, scope.project.id=020d395e82f0448f95789a896703ce98, user.id=de27d25fad634658a1abcb776d9a7b6e) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:45:09.009414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e0815-f920-4bbc-9672-c7676538a36b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:09.010913 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e0815-f920-4bbc-9672-c7676538a36b None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:09.016561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 641/1287] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Aug 3 12:45:08 2022] GET /identity/v3/role_assignments?user.id=de27d25fad634658a1abcb776d9a7b6e&scope.project.id=020d395e82f0448f95789a896703ce98&role.id=a6d209169b77456f9f1cc3ff53646cfc => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:45:11.040318 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34966c4b-8e10-4153-a140-dd15965100fd None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:11.040881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34966c4b-8e10-4153-a140-dd15965100fd None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:11.040881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34966c4b-8e10-4153-a140-dd15965100fd None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:11.042229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 647/1288] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:11.047451 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1ee22-80c2-448e-94aa-3da1119b1642 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:11.047849 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1ee22-80c2-448e-94aa-3da1119b1642 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:11.048009 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1ee22-80c2-448e-94aa-3da1119b1642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:11.066293 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-b6f1ee22-80c2-448e-94aa-3da1119b1642 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:11.068023 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b6f1ee22-80c2-448e-94aa-3da1119b1642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:11.096777 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:11.132916 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 642/1289] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:45:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:45:11.155605 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34966c4b-8e10-4153-a140-dd15965100fd None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:11.254657 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34966c4b-8e10-4153-a140-dd15965100fd None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:11.265164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:11.289151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b09894-22aa-40f5-8a87-1d47aeb7b5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:11.290394 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b09894-22aa-40f5-8a87-1d47aeb7b5cd None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:11.290628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b09894-22aa-40f5-8a87-1d47aeb7b5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:11.290963 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b09894-22aa-40f5-8a87-1d47aeb7b5cd None admin] PATH_INFO: `/v3/services/placement` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:11.291576 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b09894-22aa-40f5-8a87-1d47aeb7b5cd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:11.292948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b09894-22aa-40f5-8a87-1d47aeb7b5cd None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:11.302051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-d7b09894-22aa-40f5-8a87-1d47aeb7b5cd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:45:11.302051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:45:11.302051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:45:11.302051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:45:11.302051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:45:11.302051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:45:11.302051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:45:11.302051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:45:11.302051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:45:11.302051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:45:11.302051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:45:11.302051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:45:11.302051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:45:11.302051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:45:11.302051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:45:11.302051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:45:11.302051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:45:11.303148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:45:11.303148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:45:11.303148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:45:11.303148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:45:11.303148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:45:11.303148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:45:11.303148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:45:11.303148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:45:11.303148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:45:11.303148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:45:11.303148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:45:11.303148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:45:11.303148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:45:11.303148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:45:11.303148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:45:11.303148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:45:11.304076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:45:11.304076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:45:11.304076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:45:11.304076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:45:11.304076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:45:11.304076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:45:11.304076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:45:11.304076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:45:11.304076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:45:11.304076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:45:11.304076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:45:11.304076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:45:11.304076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:45:11.304076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:45:11.304076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 648/1290] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 3 12:45:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:45:11.310001 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1ee22-80c2-448e-94aa-3da1119b1642 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:11.408544 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1ee22-80c2-448e-94aa-3da1119b1642 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:11.441819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebc952-0926-4b6c-a439-f28d112efcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:11.442420 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebc952-0926-4b6c-a439-f28d112efcc1 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:11.442701 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebc952-0926-4b6c-a439-f28d112efcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:11.443006 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebc952-0926-4b6c-a439-f28d112efcc1 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:11.443676 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebc952-0926-4b6c-a439-f28d112efcc1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:45:11.443980 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebc952-0926-4b6c-a439-f28d112efcc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:11.445407 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebc952-0926-4b6c-a439-f28d112efcc1 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:11.450161 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 643/1291] 10.222.0.64 () {56 vars in 1116 bytes} [Wed Aug 3 12:45:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:45:11.456046 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b09894-22aa-40f5-8a87-1d47aeb7b5cd None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:11.555040 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b09894-22aa-40f5-8a87-1d47aeb7b5cd None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:11.588184 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef914e60-42a2-4616-a8fb-ebd57a2b5b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:11.588803 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef914e60-42a2-4616-a8fb-ebd57a2b5b18 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:11.589091 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef914e60-42a2-4616-a8fb-ebd57a2b5b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:11.589369 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef914e60-42a2-4616-a8fb-ebd57a2b5b18 None admin] PATH_INFO: `/v3/services` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:11.590057 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef914e60-42a2-4616-a8fb-ebd57a2b5b18 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:45:11.590367 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef914e60-42a2-4616-a8fb-ebd57a2b5b18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:11.591763 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef914e60-42a2-4616-a8fb-ebd57a2b5b18 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:11.596214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 649/1292] 10.222.0.64 () {56 vars in 1116 bytes} [Wed Aug 3 12:45:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:45:13.610499 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff422e05-bef8-4a64-a637-5708dd785fc1 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:13.611094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff422e05-bef8-4a64-a637-5708dd785fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:13.611094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff422e05-bef8-4a64-a637-5708dd785fc1 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:13.612424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 644/1293] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:13.617632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b15215-6445-40a3-a7e5-5ebaaf4f7fad None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:13.619481 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b15215-6445-40a3-a7e5-5ebaaf4f7fad None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:13.619481 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b15215-6445-40a3-a7e5-5ebaaf4f7fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:13.638672 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-b3b15215-6445-40a3-a7e5-5ebaaf4f7fad None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:13.642589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b3b15215-6445-40a3-a7e5-5ebaaf4f7fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:13.677680 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:13.743331 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 650/1294] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:45:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:45:13.766018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff422e05-bef8-4a64-a637-5708dd785fc1 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:13.799268 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:13.868816 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff422e05-bef8-4a64-a637-5708dd785fc1 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:13.906341 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192549be-f9da-4fdb-aec4-37018db03d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:13.906978 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192549be-f9da-4fdb-aec4-37018db03d29 None admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:13.907260 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192549be-f9da-4fdb-aec4-37018db03d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:13.907536 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192549be-f9da-4fdb-aec4-37018db03d29 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:13.908223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192549be-f9da-4fdb-aec4-37018db03d29 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:13.909605 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192549be-f9da-4fdb-aec4-37018db03d29 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:13.989358 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 645/1295] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Aug 3 12:45:13 2022] POST /identity/v3/services => generated 246 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:45:16.024398 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5e03c-08fd-41ab-a80e-f6356b62df55 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:16.024929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5e03c-08fd-41ab-a80e-f6356b62df55 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:16.025020 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5e03c-08fd-41ab-a80e-f6356b62df55 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:16.026298 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 651/1296] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:16.031351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517d15d-ea42-4d11-9827-afa037710606 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:16.031796 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517d15d-ea42-4d11-9827-afa037710606 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:16.031927 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517d15d-ea42-4d11-9827-afa037710606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:16.050683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-d517d15d-ea42-4d11-9827-afa037710606 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:16.051898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-d517d15d-ea42-4d11-9827-afa037710606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:16.123458 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 646/1297] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:45:16 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:45:16.145520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5e03c-08fd-41ab-a80e-f6356b62df55 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:16.249485 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5e03c-08fd-41ab-a80e-f6356b62df55 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:16.282982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8caaddd-106a-47d8-a2f9-bf021ba8bd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:16.283668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8caaddd-106a-47d8-a2f9-bf021ba8bd32 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:16.283957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8caaddd-106a-47d8-a2f9-bf021ba8bd32 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:16.284233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8caaddd-106a-47d8-a2f9-bf021ba8bd32 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:16.285131 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8caaddd-106a-47d8-a2f9-bf021ba8bd32 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:16.286676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8caaddd-106a-47d8-a2f9-bf021ba8bd32 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:16.296432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-b8caaddd-106a-47d8-a2f9-bf021ba8bd32 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:45:16.296432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:45:16.296432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:45:16.296432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:45:16.296432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:45:16.296432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:45:16.296432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:45:16.296432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:45:16.296432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:45:16.296432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:45:16.296432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:45:16.296432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:45:16.296432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:45:16.296432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:45:16.296432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:45:16.296432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:45:16.296432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:45:16.297475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:45:16.297475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:45:16.297475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:45:16.297475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:45:16.297475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:45:16.297475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:45:16.297475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:45:16.297475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:45:16.297475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:45:16.297475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:45:16.297475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:45:16.297475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:45:16.297475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:45:16.297475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:45:16.297475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:45:16.297475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:45:16.298323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:45:16.298323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:45:16.298323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:45:16.298323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:45:16.298323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:45:16.298323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:45:16.298323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:45:16.298323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:45:16.298323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:45:16.298323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:45:16.298323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:45:16.298323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:45:16.298323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:45:16.298323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:45:16.298323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 652/1298] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 3 12:45:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:45:16.303782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517d15d-ea42-4d11-9827-afa037710606 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:16.321716 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:16.401235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517d15d-ea42-4d11-9827-afa037710606 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:16.435244 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9db8b-53e5-4256-8527-6e27e15dd25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:16.435856 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9db8b-53e5-4256-8527-6e27e15dd25f None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:16.436137 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9db8b-53e5-4256-8527-6e27e15dd25f None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:16.436410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9db8b-53e5-4256-8527-6e27e15dd25f None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:16.437088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9db8b-53e5-4256-8527-6e27e15dd25f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:45:16.437393 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9db8b-53e5-4256-8527-6e27e15dd25f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:16.438877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9db8b-53e5-4256-8527-6e27e15dd25f None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:16.443926 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 647/1299] 10.222.0.64 () {56 vars in 1116 bytes} [Wed Aug 3 12:45:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:45:16.450529 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8caaddd-106a-47d8-a2f9-bf021ba8bd32 None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:16.482113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:16.549351 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8caaddd-106a-47d8-a2f9-bf021ba8bd32 None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:16.583615 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcece2-761a-4146-aa36-3ab0ce3521d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:16.584298 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcece2-761a-4146-aa36-3ab0ce3521d5 None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:16.584531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcece2-761a-4146-aa36-3ab0ce3521d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:16.584828 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcece2-761a-4146-aa36-3ab0ce3521d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:16.585573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcece2-761a-4146-aa36-3ab0ce3521d5 None admin] RBAC: Adding query filter params (interface=public, service_id=b0ca1c3b77eb4bc1bf2f80d093c6bf2b, region_id=RegionOne) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:45:16.585881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcece2-761a-4146-aa36-3ab0ce3521d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:16.587897 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcece2-761a-4146-aa36-3ab0ce3521d5 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:16.592931 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 653/1300] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Aug 3 12:45:16 2022] GET /identity/v3/endpoints?service_id=b0ca1c3b77eb4bc1bf2f80d093c6bf2b&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:45:16.598690 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9db8b-53e5-4256-8527-6e27e15dd25f None admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:16.702073 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:16.720084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9db8b-53e5-4256-8527-6e27e15dd25f None admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:16.752260 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092f14b-bd83-4e07-b362-2c6897591b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:16.752894 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092f14b-bd83-4e07-b362-2c6897591b84 None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:16.753175 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092f14b-bd83-4e07-b362-2c6897591b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:16.753448 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092f14b-bd83-4e07-b362-2c6897591b84 None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:16.754093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092f14b-bd83-4e07-b362-2c6897591b84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:16.755476 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092f14b-bd83-4e07-b362-2c6897591b84 None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:16.762684 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 648/1301] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Aug 3 12:45:16 2022] GET /identity/v3/services => generated 2191 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:45:18.741717 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3d5ff-9d5f-412c-a87d-c5ae7905633b None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:18.742280 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3d5ff-9d5f-412c-a87d-c5ae7905633b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:18.742925 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3d5ff-9d5f-412c-a87d-c5ae7905633b None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:18.744238 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 654/1302] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:45:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:18.749591 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3ba11-e863-4af7-976a-df069856d840 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:18.749996 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3ba11-e863-4af7-976a-df069856d840 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:18.750157 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3ba11-e863-4af7-976a-df069856d840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:18.768092 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-32b3ba11-e863-4af7-976a-df069856d840 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:18.769335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-32b3ba11-e863-4af7-976a-df069856d840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:18.835432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 649/1303] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:45:18 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:45:18.858039 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3d5ff-9d5f-412c-a87d-c5ae7905633b None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:18.952417 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:18.959168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3d5ff-9d5f-412c-a87d-c5ae7905633b None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:18.993458 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629acfac-657b-4242-8daf-c30596ba0d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:18.994028 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629acfac-657b-4242-8daf-c30596ba0d0c None admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:18.994311 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629acfac-657b-4242-8daf-c30596ba0d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:18.994586 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629acfac-657b-4242-8daf-c30596ba0d0c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:18.995244 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629acfac-657b-4242-8daf-c30596ba0d0c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:18.996597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629acfac-657b-4242-8daf-c30596ba0d0c None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:19.005295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application [None req-629acfac-657b-4242-8daf-c30596ba0d0c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:45:19.005295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:45:19.005295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:45:19.005295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:45:19.005295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:45:19.005295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:45:19.005295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:45:19.005295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:45:19.005295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:45:19.005295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:45:19.005295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:45:19.005295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:45:19.005295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:45:19.005295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:45:19.005295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:45:19.005295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:45:19.005295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:45:19.013565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:45:19.013565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:45:19.013565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:45:19.013565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:45:19.013565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:45:19.013565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:45:19.013565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:45:19.013565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:45:19.013565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:45:19.013565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:45:19.013565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:45:19.013565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:45:19.013565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:45:19.013565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:45:19.013565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:45:19.013565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:45:19.014579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:45:19.014579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application with Lock( Aug 03 12:45:19.014579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:45:19.014579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:45:19.014579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:45:19.014579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:45:19.014579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:45:19.014579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:45:19.014579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:45:19.014579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:45:19.014579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:45:19.014579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:45:19.014579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:45:19.014579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: ERROR keystone.server.flask.application Aug 03 12:45:19.014579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 655/1304] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Aug 3 12:45:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:45:19.015671 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3ba11-e863-4af7-976a-df069856d840 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:19.088872 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:19.111238 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3ba11-e863-4af7-976a-df069856d840 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:19.146571 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f42f1-004e-4066-8f65-9f14ce7cf1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:19.147218 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f42f1-004e-4066-8f65-9f14ce7cf1fb None admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:19.147505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f42f1-004e-4066-8f65-9f14ce7cf1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:19.147784 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f42f1-004e-4066-8f65-9f14ce7cf1fb None admin] PATH_INFO: `/v3/services` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:19.148977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f42f1-004e-4066-8f65-9f14ce7cf1fb None admin] RBAC: Adding query filter params (name=placement) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:45:19.149294 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f42f1-004e-4066-8f65-9f14ce7cf1fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:19.150695 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f42f1-004e-4066-8f65-9f14ce7cf1fb None admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:19.155961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 650/1305] 10.222.0.64 () {56 vars in 1116 bytes} [Wed Aug 3 12:45:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:45:19.161993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629acfac-657b-4242-8daf-c30596ba0d0c None admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:19.261500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629acfac-657b-4242-8daf-c30596ba0d0c None admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:19.295612 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed5c38-c080-4e6b-a4d1-b1918f72bab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:19.296290 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed5c38-c080-4e6b-a4d1-b1918f72bab6 None admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:19.296574 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed5c38-c080-4e6b-a4d1-b1918f72bab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:19.296854 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed5c38-c080-4e6b-a4d1-b1918f72bab6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:19.297559 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed5c38-c080-4e6b-a4d1-b1918f72bab6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:19.298944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed5c38-c080-4e6b-a4d1-b1918f72bab6 None admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:19.389121 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 656/1306] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:45:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:45:29.152852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=30 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:29.384356 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:48.604671 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42161325-5143-4c57-9dad-4b5b9e7fc73e None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:48.605624 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42161325-5143-4c57-9dad-4b5b9e7fc73e None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:48.606674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42161325-5143-4c57-9dad-4b5b9e7fc73e None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:48.613653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a16bf-846c-4290-9c40-93f558ecdaea None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:48.614470 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a16bf-846c-4290-9c40-93f558ecdaea None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:48.615551 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a16bf-846c-4290-9c40-93f558ecdaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:48.620850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 651/1307] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:50:48 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:48.791870 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-215a16bf-846c-4290-9c40-93f558ecdaea None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:48.793536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-215a16bf-846c-4290-9c40-93f558ecdaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:48.962769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 657/1308] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:50:49.016554 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d137a6f-a177-4411-a7c0-a783c08b1898 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:49.017082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d137a6f-a177-4411-a7c0-a783c08b1898 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:49.023058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d137a6f-a177-4411-a7c0-a783c08b1898 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:49.023058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 652/1309] 10.222.0.64 () {54 vars in 965 bytes} [Wed Aug 3 12:50:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:49.024960 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540ac59-88e0-435d-a485-d1cb838b9586 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:49.025258 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540ac59-88e0-435d-a485-d1cb838b9586 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:49.025535 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540ac59-88e0-435d-a485-d1cb838b9586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:49.105921 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-6540ac59-88e0-435d-a485-d1cb838b9586 None None] MFA Rules not processed for user `05c4c07ff52c43ebb5056484eac94afa`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:49.116413 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-6540ac59-88e0-435d-a485-d1cb838b9586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:49.148318 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:49.202835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 658/1310] 10.222.0.64 () {58 vars in 1062 bytes} [Wed Aug 3 12:50:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:50:49.211681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d137a6f-a177-4411-a7c0-a783c08b1898 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:49.213399 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-4d137a6f-a177-4411-a7c0-a783c08b1898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:49.321047 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d137a6f-a177-4411-a7c0-a783c08b1898 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:49.400618 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e81b71-98ec-4d69-af2e-4b672ccbb6a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:49.401167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e81b71-98ec-4d69-af2e-4b672ccbb6a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:49.401455 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e81b71-98ec-4d69-af2e-4b672ccbb6a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:49.401736 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e81b71-98ec-4d69-af2e-4b672ccbb6a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:49.403521 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b4e81b71-98ec-4d69-af2e-4b672ccbb6a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:49.463103 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:49.525313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e81b71-98ec-4d69-af2e-4b672ccbb6a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:49.527007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e81b71-98ec-4d69-af2e-4b672ccbb6a5 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:49.550472 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 653/1311] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:50:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:50:51.901598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c27ea-ade7-4d6d-8681-13e5f659c807 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:51.902193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c27ea-ade7-4d6d-8681-13e5f659c807 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:51.902193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c27ea-ade7-4d6d-8681-13e5f659c807 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:51.904191 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 659/1312] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:51.909853 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b0ad5-3e6c-4cdf-9d92-6fd067b1ccff None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:51.910350 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b0ad5-3e6c-4cdf-9d92-6fd067b1ccff None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:51.910550 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b0ad5-3e6c-4cdf-9d92-6fd067b1ccff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:51.987819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-813b0ad5-3e6c-4cdf-9d92-6fd067b1ccff None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:51.989023 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-813b0ad5-3e6c-4cdf-9d92-6fd067b1ccff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:52.083058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 654/1313] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:50:52.135187 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf2611-d55f-407b-bee2-f30a06288e1e None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:52.135572 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf2611-d55f-407b-bee2-f30a06288e1e None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:52.135918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf2611-d55f-407b-bee2-f30a06288e1e None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:52.137954 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 660/1314] 10.222.0.64 () {54 vars in 965 bytes} [Wed Aug 3 12:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:52.144736 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740c369-eae8-495b-940d-5eefbdcc6c79 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:52.145035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740c369-eae8-495b-940d-5eefbdcc6c79 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:52.145317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740c369-eae8-495b-940d-5eefbdcc6c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:52.159681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:52.224672 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-e740c369-eae8-495b-940d-5eefbdcc6c79 None None] MFA Rules not processed for user `05c4c07ff52c43ebb5056484eac94afa`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:52.225880 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e740c369-eae8-495b-940d-5eefbdcc6c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:52.306398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 655/1315] 10.222.0.64 () {58 vars in 1062 bytes} [Wed Aug 3 12:50:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:50:52.315626 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf2611-d55f-407b-bee2-f30a06288e1e None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:52.317173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-29cf2611-d55f-407b-bee2-f30a06288e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:52.420451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf2611-d55f-407b-bee2-f30a06288e1e None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:52.489726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:52.492306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5f91a-0ca3-40a4-b20b-f05d99fbb692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:52.492919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5f91a-0ca3-40a4-b20b-f05d99fbb692 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:52.493203 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5f91a-0ca3-40a4-b20b-f05d99fbb692 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:52.493481 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5f91a-0ca3-40a4-b20b-f05d99fbb692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:52.495141 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-aed5f91a-0ca3-40a4-b20b-f05d99fbb692 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:52.602692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5f91a-0ca3-40a4-b20b-f05d99fbb692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:52.604149 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5f91a-0ca3-40a4-b20b-f05d99fbb692 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:52.622053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 661/1316] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:50:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:50:55.386238 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a508d-0597-4bdc-98b4-cac974b21641 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:55.386858 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a508d-0597-4bdc-98b4-cac974b21641 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:55.386858 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a508d-0597-4bdc-98b4-cac974b21641 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:55.388700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 656/1317] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:55.393683 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfc329-7176-43ab-9d85-6670587f2f2b None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:55.394083 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfc329-7176-43ab-9d85-6670587f2f2b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:55.394235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfc329-7176-43ab-9d85-6670587f2f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:55.459845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-6ccfc329-7176-43ab-9d85-6670587f2f2b None None] MFA Rules not processed for user `c428456e9e294402b87552a9b190d23b`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:55.461069 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-6ccfc329-7176-43ab-9d85-6670587f2f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:55.511717 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:55.554570 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 662/1318] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:55 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:50:55.594490 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a508d-0597-4bdc-98b4-cac974b21641 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:55.596146 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-6f3a508d-0597-4bdc-98b4-cac974b21641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:55.698385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a508d-0597-4bdc-98b4-cac974b21641 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:55.701752 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:55.770430 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf47b6-bc31-4295-96d5-500b9fa1d230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:55.771069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf47b6-bc31-4295-96d5-500b9fa1d230 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:55.771355 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf47b6-bc31-4295-96d5-500b9fa1d230 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:55.771634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf47b6-bc31-4295-96d5-500b9fa1d230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:55.773256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-40cf47b6-bc31-4295-96d5-500b9fa1d230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:55.882040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf47b6-bc31-4295-96d5-500b9fa1d230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:55.883516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf47b6-bc31-4295-96d5-500b9fa1d230 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:55.902361 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 657/1319] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:50:55 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:50:58.701596 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431c37b-a221-4e16-8184-ca69d095f863 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:58.702134 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431c37b-a221-4e16-8184-ca69d095f863 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:58.702134 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431c37b-a221-4e16-8184-ca69d095f863 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:58.703516 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 663/1320] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:58.708531 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590129eb-943f-48e9-830b-0156cfd0bf29 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:58.708919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590129eb-943f-48e9-830b-0156cfd0bf29 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:58.709090 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590129eb-943f-48e9-830b-0156cfd0bf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:58.749941 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:58.774183 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-590129eb-943f-48e9-830b-0156cfd0bf29 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:58.775470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-590129eb-943f-48e9-830b-0156cfd0bf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:58.872584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 658/1321] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:50:58.910915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431c37b-a221-4e16-8184-ca69d095f863 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:58.912708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-f431c37b-a221-4e16-8184-ca69d095f863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:59.013809 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431c37b-a221-4e16-8184-ca69d095f863 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:59.085179 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4b33d-4b28-415b-934b-28e1402562d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:59.085791 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4b33d-4b28-415b-934b-28e1402562d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:59.086077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4b33d-4b28-415b-934b-28e1402562d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:59.086350 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4b33d-4b28-415b-934b-28e1402562d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:59.088009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-24c4b33d-4b28-415b-934b-28e1402562d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:59.095860 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:59.196227 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4b33d-4b28-415b-934b-28e1402562d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:59.197645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4b33d-4b28-415b-934b-28e1402562d3 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:59.216010 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 664/1322] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:50:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:02.155449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2e15a-57db-4e41-89e6-38ae3893ae98 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:02.155994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2e15a-57db-4e41-89e6-38ae3893ae98 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:02.155994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2e15a-57db-4e41-89e6-38ae3893ae98 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:02.157371 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 659/1323] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:02.162779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3a711-ce15-4fd5-91f8-b58d266b5d15 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:02.163194 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3a711-ce15-4fd5-91f8-b58d266b5d15 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:02.163348 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3a711-ce15-4fd5-91f8-b58d266b5d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:02.228339 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-f7e3a711-ce15-4fd5-91f8-b58d266b5d15 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:02.229565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-f7e3a711-ce15-4fd5-91f8-b58d266b5d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:02.290318 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:02.329235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 665/1324] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:02.365382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2e15a-57db-4e41-89e6-38ae3893ae98 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:02.367068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-bec2e15a-57db-4e41-89e6-38ae3893ae98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:02.479555 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2e15a-57db-4e41-89e6-38ae3893ae98 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:02.492563 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:02.557983 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d498b-1d3e-4eed-8c21-e99fb9dbc626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:02.558723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d498b-1d3e-4eed-8c21-e99fb9dbc626 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:02.559030 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d498b-1d3e-4eed-8c21-e99fb9dbc626 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:02.559307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d498b-1d3e-4eed-8c21-e99fb9dbc626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:02.560984 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-2e5d498b-1d3e-4eed-8c21-e99fb9dbc626 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:02.668644 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d498b-1d3e-4eed-8c21-e99fb9dbc626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:02.670086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d498b-1d3e-4eed-8c21-e99fb9dbc626 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:02.688264 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 660/1325] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:04.768775 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844eabf-5bf6-4e87-b9ee-5bbed6fcafc5 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:04.769308 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844eabf-5bf6-4e87-b9ee-5bbed6fcafc5 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:04.769424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844eabf-5bf6-4e87-b9ee-5bbed6fcafc5 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:04.770709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 666/1326] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:04.776062 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5ce6c-a78f-4fd4-a300-06187483c605 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:04.776484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5ce6c-a78f-4fd4-a300-06187483c605 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:04.776620 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5ce6c-a78f-4fd4-a300-06187483c605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:04.838225 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:04.856916 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-ebe5ce6c-a78f-4fd4-a300-06187483c605 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:04.858144 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-ebe5ce6c-a78f-4fd4-a300-06187483c605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:04.958963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 661/1327] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:04.995758 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844eabf-5bf6-4e87-b9ee-5bbed6fcafc5 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:04.997364 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-1844eabf-5bf6-4e87-b9ee-5bbed6fcafc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:05.100599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844eabf-5bf6-4e87-b9ee-5bbed6fcafc5 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:05.178530 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fa815-ca8f-4b58-9089-713cc9ec64ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:05.179189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fa815-ca8f-4b58-9089-713cc9ec64ab service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:05.179470 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fa815-ca8f-4b58-9089-713cc9ec64ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:05.179743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fa815-ca8f-4b58-9089-713cc9ec64ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:05.181350 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ca9fa815-ca8f-4b58-9089-713cc9ec64ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:05.197988 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:05.300319 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fa815-ca8f-4b58-9089-713cc9ec64ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:05.301760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fa815-ca8f-4b58-9089-713cc9ec64ab service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:05.319852 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 667/1328] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:07.385911 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7d792-872c-4402-8873-e72d2c31c6aa None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:07.386480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7d792-872c-4402-8873-e72d2c31c6aa None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:07.386480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7d792-872c-4402-8873-e72d2c31c6aa None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:07.387868 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 662/1329] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:07.394077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcc95e-fe68-44a6-8a5e-5802adf4746c None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:07.394603 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcc95e-fe68-44a6-8a5e-5802adf4746c None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:07.395115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcc95e-fe68-44a6-8a5e-5802adf4746c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:07.463415 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-bcdcc95e-fe68-44a6-8a5e-5802adf4746c None None] MFA Rules not processed for user `c428456e9e294402b87552a9b190d23b`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:07.465168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-bcdcc95e-fe68-44a6-8a5e-5802adf4746c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:07.529960 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:07.562237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 668/1330] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:07 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:07.600344 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7d792-872c-4402-8873-e72d2c31c6aa None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:07.601989 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-cef7d792-872c-4402-8873-e72d2c31c6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:07.712060 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7d792-872c-4402-8873-e72d2c31c6aa None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:07.732911 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:07.787331 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad3eb7-0c84-41e5-96fd-535b23e791da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:07.788201 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad3eb7-0c84-41e5-96fd-535b23e791da service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:07.788484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad3eb7-0c84-41e5-96fd-535b23e791da service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:07.788760 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad3eb7-0c84-41e5-96fd-535b23e791da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:07.790380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e8ad3eb7-0c84-41e5-96fd-535b23e791da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:07.899666 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad3eb7-0c84-41e5-96fd-535b23e791da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:07.901124 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad3eb7-0c84-41e5-96fd-535b23e791da service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:07.920369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 663/1331] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:07 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:10.371347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb70ed-21bc-4028-bff5-fadff115de2c None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:10.371902 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb70ed-21bc-4028-bff5-fadff115de2c None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:10.371902 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb70ed-21bc-4028-bff5-fadff115de2c None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:10.373243 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 669/1332] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:10.378528 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ec755-8b13-4dfc-9052-06062fff0796 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:10.379017 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ec755-8b13-4dfc-9052-06062fff0796 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:10.379121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ec755-8b13-4dfc-9052-06062fff0796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:10.442932 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:10.445777 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-872ec755-8b13-4dfc-9052-06062fff0796 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:10.447033 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-872ec755-8b13-4dfc-9052-06062fff0796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:10.543354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 664/1333] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:10.579113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb70ed-21bc-4028-bff5-fadff115de2c None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:10.580646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b5bb70ed-21bc-4028-bff5-fadff115de2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:10.681328 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb70ed-21bc-4028-bff5-fadff115de2c None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:10.753808 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c62ffd-7e2b-4ac4-ba47-2ab3328aee54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:10.754421 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c62ffd-7e2b-4ac4-ba47-2ab3328aee54 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:10.754708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c62ffd-7e2b-4ac4-ba47-2ab3328aee54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:10.755021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c62ffd-7e2b-4ac4-ba47-2ab3328aee54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:10.756647 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-99c62ffd-7e2b-4ac4-ba47-2ab3328aee54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:10.782575 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:10.863592 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c62ffd-7e2b-4ac4-ba47-2ab3328aee54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:10.865026 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c62ffd-7e2b-4ac4-ba47-2ab3328aee54 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:10.883365 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 670/1334] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:12.903170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ccbfd-157b-4fb0-ae00-d3f1a4d49a4c None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:12.903735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ccbfd-157b-4fb0-ae00-d3f1a4d49a4c None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:12.903735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ccbfd-157b-4fb0-ae00-d3f1a4d49a4c None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:12.905088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 665/1335] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:12.910234 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752490c-a09c-4ee4-99e1-90337d7e1efe None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:12.910689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752490c-a09c-4ee4-99e1-90337d7e1efe None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:12.910817 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752490c-a09c-4ee4-99e1-90337d7e1efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:12.977407 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-5752490c-a09c-4ee4-99e1-90337d7e1efe None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:12.978612 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-5752490c-a09c-4ee4-99e1-90337d7e1efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:13.052072 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:13.074046 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 671/1336] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:13.114091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ccbfd-157b-4fb0-ae00-d3f1a4d49a4c None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:13.115689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b73ccbfd-157b-4fb0-ae00-d3f1a4d49a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:13.219583 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ccbfd-157b-4fb0-ae00-d3f1a4d49a4c None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:13.247513 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:13.293462 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605dc12-336e-4f73-b9e6-050a3b055c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:13.294076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605dc12-336e-4f73-b9e6-050a3b055c5a service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:13.294362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605dc12-336e-4f73-b9e6-050a3b055c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:13.294641 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605dc12-336e-4f73-b9e6-050a3b055c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:13.296318 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a605dc12-336e-4f73-b9e6-050a3b055c5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:13.401285 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605dc12-336e-4f73-b9e6-050a3b055c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:13.403254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605dc12-336e-4f73-b9e6-050a3b055c5a service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:13.422023 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 666/1337] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:15.969612 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2302352-2b89-4a03-9b22-62b579f53f45 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:15.970117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2302352-2b89-4a03-9b22-62b579f53f45 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:15.970117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2302352-2b89-4a03-9b22-62b579f53f45 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:15.971491 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 672/1338] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:15.976715 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd9c00-72da-479d-8cbc-18f84ba5dc40 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:15.977148 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd9c00-72da-479d-8cbc-18f84ba5dc40 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:15.977250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd9c00-72da-479d-8cbc-18f84ba5dc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:16.045356 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-b7bd9c00-72da-479d-8cbc-18f84ba5dc40 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:16.046808 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b7bd9c00-72da-479d-8cbc-18f84ba5dc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:16.056173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:16.143194 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 667/1339] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:16.179671 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2302352-2b89-4a03-9b22-62b579f53f45 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:16.181250 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e2302352-2b89-4a03-9b22-62b579f53f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:16.284589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2302352-2b89-4a03-9b22-62b579f53f45 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:16.357243 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028789d2-8a72-4f5a-9f80-c5b7a672f26b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:16.357850 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028789d2-8a72-4f5a-9f80-c5b7a672f26b service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:16.358135 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028789d2-8a72-4f5a-9f80-c5b7a672f26b service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:16.358413 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028789d2-8a72-4f5a-9f80-c5b7a672f26b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:16.360056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-028789d2-8a72-4f5a-9f80-c5b7a672f26b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:16.393844 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:16.466879 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028789d2-8a72-4f5a-9f80-c5b7a672f26b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:16.468322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028789d2-8a72-4f5a-9f80-c5b7a672f26b service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:16.487080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 673/1340] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:20.629400 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad35fa-2866-4df2-84d5-43393d026ed6 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:20.629997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad35fa-2866-4df2-84d5-43393d026ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:20.629997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad35fa-2866-4df2-84d5-43393d026ed6 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:20.635377 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 668/1341] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:51:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:20.636820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb167c-11e0-41c4-af38-ae283b091de4 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:20.637263 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb167c-11e0-41c4-af38-ae283b091de4 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:20.637395 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb167c-11e0-41c4-af38-ae283b091de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:20.708931 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-15cb167c-11e0-41c4-af38-ae283b091de4 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:20.711392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-15cb167c-11e0-41c4-af38-ae283b091de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:20.801510 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:20.813231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 674/1342] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:51:20.851933 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad35fa-2866-4df2-84d5-43393d026ed6 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:20.853548 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-eaad35fa-2866-4df2-84d5-43393d026ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:20.956665 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad35fa-2866-4df2-84d5-43393d026ed6 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:20.996072 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:21.156548 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cefde0-837f-4635-a1ab-5848ff5314fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:21.157175 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cefde0-837f-4635-a1ab-5848ff5314fc service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:21.157458 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cefde0-837f-4635-a1ab-5848ff5314fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:21.157734 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cefde0-837f-4635-a1ab-5848ff5314fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:21.159445 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-04cefde0-837f-4635-a1ab-5848ff5314fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:21.268234 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cefde0-837f-4635-a1ab-5848ff5314fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:21.269586 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cefde0-837f-4635-a1ab-5848ff5314fc service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:21.287192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 669/1343] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:24.259028 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4efbd-71c2-4c00-89d5-811cf9961cc5 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:24.259477 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4efbd-71c2-4c00-89d5-811cf9961cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:24.259598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4efbd-71c2-4c00-89d5-811cf9961cc5 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:24.261003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 675/1344] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:24.266309 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73bf6d-0dc2-403c-8597-f22e78d40752 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:24.266754 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73bf6d-0dc2-403c-8597-f22e78d40752 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:24.266930 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73bf6d-0dc2-403c-8597-f22e78d40752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:24.333486 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-1e73bf6d-0dc2-403c-8597-f22e78d40752 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:24.334688 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-1e73bf6d-0dc2-403c-8597-f22e78d40752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:24.353129 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:24.436002 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 670/1345] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:24.473964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4efbd-71c2-4c00-89d5-811cf9961cc5 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:24.475579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-42d4efbd-71c2-4c00-89d5-811cf9961cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:24.582351 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4efbd-71c2-4c00-89d5-811cf9961cc5 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:24.661304 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef266ce-15ae-400a-9b30-37cab5e63282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:24.661920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef266ce-15ae-400a-9b30-37cab5e63282 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:24.662199 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef266ce-15ae-400a-9b30-37cab5e63282 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:24.662797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef266ce-15ae-400a-9b30-37cab5e63282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:24.666167 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-7ef266ce-15ae-400a-9b30-37cab5e63282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:24.708056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:24.774843 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef266ce-15ae-400a-9b30-37cab5e63282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:24.776309 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef266ce-15ae-400a-9b30-37cab5e63282 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:24.796614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 676/1346] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:51:29.563173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9fcc8-5ae9-4d31-93a5-b70ba072b204 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.563640 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9fcc8-5ae9-4d31-93a5-b70ba072b204 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.563747 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9fcc8-5ae9-4d31-93a5-b70ba072b204 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.565221 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 671/1347] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:29.570888 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3e457-7ee7-4f57-b691-c66675e22adc None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.571379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3e457-7ee7-4f57-b691-c66675e22adc None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.571487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3e457-7ee7-4f57-b691-c66675e22adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.642647 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-fdb3e457-7ee7-4f57-b691-c66675e22adc None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:29.643940 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-fdb3e457-7ee7-4f57-b691-c66675e22adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:29.744235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:29.747055 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 677/1348] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:29.785126 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9fcc8-5ae9-4d31-93a5-b70ba072b204 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.786835 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-26b9fcc8-5ae9-4d31-93a5-b70ba072b204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:29.893276 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9fcc8-5ae9-4d31-93a5-b70ba072b204 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.944935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:29.970995 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d1907-7e37-43e7-8fbb-411d1df4b82b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.971585 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d1907-7e37-43e7-8fbb-411d1df4b82b service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.971867 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d1907-7e37-43e7-8fbb-411d1df4b82b service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.972139 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d1907-7e37-43e7-8fbb-411d1df4b82b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.973764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b43d1907-7e37-43e7-8fbb-411d1df4b82b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:30.082794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d1907-7e37-43e7-8fbb-411d1df4b82b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:30.084244 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d1907-7e37-43e7-8fbb-411d1df4b82b service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:30.102262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 672/1349] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:34.971101 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2301c-c9d2-41bb-9f0f-372c997f8e82 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:34.971603 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2301c-c9d2-41bb-9f0f-372c997f8e82 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:34.971711 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2301c-c9d2-41bb-9f0f-372c997f8e82 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:34.973476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 678/1350] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 3 12:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:34.979029 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c555-c6da-435d-aac7-579ee0ae1e31 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:34.979445 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c555-c6da-435d-aac7-579ee0ae1e31 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:34.979593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c555-c6da-435d-aac7-579ee0ae1e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:35.070400 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-3483c555-c6da-435d-aac7-579ee0ae1e31 None None] MFA Rules not processed for user `de27d25fad634658a1abcb776d9a7b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:35.071743 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3483c555-c6da-435d-aac7-579ee0ae1e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:35.123052 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:35.231699 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 673/1351] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 3 12:51:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:39.408163 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0c1fa-209b-445e-a799-046ff9237c59 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:39.408659 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0c1fa-209b-445e-a799-046ff9237c59 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:39.408659 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0c1fa-209b-445e-a799-046ff9237c59 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:39.410289 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 679/1352] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 3 12:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:39.415839 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd74d2-173e-41f7-8d70-dfe3cde0b2d9 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:39.416273 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd74d2-173e-41f7-8d70-dfe3cde0b2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:39.416390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd74d2-173e-41f7-8d70-dfe3cde0b2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:39.500052 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-a8cd74d2-173e-41f7-8d70-dfe3cde0b2d9 None None] MFA Rules not processed for user `de27d25fad634658a1abcb776d9a7b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:39.501315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a8cd74d2-173e-41f7-8d70-dfe3cde0b2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:39.582590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:39.630689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 674/1353] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 3 12:51:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:40.885671 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40ae94-1564-4e02-82e8-b635594c9590 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:40.886326 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40ae94-1564-4e02-82e8-b635594c9590 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:40.886326 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40ae94-1564-4e02-82e8-b635594c9590 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:40.887806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 680/1354] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 3 12:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:40.892701 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec7349-57cf-4c41-bf17-535918deebd1 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:40.893122 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec7349-57cf-4c41-bf17-535918deebd1 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:40.893570 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec7349-57cf-4c41-bf17-535918deebd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:40.970701 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-56ec7349-57cf-4c41-bf17-535918deebd1 None None] MFA Rules not processed for user `de27d25fad634658a1abcb776d9a7b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:40.971980 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-56ec7349-57cf-4c41-bf17-535918deebd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:41.078084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 675/1355] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 3 12:51:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:44.457825 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff852b-a7a8-425d-a821-a75053e5a115 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:44.458677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff852b-a7a8-425d-a821-a75053e5a115 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:44.459978 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff852b-a7a8-425d-a821-a75053e5a115 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:44.467662 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 681/1356] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:51:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:44.467991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64df26f-a1ab-4763-9ecb-f397894a12b0 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:44.468423 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64df26f-a1ab-4763-9ecb-f397894a12b0 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:44.468609 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64df26f-a1ab-4763-9ecb-f397894a12b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:44.518482 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:44.552631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-c64df26f-a1ab-4763-9ecb-f397894a12b0 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:44.554222 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-c64df26f-a1ab-4763-9ecb-f397894a12b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:44.669787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 676/1357] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:44.726542 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fecf9-0040-40d5-922c-a11402a2ab8b None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:44.727302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fecf9-0040-40d5-922c-a11402a2ab8b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:44.727809 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fecf9-0040-40d5-922c-a11402a2ab8b None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:44.730556 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 682/1358] 10.222.0.64 () {54 vars in 962 bytes} [Wed Aug 3 12:51:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:44.740269 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a33e4-fe88-4d53-b007-cc7b4665e9fb None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:44.740994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a33e4-fe88-4d53-b007-cc7b4665e9fb None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:44.741567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a33e4-fe88-4d53-b007-cc7b4665e9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:44.836242 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-019a33e4-fe88-4d53-b007-cc7b4665e9fb None None] MFA Rules not processed for user `bc939818c9224b0ebe2dbaa1eaaec5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:44.837569 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-019a33e4-fe88-4d53-b007-cc7b4665e9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:44.892475 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:44.961838 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 677/1359] 10.222.0.64 () {58 vars in 1059 bytes} [Wed Aug 3 12:51:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:44.970022 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fecf9-0040-40d5-922c-a11402a2ab8b None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:44.971512 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-262fecf9-0040-40d5-922c-a11402a2ab8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:45.124185 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fecf9-0040-40d5-922c-a11402a2ab8b None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:45.211026 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:45.253199 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c387cf-cdcf-4eca-b189-3a48182e32d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:45.253840 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c387cf-cdcf-4eca-b189-3a48182e32d4 service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:45.254130 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c387cf-cdcf-4eca-b189-3a48182e32d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:45.254407 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c387cf-cdcf-4eca-b189-3a48182e32d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:45.256111 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-28c387cf-cdcf-4eca-b189-3a48182e32d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:45.357276 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c387cf-cdcf-4eca-b189-3a48182e32d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:45.359868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c387cf-cdcf-4eca-b189-3a48182e32d4 service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:45.379789 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 683/1360] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:47.606625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf49025-e7da-4a29-a759-cd15578f279f None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.607106 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf49025-e7da-4a29-a759-cd15578f279f None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.607296 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf49025-e7da-4a29-a759-cd15578f279f None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.608796 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 678/1361] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:47.614123 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71cfa9-73a5-41f8-b8dd-acb2d761814f None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.615041 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71cfa9-73a5-41f8-b8dd-acb2d761814f None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.618914 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71cfa9-73a5-41f8-b8dd-acb2d761814f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.691130 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-2f71cfa9-73a5-41f8-b8dd-acb2d761814f None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:47.692487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-2f71cfa9-73a5-41f8-b8dd-acb2d761814f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:47.735604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:47.802783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 684/1362] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:47.843727 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf49025-e7da-4a29-a759-cd15578f279f None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:47.845277 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-dbf49025-e7da-4a29-a759-cd15578f279f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:48.027737 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf49025-e7da-4a29-a759-cd15578f279f None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:48.038069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:48.179408 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c6906-b1a3-4b2c-b412-97eb1d66458c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:48.180120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c6906-b1a3-4b2c-b412-97eb1d66458c service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.180468 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c6906-b1a3-4b2c-b412-97eb1d66458c service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.180810 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c6906-b1a3-4b2c-b412-97eb1d66458c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.182636 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-428c6906-b1a3-4b2c-b412-97eb1d66458c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:48.281435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c6906-b1a3-4b2c-b412-97eb1d66458c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:48.283161 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c6906-b1a3-4b2c-b412-97eb1d66458c service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:48.302347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 679/1363] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:50.779453 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823de46a-91a3-4a11-8618-cf8af749e05d None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.780001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823de46a-91a3-4a11-8618-cf8af749e05d None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.780001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823de46a-91a3-4a11-8618-cf8af749e05d None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.781564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 685/1364] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:50.786654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b7904-903b-479b-a9a5-dc9850bc4069 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.787739 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b7904-903b-479b-a9a5-dc9850bc4069 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.788116 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b7904-903b-479b-a9a5-dc9850bc4069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.807236 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:50.868221 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-a79b7904-903b-479b-a9a5-dc9850bc4069 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:50.870066 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a79b7904-903b-479b-a9a5-dc9850bc4069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:50.977479 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 680/1365] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:51:51.024991 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b079e-2506-4184-914d-b21439638dad None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:51.025313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b079e-2506-4184-914d-b21439638dad None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:51.025621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b079e-2506-4184-914d-b21439638dad None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:51.027195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 686/1366] 10.222.0.64 () {54 vars in 962 bytes} [Wed Aug 3 12:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:51.032726 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65933725-b804-4095-80c2-1810779b73b7 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:51.033018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65933725-b804-4095-80c2-1810779b73b7 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:51.033299 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65933725-b804-4095-80c2-1810779b73b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:51.115733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-65933725-b804-4095-80c2-1810779b73b7 None None] MFA Rules not processed for user `bc939818c9224b0ebe2dbaa1eaaec5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:51.116960 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-65933725-b804-4095-80c2-1810779b73b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:51.167104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:51.259743 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 681/1367] 10.222.0.64 () {58 vars in 1059 bytes} [Wed Aug 3 12:51:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:51.268767 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b079e-2506-4184-914d-b21439638dad None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:51.271843 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-7e9b079e-2506-4184-914d-b21439638dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:51.447770 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b079e-2506-4184-914d-b21439638dad None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:51.470140 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:51.580220 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca424c-0596-4015-94a1-15f454b21d20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:51.580952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca424c-0596-4015-94a1-15f454b21d20 service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:51.581337 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca424c-0596-4015-94a1-15f454b21d20 service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:51.581733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca424c-0596-4015-94a1-15f454b21d20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:51.583546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-2eca424c-0596-4015-94a1-15f454b21d20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:51.685194 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca424c-0596-4015-94a1-15f454b21d20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:51.687237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca424c-0596-4015-94a1-15f454b21d20 service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:51.707743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 687/1368] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:51:52.690128 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277e1d6-01c8-4dec-a316-a578b565bbd4 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.690672 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277e1d6-01c8-4dec-a316-a578b565bbd4 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.691018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277e1d6-01c8-4dec-a316-a578b565bbd4 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.692818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 682/1369] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:51:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:52.697892 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfaa18f-dcd8-47c2-9f43-368582d35584 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.698314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfaa18f-dcd8-47c2-9f43-368582d35584 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.698490 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfaa18f-dcd8-47c2-9f43-368582d35584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.731957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:52.768225 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-adfaa18f-dcd8-47c2-9f43-368582d35584 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:52.769497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-adfaa18f-dcd8-47c2-9f43-368582d35584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:52.877968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 688/1370] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:53.221205 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f6202-604a-4f46-af4c-a67b6a57b172 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:53.221497 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f6202-604a-4f46-af4c-a67b6a57b172 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:53.221772 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f6202-604a-4f46-af4c-a67b6a57b172 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:53.223514 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 683/1371] 10.222.0.64 () {54 vars in 964 bytes} [Wed Aug 3 12:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:53.228955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab9321-542e-4549-bd29-7d703fb799c0 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:53.229244 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab9321-542e-4549-bd29-7d703fb799c0 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:53.229522 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab9321-542e-4549-bd29-7d703fb799c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:53.312735 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-0fab9321-542e-4549-bd29-7d703fb799c0 None None] MFA Rules not processed for user `19337279eb414e62b529feb6e7c9b1b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:53.313969 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-0fab9321-542e-4549-bd29-7d703fb799c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:53.363293 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:53.393155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 689/1372] 10.222.0.64 () {58 vars in 1061 bytes} [Wed Aug 3 12:51:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:53.401145 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f6202-604a-4f46-af4c-a67b6a57b172 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:53.402664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-380f6202-604a-4f46-af4c-a67b6a57b172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:53.509002 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f6202-604a-4f46-af4c-a67b6a57b172 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:53.554391 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:53.590111 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d382ad-f23a-4dfe-b7b2-904c36863d91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:53.590749 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d382ad-f23a-4dfe-b7b2-904c36863d91 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:53.591046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d382ad-f23a-4dfe-b7b2-904c36863d91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:53.591309 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d382ad-f23a-4dfe-b7b2-904c36863d91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:53.592961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-f7d382ad-f23a-4dfe-b7b2-904c36863d91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:53.708041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d382ad-f23a-4dfe-b7b2-904c36863d91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:53.710224 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d382ad-f23a-4dfe-b7b2-904c36863d91 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:53.735481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 684/1373] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:53.970470 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad1e95-b8b5-4e75-9e1c-e393e25c82d0 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:53.971099 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad1e95-b8b5-4e75-9e1c-e393e25c82d0 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:53.971424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad1e95-b8b5-4e75-9e1c-e393e25c82d0 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:53.973343 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 690/1374] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:51:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:53.979311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216e313-35f0-41b9-9f3e-4ffbcc99d790 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:53.979665 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216e313-35f0-41b9-9f3e-4ffbcc99d790 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:53.979831 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216e313-35f0-41b9-9f3e-4ffbcc99d790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:54.051982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-6216e313-35f0-41b9-9f3e-4ffbcc99d790 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:54.053357 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-6216e313-35f0-41b9-9f3e-4ffbcc99d790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:54.076632 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:54.161164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 685/1375] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:54.206267 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad1e95-b8b5-4e75-9e1c-e393e25c82d0 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:54.207944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-73ad1e95-b8b5-4e75-9e1c-e393e25c82d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:54.357663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad1e95-b8b5-4e75-9e1c-e393e25c82d0 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:54.414919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:54.475019 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86352499-9a56-4b8c-9349-a80118184fac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:54.475641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86352499-9a56-4b8c-9349-a80118184fac service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:54.475928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86352499-9a56-4b8c-9349-a80118184fac service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:54.476206 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86352499-9a56-4b8c-9349-a80118184fac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:54.477838 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-86352499-9a56-4b8c-9349-a80118184fac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:54.568215 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86352499-9a56-4b8c-9349-a80118184fac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:54.569744 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86352499-9a56-4b8c-9349-a80118184fac service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:54.588312 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 691/1376] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:56.885736 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ce746-6bb8-4f01-a2d3-38f97179266c None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:56.886623 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ce746-6bb8-4f01-a2d3-38f97179266c None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:56.886937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ce746-6bb8-4f01-a2d3-38f97179266c None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:56.888603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 686/1377] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:51:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:56.894167 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f317830-a658-45cd-b76d-09f32b65d587 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:56.894596 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f317830-a658-45cd-b76d-09f32b65d587 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:56.894700 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f317830-a658-45cd-b76d-09f32b65d587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:56.960630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-5f317830-a658-45cd-b76d-09f32b65d587 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:56.961804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-5f317830-a658-45cd-b76d-09f32b65d587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:56.968868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:57.059994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 692/1378] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:57.102949 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ce746-6bb8-4f01-a2d3-38f97179266c None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:57.105153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-d41ce746-6bb8-4f01-a2d3-38f97179266c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:57.261614 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ce746-6bb8-4f01-a2d3-38f97179266c None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:57.265259 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:57.402388 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b085817-7a88-4d9c-bc0c-40b10760de29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:57.402968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b085817-7a88-4d9c-bc0c-40b10760de29 service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:57.403254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b085817-7a88-4d9c-bc0c-40b10760de29 service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:57.404378 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b085817-7a88-4d9c-bc0c-40b10760de29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:57.406047 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3b085817-7a88-4d9c-bc0c-40b10760de29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:57.503035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b085817-7a88-4d9c-bc0c-40b10760de29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:57.504628 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b085817-7a88-4d9c-bc0c-40b10760de29 service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:57.525867 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 687/1379] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:59.678273 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10bf6d-22ca-4f0c-89f5-49e3f65da58c None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.678826 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10bf6d-22ca-4f0c-89f5-49e3f65da58c None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.679897 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10bf6d-22ca-4f0c-89f5-49e3f65da58c None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.682055 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 693/1380] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:51:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:59.687777 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1db37-c77c-4318-9b6a-4e88d0bba156 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.688250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1db37-c77c-4318-9b6a-4e88d0bba156 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.688335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1db37-c77c-4318-9b6a-4e88d0bba156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.701373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:59.761915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-29a1db37-c77c-4318-9b6a-4e88d0bba156 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:59.763573 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-29a1db37-c77c-4318-9b6a-4e88d0bba156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:59.869513 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 688/1381] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:59.918099 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10bf6d-22ca-4f0c-89f5-49e3f65da58c None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:59.919799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-1b10bf6d-22ca-4f0c-89f5-49e3f65da58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:00.065420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:00.076885 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10bf6d-22ca-4f0c-89f5-49e3f65da58c None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:00.215235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98443e55-deca-4c2d-b7d3-3a2df9414200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:00.215857 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98443e55-deca-4c2d-b7d3-3a2df9414200 service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:00.216137 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98443e55-deca-4c2d-b7d3-3a2df9414200 service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:00.216410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98443e55-deca-4c2d-b7d3-3a2df9414200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:00.218024 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-98443e55-deca-4c2d-b7d3-3a2df9414200 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:00.316716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98443e55-deca-4c2d-b7d3-3a2df9414200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:00.318530 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98443e55-deca-4c2d-b7d3-3a2df9414200 service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:00.329423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:00.338352 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 694/1382] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:02.528832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339d68c-673c-463d-904d-683624beb92f None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:02.529438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339d68c-673c-463d-904d-683624beb92f None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:02.529438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339d68c-673c-463d-904d-683624beb92f None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:02.530971 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 689/1383] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:02.536434 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e461e-facb-4664-bfad-510732c5b992 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:02.536862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e461e-facb-4664-bfad-510732c5b992 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:02.537311 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e461e-facb-4664-bfad-510732c5b992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:02.615216 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-f21e461e-facb-4664-bfad-510732c5b992 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:02.616557 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-f21e461e-facb-4664-bfad-510732c5b992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:02.724440 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 695/1384] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:02.770200 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339d68c-673c-463d-904d-683624beb92f None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:02.771910 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-0339d68c-673c-463d-904d-683624beb92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:02.875313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:02.940849 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339d68c-673c-463d-904d-683624beb92f None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:03.064597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f38e5-da1c-43e3-a84d-9476347c484a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:03.065260 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f38e5-da1c-43e3-a84d-9476347c484a service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:03.065568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f38e5-da1c-43e3-a84d-9476347c484a service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:03.065869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f38e5-da1c-43e3-a84d-9476347c484a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:03.067651 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a52f38e5-da1c-43e3-a84d-9476347c484a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:03.121428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:03.164842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f38e5-da1c-43e3-a84d-9476347c484a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:03.167133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f38e5-da1c-43e3-a84d-9476347c484a service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:03.187186 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 690/1385] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:05.532979 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f807e1-9ebe-48f1-808b-6e4c08f073fb None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:05.533570 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f807e1-9ebe-48f1-808b-6e4c08f073fb None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:05.533691 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f807e1-9ebe-48f1-808b-6e4c08f073fb None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:05.535560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 696/1386] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:52:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:05.542675 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d0016-fb5f-4b36-8c79-1b8a0f1019d3 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:05.543182 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d0016-fb5f-4b36-8c79-1b8a0f1019d3 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:05.543293 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d0016-fb5f-4b36-8c79-1b8a0f1019d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:05.610052 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-e08d0016-fb5f-4b36-8c79-1b8a0f1019d3 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:05.611363 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e08d0016-fb5f-4b36-8c79-1b8a0f1019d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:05.716072 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 691/1387] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:05.761269 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f807e1-9ebe-48f1-808b-6e4c08f073fb None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:05.762836 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d5f807e1-9ebe-48f1-808b-6e4c08f073fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:05.841129 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:05.917551 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f807e1-9ebe-48f1-808b-6e4c08f073fb None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:06.030706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d68637-3b89-498a-a17a-27c508e5ebf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:06.031362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d68637-3b89-498a-a17a-27c508e5ebf3 service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:06.031648 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d68637-3b89-498a-a17a-27c508e5ebf3 service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:06.031927 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d68637-3b89-498a-a17a-27c508e5ebf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:06.033562 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-a1d68637-3b89-498a-a17a-27c508e5ebf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:06.072701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:06.125387 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d68637-3b89-498a-a17a-27c508e5ebf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:06.126937 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d68637-3b89-498a-a17a-27c508e5ebf3 service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:06.146062 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 697/1388] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:08.329616 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b91020-29de-4a0b-96f6-8bce99264a30 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:08.330122 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b91020-29de-4a0b-96f6-8bce99264a30 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:08.330217 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b91020-29de-4a0b-96f6-8bce99264a30 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:08.331583 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 692/1389] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:08.336969 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41fe87-dd34-4c5c-a2ca-867d6251f8f7 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:08.337985 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41fe87-dd34-4c5c-a2ca-867d6251f8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:08.338081 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41fe87-dd34-4c5c-a2ca-867d6251f8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:08.403631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-5c41fe87-dd34-4c5c-a2ca-867d6251f8f7 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:08.404853 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-5c41fe87-dd34-4c5c-a2ca-867d6251f8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:08.502840 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 698/1390] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:08.549138 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b91020-29de-4a0b-96f6-8bce99264a30 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:08.554161 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e6b91020-29de-4a0b-96f6-8bce99264a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:08.582547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:08.698484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b91020-29de-4a0b-96f6-8bce99264a30 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:08.802181 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:08.813715 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa0468-f223-48c4-837c-a006242e994b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:08.814335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa0468-f223-48c4-837c-a006242e994b service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:08.814619 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa0468-f223-48c4-837c-a006242e994b service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:08.814942 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa0468-f223-48c4-837c-a006242e994b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:08.816578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a9aa0468-f223-48c4-837c-a006242e994b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:08.907028 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa0468-f223-48c4-837c-a006242e994b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:08.908630 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa0468-f223-48c4-837c-a006242e994b service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:08.927610 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 693/1391] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:09.017068 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c68020-ca76-4ac8-b2e0-b54307422a67 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:09.017355 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c68020-ca76-4ac8-b2e0-b54307422a67 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:09.017670 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c68020-ca76-4ac8-b2e0-b54307422a67 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:09.019086 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 699/1392] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:09.024469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87985f9-e4d5-4d12-aaf9-ef1af79fc64d None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:09.025514 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87985f9-e4d5-4d12-aaf9-ef1af79fc64d None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:09.025868 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87985f9-e4d5-4d12-aaf9-ef1af79fc64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:09.091296 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-c87985f9-e4d5-4d12-aaf9-ef1af79fc64d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:09.092436 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-c87985f9-e4d5-4d12-aaf9-ef1af79fc64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:09.157132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:09.199855 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 694/1393] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:09.263396 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a77b4c-3097-465d-99dd-b4ad95aec089 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:09.263686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a77b4c-3097-465d-99dd-b4ad95aec089 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:09.263973 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a77b4c-3097-465d-99dd-b4ad95aec089 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:09.265329 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 700/1394] 10.222.0.64 () {54 vars in 966 bytes} [Wed Aug 3 12:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:52:09.270416 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a8152-8aec-488d-93e8-f8afa1849a58 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:09.270833 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a8152-8aec-488d-93e8-f8afa1849a58 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:09.271180 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a8152-8aec-488d-93e8-f8afa1849a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:09.348521 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-e61a8152-8aec-488d-93e8-f8afa1849a58 None None] MFA Rules not processed for user `74b99f03a7c14a2e89384dcca532dc61`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:09.349663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e61a8152-8aec-488d-93e8-f8afa1849a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:09.429125 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 695/1395] 10.222.0.64 () {58 vars in 1063 bytes} [Wed Aug 3 12:52:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:09.437457 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a77b4c-3097-465d-99dd-b4ad95aec089 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:09.439131 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-16a77b4c-3097-465d-99dd-b4ad95aec089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:09.453670 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:09.547223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a77b4c-3097-465d-99dd-b4ad95aec089 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:09.621849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc8731-2d9a-46e4-a55d-8ca45d24cb48 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b99f03a7c14a2e89384dcca532dc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:09.622400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc8731-2d9a-46e4-a55d-8ca45d24cb48 service glance] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:09.622694 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc8731-2d9a-46e4-a55d-8ca45d24cb48 service glance] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:09.622998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc8731-2d9a-46e4-a55d-8ca45d24cb48 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:09.624686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-2acc8731-2d9a-46e4-a55d-8ca45d24cb48 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:09.695213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:09.737804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc8731-2d9a-46e4-a55d-8ca45d24cb48 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:09.739306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc8731-2d9a-46e4-a55d-8ca45d24cb48 service glance] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:09.758035 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 701/1396] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:10.643137 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d854a4-8bd1-424c-b6a3-e900817877c7 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:10.643624 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d854a4-8bd1-424c-b6a3-e900817877c7 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:10.643905 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d854a4-8bd1-424c-b6a3-e900817877c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:10.713457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-75d854a4-8bd1-424c-b6a3-e900817877c7 None None] MFA Rules not processed for user `b9d70abf4f754530a3cf6efa7a782736`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:10.714616 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-75d854a4-8bd1-424c-b6a3-e900817877c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:10.723066 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:10.802929 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 696/1397] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 3 12:52:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:52:10.850680 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7c22b-49dd-4235-8b87-6e1eaa69c1c9 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:10.855243 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7c22b-49dd-4235-8b87-6e1eaa69c1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:10.855243 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7c22b-49dd-4235-8b87-6e1eaa69c1c9 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:10.855243 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 702/1398] 10.222.0.64 () {54 vars in 943 bytes} [Wed Aug 3 12:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:10.859141 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36a5c9-4acd-4d5d-be3f-d32db428f79c None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:10.859438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36a5c9-4acd-4d5d-be3f-d32db428f79c None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:10.859752 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36a5c9-4acd-4d5d-be3f-d32db428f79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:10.938153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-3b36a5c9-4acd-4d5d-be3f-d32db428f79c None None] MFA Rules not processed for user `5209ec838a4f45d6b746edb27970c93d`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:10.939400 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3b36a5c9-4acd-4d5d-be3f-d32db428f79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:11.024912 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:11.048407 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 697/1399] 10.222.0.64 () {58 vars in 1040 bytes} [Wed Aug 3 12:52:10 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:11.058661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7c22b-49dd-4235-8b87-6e1eaa69c1c9 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:11.060261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-f8d7c22b-49dd-4235-8b87-6e1eaa69c1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:11.086298 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570fa2f-372d-46cb-b992-d6db7c37c93d None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:11.086594 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570fa2f-372d-46cb-b992-d6db7c37c93d None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:11.086923 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570fa2f-372d-46cb-b992-d6db7c37c93d None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:11.088292 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 698/1400] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:52:11.093009 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a113e9-2673-4a85-afed-10f5ee98810d None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:11.093296 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a113e9-2673-4a85-afed-10f5ee98810d None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:11.093575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a113e9-2673-4a85-afed-10f5ee98810d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:11.158836 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-38a113e9-2673-4a85-afed-10f5ee98810d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:11.160049 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-38a113e9-2673-4a85-afed-10f5ee98810d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:11.201648 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7c22b-49dd-4235-8b87-6e1eaa69c1c9 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:11.239647 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:11.257253 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 699/1401] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:52:11.302397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a113e9-2673-4a85-afed-10f5ee98810d None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:11.303627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-38a113e9-2673-4a85-afed-10f5ee98810d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:11.309433 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3d4a5-a8b1-44eb-a6f0-6e7dbf66261b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5209ec838a4f45d6b746edb27970c93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:11.310061 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3d4a5-a8b1-44eb-a6f0-6e7dbf66261b service swift] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:11.310350 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3d4a5-a8b1-44eb-a6f0-6e7dbf66261b service swift] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:11.310630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3d4a5-a8b1-44eb-a6f0-6e7dbf66261b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:11.312360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-9fe3d4a5-a8b1-44eb-a6f0-6e7dbf66261b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:11.369221 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:11.403097 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3d4a5-a8b1-44eb-a6f0-6e7dbf66261b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:11.404732 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3d4a5-a8b1-44eb-a6f0-6e7dbf66261b service swift] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:11.414088 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 703/1402] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 3 12:52:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:52:11.422274 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a113e9-2673-4a85-afed-10f5ee98810d None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:11.550344 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d6462-579a-42d3-b2d6-aa7021ba7016 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:11.550983 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d6462-579a-42d3-b2d6-aa7021ba7016 service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:11.551445 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d6462-579a-42d3-b2d6-aa7021ba7016 service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:11.551725 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d6462-579a-42d3-b2d6-aa7021ba7016 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:11.553343 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-ec1d6462-579a-42d3-b2d6-aa7021ba7016 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:11.611006 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:11.641715 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d6462-579a-42d3-b2d6-aa7021ba7016 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:11.643338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d6462-579a-42d3-b2d6-aa7021ba7016 service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:11.661438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 700/1403] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:52:13.830797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883d547-5594-47dd-88a3-cf370d70c50f None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:13.831329 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883d547-5594-47dd-88a3-cf370d70c50f None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:13.831329 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883d547-5594-47dd-88a3-cf370d70c50f None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:13.832639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 704/1404] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:13.838655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efe27c-9d20-4152-8805-070b88b6c879 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:13.839210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efe27c-9d20-4152-8805-070b88b6c879 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:13.839292 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efe27c-9d20-4152-8805-070b88b6c879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:13.912837 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-46efe27c-9d20-4152-8805-070b88b6c879 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:13.914056 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-46efe27c-9d20-4152-8805-070b88b6c879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:14.024825 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 701/1405] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:14.070167 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883d547-5594-47dd-88a3-cf370d70c50f None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:14.071943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e883d547-5594-47dd-88a3-cf370d70c50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:14.170247 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:14.252802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883d547-5594-47dd-88a3-cf370d70c50f None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:14.386459 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a1569-ba51-40f2-9d23-51b3246d5c19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:14.387120 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a1569-ba51-40f2-9d23-51b3246d5c19 service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:14.387397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a1569-ba51-40f2-9d23-51b3246d5c19 service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:14.388867 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a1569-ba51-40f2-9d23-51b3246d5c19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:14.390725 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-539a1569-ba51-40f2-9d23-51b3246d5c19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:14.425480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:14.495043 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a1569-ba51-40f2-9d23-51b3246d5c19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:14.496635 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a1569-ba51-40f2-9d23-51b3246d5c19 service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:14.529192 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 705/1406] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:17.527218 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391255d-8e6f-45cc-baf9-d20bf08c2087 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.528022 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391255d-8e6f-45cc-baf9-d20bf08c2087 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.528022 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391255d-8e6f-45cc-baf9-d20bf08c2087 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.530914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 702/1407] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:52:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:17.534525 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dfb0c-a4fa-4716-af81-71d9e3622ba1 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.535005 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dfb0c-a4fa-4716-af81-71d9e3622ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.535124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dfb0c-a4fa-4716-af81-71d9e3622ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.609440 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-2b3dfb0c-a4fa-4716-af81-71d9e3622ba1 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:17.610796 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-2b3dfb0c-a4fa-4716-af81-71d9e3622ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:17.720974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 706/1408] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:17.766601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391255d-8e6f-45cc-baf9-d20bf08c2087 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:17.768156 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-4391255d-8e6f-45cc-baf9-d20bf08c2087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:17.813771 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:17.939832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391255d-8e6f-45cc-baf9-d20bf08c2087 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:18.063412 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:18.069633 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ae7e3-dc2b-466e-b1e3-4c3f99604972 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:18.070307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ae7e3-dc2b-466e-b1e3-4c3f99604972 service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:18.070660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ae7e3-dc2b-466e-b1e3-4c3f99604972 service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:18.070970 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ae7e3-dc2b-466e-b1e3-4c3f99604972 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:18.072915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-378ae7e3-dc2b-466e-b1e3-4c3f99604972 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:18.169013 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ae7e3-dc2b-466e-b1e3-4c3f99604972 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:18.170651 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ae7e3-dc2b-466e-b1e3-4c3f99604972 service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:18.190239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 703/1409] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:52:27.718441 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:28.187770 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=47 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:35.110854 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e01048-8f3a-4561-9a67-781c6799cabf None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:35.111435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e01048-8f3a-4561-9a67-781c6799cabf None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:35.111435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e01048-8f3a-4561-9a67-781c6799cabf None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:35.112781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 707/1410] 10.222.0.64 () {54 vars in 918 bytes} [Wed Aug 3 12:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:35.118352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23015b7-db9d-45f7-a876-4e05e78fc930 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:35.118820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23015b7-db9d-45f7-a876-4e05e78fc930 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:35.119012 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23015b7-db9d-45f7-a876-4e05e78fc930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:35.196782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-e23015b7-db9d-45f7-a876-4e05e78fc930 None None] MFA Rules not processed for user `de27d25fad634658a1abcb776d9a7b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:35.198008 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e23015b7-db9d-45f7-a876-4e05e78fc930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:35.305584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 704/1411] 10.222.0.64 () {58 vars in 1015 bytes} [Wed Aug 3 12:52:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:35.319747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9316bc-0cb5-474c-93ad-44e3a9294122 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:35.320069 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9316bc-0cb5-474c-93ad-44e3a9294122 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:35.320842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9316bc-0cb5-474c-93ad-44e3a9294122 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:35.322176 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 708/1412] 10.222.0.64 () {54 vars in 918 bytes} [Wed Aug 3 12:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:35.326873 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93448bc8-a5a1-4f13-97c5-6f9a37def2e9 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:35.327167 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93448bc8-a5a1-4f13-97c5-6f9a37def2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:35.327449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93448bc8-a5a1-4f13-97c5-6f9a37def2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:35.400139 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:35.402721 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-93448bc8-a5a1-4f13-97c5-6f9a37def2e9 None None] MFA Rules not processed for user `bc939818c9224b0ebe2dbaa1eaaec5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:35.403999 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-93448bc8-a5a1-4f13-97c5-6f9a37def2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:35.517059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 705/1413] 10.222.0.64 () {58 vars in 1015 bytes} [Wed Aug 3 12:52:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:37.961950 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee04331-b323-4121-9c76-ce51b3c51672 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:37.962503 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee04331-b323-4121-9c76-ce51b3c51672 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:37.962602 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee04331-b323-4121-9c76-ce51b3c51672 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:37.963975 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:37.969246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e44460-db81-4d16-a586-bc1815f57d60 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:37.969690 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e44460-db81-4d16-a586-bc1815f57d60 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:37.969798 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e44460-db81-4d16-a586-bc1815f57d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:38.040615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-37e44460-db81-4d16-a586-bc1815f57d60 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:38.041877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-37e44460-db81-4d16-a586-bc1815f57d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:38.095639 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:38.137870 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:38.180684 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee04331-b323-4121-9c76-ce51b3c51672 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:38.182211 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-aee04331-b323-4121-9c76-ce51b3c51672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:38.451637 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee04331-b323-4121-9c76-ce51b3c51672 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:38.522726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:38.561558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198decc-6df6-48fb-bca8-2b9936019119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:38.562113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198decc-6df6-48fb-bca8-2b9936019119 service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:38.562393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198decc-6df6-48fb-bca8-2b9936019119 service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:38.562668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198decc-6df6-48fb-bca8-2b9936019119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:38.564342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e198decc-6df6-48fb-bca8-2b9936019119 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:38.652575 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198decc-6df6-48fb-bca8-2b9936019119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:38.654169 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198decc-6df6-48fb-bca8-2b9936019119 service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:38.674059 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 710/1416] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:52:39.567670 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6309067-99ca-4bd8-a763-71b914e7611a None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:39.568237 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6309067-99ca-4bd8-a763-71b914e7611a None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:39.568237 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6309067-99ca-4bd8-a763-71b914e7611a None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:39.569634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:39.574598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4341c-e130-42ff-b21e-5771ee0bebf8 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:39.575066 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4341c-e130-42ff-b21e-5771ee0bebf8 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:39.575166 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4341c-e130-42ff-b21e-5771ee0bebf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:39.650852 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-0be4341c-e130-42ff-b21e-5771ee0bebf8 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:39.652057 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-0be4341c-e130-42ff-b21e-5771ee0bebf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:39.679185 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:39.749295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:52:39.899020 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6309067-99ca-4bd8-a763-71b914e7611a None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:39.900529 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-c6309067-99ca-4bd8-a763-71b914e7611a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:40.045229 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6309067-99ca-4bd8-a763-71b914e7611a None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:40.086493 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:40.159599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd3dc3-c40d-4bc6-8696-80bed65d15b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:40.160217 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd3dc3-c40d-4bc6-8696-80bed65d15b4 service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:40.160498 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd3dc3-c40d-4bc6-8696-80bed65d15b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:40.160773 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd3dc3-c40d-4bc6-8696-80bed65d15b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:40.162676 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-84cd3dc3-c40d-4bc6-8696-80bed65d15b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:40.250026 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd3dc3-c40d-4bc6-8696-80bed65d15b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:40.251695 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd3dc3-c40d-4bc6-8696-80bed65d15b4 service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:40.269404 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 708/1419] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:41.152003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69c3f4-50b8-4b63-9ac6-39606c174147 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:41.152683 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69c3f4-50b8-4b63-9ac6-39606c174147 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:41.152683 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69c3f4-50b8-4b63-9ac6-39606c174147 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:41.153909 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:41.159104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659b87c-8149-4642-b8c8-a6ad67fc3e25 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:41.159583 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659b87c-8149-4642-b8c8-a6ad67fc3e25 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:41.159682 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659b87c-8149-4642-b8c8-a6ad67fc3e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:41.214987 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:41.236177 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-1659b87c-8149-4642-b8c8-a6ad67fc3e25 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:41.237395 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-1659b87c-8149-4642-b8c8-a6ad67fc3e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:41.334973 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:41.491508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69c3f4-50b8-4b63-9ac6-39606c174147 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:41.493732 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-fa69c3f4-50b8-4b63-9ac6-39606c174147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:41.637688 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69c3f4-50b8-4b63-9ac6-39606c174147 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:41.651183 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:41.749775 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83ceb0-ed99-4404-8e9a-026237889a9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:41.750306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83ceb0-ed99-4404-8e9a-026237889a9d service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:41.750588 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83ceb0-ed99-4404-8e9a-026237889a9d service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:41.750896 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83ceb0-ed99-4404-8e9a-026237889a9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:41.752503 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-eb83ceb0-ed99-4404-8e9a-026237889a9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:41.840186 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83ceb0-ed99-4404-8e9a-026237889a9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:41.841814 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83ceb0-ed99-4404-8e9a-026237889a9d service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:41.860328 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 713/1422] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:42.723257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61596279-9f67-4067-85d6-7ee9dd9c58f3 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:42.723821 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61596279-9f67-4067-85d6-7ee9dd9c58f3 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:42.723821 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61596279-9f67-4067-85d6-7ee9dd9c58f3 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:42.725166 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:42.730493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02fe1b-3540-434a-af8f-504ac0d8552e None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:42.730952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02fe1b-3540-434a-af8f-504ac0d8552e None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:42.731057 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02fe1b-3540-434a-af8f-504ac0d8552e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:42.750951 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:42.806143 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-ee02fe1b-3540-434a-af8f-504ac0d8552e None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:42.807368 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ee02fe1b-3540-434a-af8f-504ac0d8552e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:42.902480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:43.051446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61596279-9f67-4067-85d6-7ee9dd9c58f3 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:43.052879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-61596279-9f67-4067-85d6-7ee9dd9c58f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:43.161500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:43.198525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61596279-9f67-4067-85d6-7ee9dd9c58f3 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:43.309414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565096cc-304f-4390-92c9-4b223e308c2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:43.309967 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565096cc-304f-4390-92c9-4b223e308c2f service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:43.310252 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565096cc-304f-4390-92c9-4b223e308c2f service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:43.310527 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565096cc-304f-4390-92c9-4b223e308c2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:43.312264 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-565096cc-304f-4390-92c9-4b223e308c2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:43.387208 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:43.400224 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565096cc-304f-4390-92c9-4b223e308c2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:43.401821 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565096cc-304f-4390-92c9-4b223e308c2f service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:43.420180 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 711/1425] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:44.279151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4d242-2999-48a6-9c51-a4082705c36b None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:44.279707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4d242-2999-48a6-9c51-a4082705c36b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:44.279707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4d242-2999-48a6-9c51-a4082705c36b None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:44.281083 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:44.285898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba7d63-ecf6-4036-a794-f737a4f595d2 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:44.286323 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba7d63-ecf6-4036-a794-f737a4f595d2 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:44.286446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba7d63-ecf6-4036-a794-f737a4f595d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:44.361787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-a4ba7d63-ecf6-4036-a794-f737a4f595d2 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:44.363057 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a4ba7d63-ecf6-4036-a794-f737a4f595d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:44.458539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:52:44.607721 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4d242-2999-48a6-9c51-a4082705c36b None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:44.609239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-07e4d242-2999-48a6-9c51-a4082705c36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:44.692923 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:44.754805 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4d242-2999-48a6-9c51-a4082705c36b None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:44.869148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c752325-64d4-4306-8d33-e4a5518effa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:44.869753 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c752325-64d4-4306-8d33-e4a5518effa4 service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:44.870035 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c752325-64d4-4306-8d33-e4a5518effa4 service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:44.870311 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c752325-64d4-4306-8d33-e4a5518effa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:44.871977 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-2c752325-64d4-4306-8d33-e4a5518effa4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:44.919529 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:44.961146 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c752325-64d4-4306-8d33-e4a5518effa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:44.962725 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c752325-64d4-4306-8d33-e4a5518effa4 service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:44.980809 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 716/1428] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:45.834414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf35060-5ebd-406e-b015-cb2b22f1317e None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:45.834987 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf35060-5ebd-406e-b015-cb2b22f1317e None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:45.834987 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf35060-5ebd-406e-b015-cb2b22f1317e None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:45.836403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:45.841287 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ebc85-3a25-46c9-ab6e-0b4bef59c59c None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:45.841746 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ebc85-3a25-46c9-ab6e-0b4bef59c59c None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:45.841850 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ebc85-3a25-46c9-ab6e-0b4bef59c59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:45.916980 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-7b0ebc85-3a25-46c9-ab6e-0b4bef59c59c None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:45.918186 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-7b0ebc85-3a25-46c9-ab6e-0b4bef59c59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:46.013744 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:46.165369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf35060-5ebd-406e-b015-cb2b22f1317e None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:46.166938 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-baf35060-5ebd-406e-b015-cb2b22f1317e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:46.214898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:46.313493 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf35060-5ebd-406e-b015-cb2b22f1317e None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:46.424979 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1508bf-46d3-4aa6-975b-2a626ecdde6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:46.425597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1508bf-46d3-4aa6-975b-2a626ecdde6b service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:46.425884 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1508bf-46d3-4aa6-975b-2a626ecdde6b service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:46.426197 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1508bf-46d3-4aa6-975b-2a626ecdde6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:46.427910 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-6a1508bf-46d3-4aa6-975b-2a626ecdde6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:46.434882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:46.516742 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1508bf-46d3-4aa6-975b-2a626ecdde6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:46.518336 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1508bf-46d3-4aa6-975b-2a626ecdde6b service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:46.537388 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 714/1431] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:47.418280 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14d7fa-d5e4-426f-a4e4-1022796c3666 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:47.418833 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14d7fa-d5e4-426f-a4e4-1022796c3666 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:47.418933 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14d7fa-d5e4-426f-a4e4-1022796c3666 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:47.420231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:47.425102 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f57af5-a94d-429f-8520-60c2ca130a30 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:47.425544 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f57af5-a94d-429f-8520-60c2ca130a30 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:47.425673 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f57af5-a94d-429f-8520-60c2ca130a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:47.500724 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-71f57af5-a94d-429f-8520-60c2ca130a30 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:47.501926 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-71f57af5-a94d-429f-8520-60c2ca130a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:47.567714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:47.595217 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:47.748603 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14d7fa-d5e4-426f-a4e4-1022796c3666 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:47.750025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ed14d7fa-d5e4-426f-a4e4-1022796c3666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:47.767455 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:47.894863 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14d7fa-d5e4-426f-a4e4-1022796c3666 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:47.982795 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:48.008817 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7304d-06f7-4aba-b8d4-13783b2e4ea2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:48.009396 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7304d-06f7-4aba-b8d4-13783b2e4ea2 service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:48.009933 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7304d-06f7-4aba-b8d4-13783b2e4ea2 service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:48.010383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7304d-06f7-4aba-b8d4-13783b2e4ea2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:48.012303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-4ec7304d-06f7-4aba-b8d4-13783b2e4ea2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:48.100431 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7304d-06f7-4aba-b8d4-13783b2e4ea2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:48.102043 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7304d-06f7-4aba-b8d4-13783b2e4ea2 service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:48.119726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 719/1434] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:48.965310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5954e38-7561-45fc-9f4f-97e385b585da None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:48.971739 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5954e38-7561-45fc-9f4f-97e385b585da None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:48.971739 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5954e38-7561-45fc-9f4f-97e385b585da None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:48.971739 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:48.972430 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35cee9-3684-4be0-b7cc-2bfce2987e09 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:48.972821 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35cee9-3684-4be0-b7cc-2bfce2987e09 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:48.972987 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35cee9-3684-4be0-b7cc-2bfce2987e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:49.049118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-ef35cee9-3684-4be0-b7cc-2bfce2987e09 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:49.050331 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ef35cee9-3684-4be0-b7cc-2bfce2987e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:49.090811 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:49.146537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:49.296685 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5954e38-7561-45fc-9f4f-97e385b585da None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:49.298125 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-f5954e38-7561-45fc-9f4f-97e385b585da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:49.443413 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5954e38-7561-45fc-9f4f-97e385b585da None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:49.497086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:49.555244 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ce478-308e-4a31-ad4a-4d167e673d2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:49.555795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ce478-308e-4a31-ad4a-4d167e673d2c service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:49.556079 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ce478-308e-4a31-ad4a-4d167e673d2c service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:49.556355 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ce478-308e-4a31-ad4a-4d167e673d2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:49.558054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-908ce478-308e-4a31-ad4a-4d167e673d2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:49.647110 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ce478-308e-4a31-ad4a-4d167e673d2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:49.649330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ce478-308e-4a31-ad4a-4d167e673d2c service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:49.667393 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 717/1437] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:50.532278 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60150be-bb0d-4645-bfa5-b6de6c1e0649 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:50.532798 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60150be-bb0d-4645-bfa5-b6de6c1e0649 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:50.532906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60150be-bb0d-4645-bfa5-b6de6c1e0649 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:50.534233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:50.539863 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db9beb-48f1-47c4-91e1-b885dadc57bf None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:50.540283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db9beb-48f1-47c4-91e1-b885dadc57bf None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:50.540454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db9beb-48f1-47c4-91e1-b885dadc57bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:50.616392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-89db9beb-48f1-47c4-91e1-b885dadc57bf None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:50.618191 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-89db9beb-48f1-47c4-91e1-b885dadc57bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:50.620343 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:50.721114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:50.871385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60150be-bb0d-4645-bfa5-b6de6c1e0649 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:50.872971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e60150be-bb0d-4645-bfa5-b6de6c1e0649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:51.019034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60150be-bb0d-4645-bfa5-b6de6c1e0649 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:51.045871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:51.130164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d72d5f-60a9-47f3-87b6-e0893754ab6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:51.130810 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d72d5f-60a9-47f3-87b6-e0893754ab6b service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:51.131101 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d72d5f-60a9-47f3-87b6-e0893754ab6b service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:51.131380 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d72d5f-60a9-47f3-87b6-e0893754ab6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:51.133506 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b6d72d5f-60a9-47f3-87b6-e0893754ab6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:51.222499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d72d5f-60a9-47f3-87b6-e0893754ab6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:51.224126 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d72d5f-60a9-47f3-87b6-e0893754ab6b service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:51.241998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 722/1440] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:53.173818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c3a81-e409-47df-9105-b2fe8329ce61 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:53.174371 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c3a81-e409-47df-9105-b2fe8329ce61 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:53.174371 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c3a81-e409-47df-9105-b2fe8329ce61 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:53.175822 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:52:53.181662 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047475d-379c-45ac-9bd5-0631a7947348 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:53.182080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047475d-379c-45ac-9bd5-0631a7947348 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:53.182237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047475d-379c-45ac-9bd5-0631a7947348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:53.224302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:53.250223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-5047475d-379c-45ac-9bd5-0631a7947348 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:53.251922 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-5047475d-379c-45ac-9bd5-0631a7947348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:53.350255 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:53.388974 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c3a81-e409-47df-9105-b2fe8329ce61 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:53.390524 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-589c3a81-e409-47df-9105-b2fe8329ce61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:53.498154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c3a81-e409-47df-9105-b2fe8329ce61 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:53.530409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:53.574261 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7384740-2a71-4633-99f8-533bb74e9400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:53.574944 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7384740-2a71-4633-99f8-533bb74e9400 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:53.575228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7384740-2a71-4633-99f8-533bb74e9400 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:53.575507 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7384740-2a71-4633-99f8-533bb74e9400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:53.577147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e7384740-2a71-4633-99f8-533bb74e9400 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:53.685418 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7384740-2a71-4633-99f8-533bb74e9400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:53.686912 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7384740-2a71-4633-99f8-533bb74e9400 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:53.705918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 720/1443] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:55.850616 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335bc1e-4e6b-473b-8a36-dd836a331f52 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:55.851223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335bc1e-4e6b-473b-8a36-dd836a331f52 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:55.851223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335bc1e-4e6b-473b-8a36-dd836a331f52 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:55.852631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:55.857736 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd35505-f84b-4ba1-a462-2f4beac95055 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:55.858178 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd35505-f84b-4ba1-a462-2f4beac95055 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:55.858288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd35505-f84b-4ba1-a462-2f4beac95055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:55.923847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-0cd35505-f84b-4ba1-a462-2f4beac95055 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:55.925068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-0cd35505-f84b-4ba1-a462-2f4beac95055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:55.938196 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:56.021670 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:56.059927 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335bc1e-4e6b-473b-8a36-dd836a331f52 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:56.061472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b335bc1e-4e6b-473b-8a36-dd836a331f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:56.166443 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335bc1e-4e6b-473b-8a36-dd836a331f52 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:56.178433 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:56.239964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda5da7-6621-45d3-beef-332b47c06bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:56.240579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda5da7-6621-45d3-beef-332b47c06bfa service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:56.240857 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda5da7-6621-45d3-beef-332b47c06bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:56.241127 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda5da7-6621-45d3-beef-332b47c06bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:56.243328 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-2dda5da7-6621-45d3-beef-332b47c06bfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:56.351215 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda5da7-6621-45d3-beef-332b47c06bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:56.352692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda5da7-6621-45d3-beef-332b47c06bfa service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:56.371238 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 725/1446] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:58.698416 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029abec0-c466-43bc-bfb2-255d0348ebab None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:58.699012 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029abec0-c466-43bc-bfb2-255d0348ebab None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:58.699012 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029abec0-c466-43bc-bfb2-255d0348ebab None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:58.700406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:58.705529 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7361893-d314-40f3-a602-da92dbfc91a6 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:58.705926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7361893-d314-40f3-a602-da92dbfc91a6 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:58.706106 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7361893-d314-40f3-a602-da92dbfc91a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:58.754102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:58.771726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-e7361893-d314-40f3-a602-da92dbfc91a6 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:58.773609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e7361893-d314-40f3-a602-da92dbfc91a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:58.869640 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:58.908160 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029abec0-c466-43bc-bfb2-255d0348ebab None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:58.909709 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-029abec0-c466-43bc-bfb2-255d0348ebab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:59.012557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029abec0-c466-43bc-bfb2-255d0348ebab None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:59.052349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:59.087174 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de4e72-2e0b-4b4e-8334-6558a8a8962e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:59.087798 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de4e72-2e0b-4b4e-8334-6558a8a8962e service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:59.088083 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de4e72-2e0b-4b4e-8334-6558a8a8962e service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:59.088361 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de4e72-2e0b-4b4e-8334-6558a8a8962e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:59.090011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-69de4e72-2e0b-4b4e-8334-6558a8a8962e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:59.197584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de4e72-2e0b-4b4e-8334-6558a8a8962e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:59.199047 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de4e72-2e0b-4b4e-8334-6558a8a8962e service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:59.217584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 723/1449] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:01.326396 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6d9fd-1dcd-4653-a27b-5e6cf81af743 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:01.326972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6d9fd-1dcd-4653-a27b-5e6cf81af743 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:01.326972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6d9fd-1dcd-4653-a27b-5e6cf81af743 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:01.328343 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:01.333656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29396ed9-83c2-4a80-b637-32b7ae77220e None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:01.334058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29396ed9-83c2-4a80-b637-32b7ae77220e None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:01.334214 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29396ed9-83c2-4a80-b637-32b7ae77220e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:01.400844 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-29396ed9-83c2-4a80-b637-32b7ae77220e None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:01.402063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-29396ed9-83c2-4a80-b637-32b7ae77220e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:01.423486 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:01.498680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:01.538780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6d9fd-1dcd-4653-a27b-5e6cf81af743 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:01.540419 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-24c6d9fd-1dcd-4653-a27b-5e6cf81af743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:01.645846 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6d9fd-1dcd-4653-a27b-5e6cf81af743 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:01.666357 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:01.720675 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc5c4a-688a-4de5-a73f-d83c86279f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:01.721216 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc5c4a-688a-4de5-a73f-d83c86279f28 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:01.721498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc5c4a-688a-4de5-a73f-d83c86279f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:01.721772 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc5c4a-688a-4de5-a73f-d83c86279f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:01.723419 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-32dc5c4a-688a-4de5-a73f-d83c86279f28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:01.831813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc5c4a-688a-4de5-a73f-d83c86279f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:01.833237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc5c4a-688a-4de5-a73f-d83c86279f28 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:01.851703 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 728/1452] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:03.925017 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3c3a4-6708-45f0-833b-6af7805cbe06 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:03.925603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3c3a4-6708-45f0-833b-6af7805cbe06 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:03.925603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3c3a4-6708-45f0-833b-6af7805cbe06 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:03.927008 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:03.932345 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc09488-2216-4bb4-80a4-7f4f9439c08a None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:03.932765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc09488-2216-4bb4-80a4-7f4f9439c08a None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:03.932913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc09488-2216-4bb4-80a4-7f4f9439c08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:03.996473 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:03.999116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-dcc09488-2216-4bb4-80a4-7f4f9439c08a None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:04.000344 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-dcc09488-2216-4bb4-80a4-7f4f9439c08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:04.095950 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:04.133905 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3c3a4-6708-45f0-833b-6af7805cbe06 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:04.135478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-99c3c3a4-6708-45f0-833b-6af7805cbe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:04.239079 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3c3a4-6708-45f0-833b-6af7805cbe06 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:04.288680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:04.313341 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1a56f-447c-4923-8f63-888846763244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:04.313980 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1a56f-447c-4923-8f63-888846763244 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:04.314269 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1a56f-447c-4923-8f63-888846763244 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:04.314570 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1a56f-447c-4923-8f63-888846763244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:04.316269 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-8ab1a56f-447c-4923-8f63-888846763244 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:04.424121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1a56f-447c-4923-8f63-888846763244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:04.425562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1a56f-447c-4923-8f63-888846763244 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:04.443746 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 726/1455] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:06.487693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152e3a4-e5ec-4f61-a7b1-bdcbde26a7ed None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:06.488241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152e3a4-e5ec-4f61-a7b1-bdcbde26a7ed None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:06.488241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152e3a4-e5ec-4f61-a7b1-bdcbde26a7ed None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:06.489609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:06.494937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b5ec4-7417-42af-93fb-0e672e22ff27 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:06.495370 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b5ec4-7417-42af-93fb-0e672e22ff27 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:06.495507 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b5ec4-7417-42af-93fb-0e672e22ff27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:06.560972 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-055b5ec4-7417-42af-93fb-0e672e22ff27 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:06.562209 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-055b5ec4-7417-42af-93fb-0e672e22ff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:06.591455 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:06.658097 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:06.698105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152e3a4-e5ec-4f61-a7b1-bdcbde26a7ed None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:06.699710 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b152e3a4-e5ec-4f61-a7b1-bdcbde26a7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:06.804175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152e3a4-e5ec-4f61-a7b1-bdcbde26a7ed None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:06.832584 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:06.877350 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea756cc-7b44-48a8-af1f-b4eb3ed2eae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:06.877971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea756cc-7b44-48a8-af1f-b4eb3ed2eae8 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:06.878257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea756cc-7b44-48a8-af1f-b4eb3ed2eae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:06.878538 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea756cc-7b44-48a8-af1f-b4eb3ed2eae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:06.880234 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-cea756cc-7b44-48a8-af1f-b4eb3ed2eae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:06.988717 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea756cc-7b44-48a8-af1f-b4eb3ed2eae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:06.990143 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea756cc-7b44-48a8-af1f-b4eb3ed2eae8 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:07.008788 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 731/1458] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:09.083069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e48c9-f172-46a0-8149-79da772556b1 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:09.083661 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e48c9-f172-46a0-8149-79da772556b1 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:09.083661 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e48c9-f172-46a0-8149-79da772556b1 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:09.085029 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:09.090487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031388a0-8d89-4876-927f-cf6fb2cca5d9 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:09.090969 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031388a0-8d89-4876-927f-cf6fb2cca5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:09.091078 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031388a0-8d89-4876-927f-cf6fb2cca5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:09.157153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-031388a0-8d89-4876-927f-cf6fb2cca5d9 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:09.158370 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-031388a0-8d89-4876-927f-cf6fb2cca5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:09.167485 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:09.259991 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:09.297905 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e48c9-f172-46a0-8149-79da772556b1 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:09.299511 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-966e48c9-f172-46a0-8149-79da772556b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:09.400892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e48c9-f172-46a0-8149-79da772556b1 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:09.454284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:09.473231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02748ce6-60e2-43a8-b0ba-de936cc7cfc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:09.473838 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02748ce6-60e2-43a8-b0ba-de936cc7cfc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:09.474118 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02748ce6-60e2-43a8-b0ba-de936cc7cfc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:09.474389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02748ce6-60e2-43a8-b0ba-de936cc7cfc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:09.476649 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-02748ce6-60e2-43a8-b0ba-de936cc7cfc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:09.590220 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02748ce6-60e2-43a8-b0ba-de936cc7cfc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:09.591704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02748ce6-60e2-43a8-b0ba-de936cc7cfc9 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:09.610463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 729/1461] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:11.635378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4d117-e82f-4fcd-89be-2165af66aa70 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:11.635939 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4d117-e82f-4fcd-89be-2165af66aa70 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:11.635939 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4d117-e82f-4fcd-89be-2165af66aa70 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:11.637315 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:11.642653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d050daf-3524-44bd-82d2-23dbc8fcf1d5 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:11.643120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d050daf-3524-44bd-82d2-23dbc8fcf1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:11.643250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d050daf-3524-44bd-82d2-23dbc8fcf1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:11.710146 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-3d050daf-3524-44bd-82d2-23dbc8fcf1d5 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:11.711379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3d050daf-3524-44bd-82d2-23dbc8fcf1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:11.748622 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:11.806859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:11.846749 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4d117-e82f-4fcd-89be-2165af66aa70 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:11.848355 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-3ae4d117-e82f-4fcd-89be-2165af66aa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:11.952032 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4d117-e82f-4fcd-89be-2165af66aa70 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:11.989341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:12.025203 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4b006-ed91-44eb-9e47-6336a8791e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:12.025812 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4b006-ed91-44eb-9e47-6336a8791e02 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:12.026092 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4b006-ed91-44eb-9e47-6336a8791e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:12.026367 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4b006-ed91-44eb-9e47-6336a8791e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:12.028001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-3ed4b006-ed91-44eb-9e47-6336a8791e02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:12.135370 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4b006-ed91-44eb-9e47-6336a8791e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:12.136797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4b006-ed91-44eb-9e47-6336a8791e02 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:12.156019 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 734/1464] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:14.150946 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d2c2b-1b54-417c-a40c-97890fea6ac1 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:14.151498 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d2c2b-1b54-417c-a40c-97890fea6ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:14.151498 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d2c2b-1b54-417c-a40c-97890fea6ac1 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:14.153044 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:14.158212 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19750d00-c200-4930-82a3-8bed6510f258 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:14.158643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19750d00-c200-4930-82a3-8bed6510f258 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:14.158802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19750d00-c200-4930-82a3-8bed6510f258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:14.227292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-19750d00-c200-4930-82a3-8bed6510f258 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:14.228555 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-19750d00-c200-4930-82a3-8bed6510f258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:14.248090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:14.329055 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:14.365672 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d2c2b-1b54-417c-a40c-97890fea6ac1 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:14.367251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-0b1d2c2b-1b54-417c-a40c-97890fea6ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:14.470909 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d2c2b-1b54-417c-a40c-97890fea6ac1 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:14.535588 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:14.542546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4542f-372b-4bf7-828c-a25a9200592b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:14.543254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4542f-372b-4bf7-828c-a25a9200592b service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:14.543534 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4542f-372b-4bf7-828c-a25a9200592b service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:14.543805 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4542f-372b-4bf7-828c-a25a9200592b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:14.545710 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-faa4542f-372b-4bf7-828c-a25a9200592b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:14.653561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4542f-372b-4bf7-828c-a25a9200592b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:14.655038 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4542f-372b-4bf7-828c-a25a9200592b service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:14.674502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 732/1467] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:16.701960 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740264ca-c1cb-4600-81f1-5dba2cb83977 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:16.702517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740264ca-c1cb-4600-81f1-5dba2cb83977 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:16.702517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740264ca-c1cb-4600-81f1-5dba2cb83977 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:16.703878 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:53:16.709778 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f982f-dffb-461f-a680-ef9b17c5e072 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:16.710202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f982f-dffb-461f-a680-ef9b17c5e072 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:16.710388 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f982f-dffb-461f-a680-ef9b17c5e072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:16.775928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-054f982f-dffb-461f-a680-ef9b17c5e072 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:16.777064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-054f982f-dffb-461f-a680-ef9b17c5e072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:16.824851 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:16.873215 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:16.909915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740264ca-c1cb-4600-81f1-5dba2cb83977 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:16.911520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-740264ca-c1cb-4600-81f1-5dba2cb83977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:17.014639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740264ca-c1cb-4600-81f1-5dba2cb83977 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:17.061715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:17.088521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec64e9-a384-419e-891a-590aba62978d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:17.089421 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec64e9-a384-419e-891a-590aba62978d service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:17.089878 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec64e9-a384-419e-891a-590aba62978d service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:17.090202 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec64e9-a384-419e-891a-590aba62978d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:17.092111 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-4dec64e9-a384-419e-891a-590aba62978d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:17.201311 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec64e9-a384-419e-891a-590aba62978d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:17.202772 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec64e9-a384-419e-891a-590aba62978d service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:17.222232 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 737/1470] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:26.871472 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=22 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:27.219936 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=66 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:36.760724 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf4b99-eab4-463e-8c99-a291acf07ea9 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:36.761286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf4b99-eab4-463e-8c99-a291acf07ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:36.761286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf4b99-eab4-463e-8c99-a291acf07ea9 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:36.762657 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 734/1471] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:36.767896 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1532df2-4157-4d62-ad4d-5732134a57ce None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:36.768347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1532df2-4157-4d62-ad4d-5732134a57ce None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:36.768467 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1532df2-4157-4d62-ad4d-5732134a57ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:36.834067 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-d1532df2-4157-4d62-ad4d-5732134a57ce None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:36.835236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d1532df2-4157-4d62-ad4d-5732134a57ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:36.931148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 738/1472] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:37.017356 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9eed2-1f84-4fc8-9645-52e4a8005a14 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:37.017655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9eed2-1f84-4fc8-9645-52e4a8005a14 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:37.017937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9eed2-1f84-4fc8-9645-52e4a8005a14 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:37.019328 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 735/1473] 10.222.0.64 () {54 vars in 966 bytes} [Wed Aug 3 12:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:37.024574 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b74efb-2105-4831-8180-dbc33f33027f None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:37.024868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b74efb-2105-4831-8180-dbc33f33027f None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:37.025144 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b74efb-2105-4831-8180-dbc33f33027f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:37.100691 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-76b74efb-2105-4831-8180-dbc33f33027f None None] MFA Rules not processed for user `74b99f03a7c14a2e89384dcca532dc61`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:37.101844 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-76b74efb-2105-4831-8180-dbc33f33027f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:37.122392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:37.178536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 739/1474] 10.222.0.64 () {58 vars in 1063 bytes} [Wed Aug 3 12:53:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:37.186327 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9eed2-1f84-4fc8-9645-52e4a8005a14 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:37.187914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-32d9eed2-1f84-4fc8-9645-52e4a8005a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:37.290417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9eed2-1f84-4fc8-9645-52e4a8005a14 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:37.362155 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b35814-4390-4812-8387-d3229759339c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b99f03a7c14a2e89384dcca532dc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:37.362704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b35814-4390-4812-8387-d3229759339c service glance] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:37.363026 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b35814-4390-4812-8387-d3229759339c service glance] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:37.363303 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b35814-4390-4812-8387-d3229759339c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:37.364943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-88b35814-4390-4812-8387-d3229759339c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:37.419438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:37.473804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b35814-4390-4812-8387-d3229759339c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:37.475881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b35814-4390-4812-8387-d3229759339c service glance] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:37.494082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 736/1475] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:39.580275 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6334bd-0d79-426b-b263-1e550466558d None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:39.580820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6334bd-0d79-426b-b263-1e550466558d None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:39.580913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6334bd-0d79-426b-b263-1e550466558d None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:39.582258 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 740/1476] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:39.587533 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8de1f7-7b42-4d17-a6a3-404c251057d0 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:39.587943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8de1f7-7b42-4d17-a6a3-404c251057d0 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:39.588096 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8de1f7-7b42-4d17-a6a3-404c251057d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:39.655609 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-5d8de1f7-7b42-4d17-a6a3-404c251057d0 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:39.656850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-5d8de1f7-7b42-4d17-a6a3-404c251057d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:39.752450 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 737/1477] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:39.775475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6334bd-0d79-426b-b263-1e550466558d None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:39.776998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-7d6334bd-0d79-426b-b263-1e550466558d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:39.904257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6334bd-0d79-426b-b263-1e550466558d None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:39.956133 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:40.001619 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a33bcb-9f0d-4acb-8c33-2d8eeaee56d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:40.002455 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a33bcb-9f0d-4acb-8c33-2d8eeaee56d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:40.002971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a33bcb-9f0d-4acb-8c33-2d8eeaee56d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:40.003295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a33bcb-9f0d-4acb-8c33-2d8eeaee56d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:40.004325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a33bcb-9f0d-4acb-8c33-2d8eeaee56d5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:40.006072 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: WARNING py.warnings [None req-e3a33bcb-9f0d-4acb-8c33-2d8eeaee56d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:53:40.006072 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: warnings.warn(msg) Aug 03 12:53:40.006072 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: Aug 03 12:53:40.007254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a33bcb-9f0d-4acb-8c33-2d8eeaee56d5 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:40.025709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 741/1478] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Aug 3 12:53:39 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:53:42.037205 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cc58a-cf52-479b-86ff-e12653f1b527 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:42.037849 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cc58a-cf52-479b-86ff-e12653f1b527 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:42.037849 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cc58a-cf52-479b-86ff-e12653f1b527 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:42.039135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 738/1479] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:42.044152 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20ec7d-080b-48d5-9700-786edae288f3 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:42.044551 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20ec7d-080b-48d5-9700-786edae288f3 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:42.044703 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20ec7d-080b-48d5-9700-786edae288f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:42.109639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-5f20ec7d-080b-48d5-9700-786edae288f3 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:42.110871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-5f20ec7d-080b-48d5-9700-786edae288f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:42.207552 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 742/1480] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:42.250069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cc58a-cf52-479b-86ff-e12653f1b527 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:42.251626 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-790cc58a-cf52-479b-86ff-e12653f1b527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:42.262155 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:42.397038 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cc58a-cf52-479b-86ff-e12653f1b527 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:42.475140 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:42.508448 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea73a49-459e-4d49-b3d4-bc8a6c566c8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:42.509063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea73a49-459e-4d49-b3d4-bc8a6c566c8c service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:42.509349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea73a49-459e-4d49-b3d4-bc8a6c566c8c service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:42.509629 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea73a49-459e-4d49-b3d4-bc8a6c566c8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:42.511289 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-9ea73a49-459e-4d49-b3d4-bc8a6c566c8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:42.598875 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea73a49-459e-4d49-b3d4-bc8a6c566c8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:42.600396 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea73a49-459e-4d49-b3d4-bc8a6c566c8c service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:42.618305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 739/1481] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:44.771340 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5d208-2477-4337-acc4-d6652de45574 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:44.771911 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5d208-2477-4337-acc4-d6652de45574 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:44.771911 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5d208-2477-4337-acc4-d6652de45574 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:44.773290 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 743/1482] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:44.778333 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afe497-553c-4f54-837a-8e7b240584b4 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:44.778783 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afe497-553c-4f54-837a-8e7b240584b4 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:44.778948 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afe497-553c-4f54-837a-8e7b240584b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:44.845960 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-21afe497-553c-4f54-837a-8e7b240584b4 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:44.847240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-21afe497-553c-4f54-837a-8e7b240584b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:44.893321 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:44.943372 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 740/1483] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:44.979282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5d208-2477-4337-acc4-d6652de45574 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:44.980856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-89f5d208-2477-4337-acc4-d6652de45574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:45.004411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:45.084507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5d208-2477-4337-acc4-d6652de45574 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:45.156720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae3c92-20c6-4c01-b840-632db01a2112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:45.157345 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae3c92-20c6-4c01-b840-632db01a2112 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:45.157631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae3c92-20c6-4c01-b840-632db01a2112 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:45.157912 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae3c92-20c6-4c01-b840-632db01a2112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:45.159581 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-2fae3c92-20c6-4c01-b840-632db01a2112 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:45.235738 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:45.270326 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae3c92-20c6-4c01-b840-632db01a2112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:45.271810 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae3c92-20c6-4c01-b840-632db01a2112 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:45.291529 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 744/1484] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:47.322235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d42d4d-cd2a-4c65-ae39-0e7a834269e0 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:47.322789 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d42d4d-cd2a-4c65-ae39-0e7a834269e0 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:47.322907 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d42d4d-cd2a-4c65-ae39-0e7a834269e0 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:47.324190 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 741/1485] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:47.329463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a87ce-bb50-4568-9499-bdb4012efbed None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:47.329912 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a87ce-bb50-4568-9499-bdb4012efbed None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:47.330020 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a87ce-bb50-4568-9499-bdb4012efbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:47.395159 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-5b3a87ce-bb50-4568-9499-bdb4012efbed None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:47.396916 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-5b3a87ce-bb50-4568-9499-bdb4012efbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:47.493256 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 745/1486] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:47.532408 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d42d4d-cd2a-4c65-ae39-0e7a834269e0 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:47.541692 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-00d42d4d-cd2a-4c65-ae39-0e7a834269e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:47.640055 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d42d4d-cd2a-4c65-ae39-0e7a834269e0 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:47.712367 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:47.714150 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19232680-39ac-425f-b5f6-adbd357769d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:47.714795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19232680-39ac-425f-b5f6-adbd357769d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:47.715083 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19232680-39ac-425f-b5f6-adbd357769d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:47.715359 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19232680-39ac-425f-b5f6-adbd357769d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:47.722193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-19232680-39ac-425f-b5f6-adbd357769d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:47.825701 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19232680-39ac-425f-b5f6-adbd357769d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:47.827209 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19232680-39ac-425f-b5f6-adbd357769d2 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:47.844913 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 742/1487] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:50.005226 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b89b0-523d-4724-a3c5-a6606971ee04 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:50.005877 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b89b0-523d-4724-a3c5-a6606971ee04 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:50.005877 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b89b0-523d-4724-a3c5-a6606971ee04 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:50.007190 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 746/1488] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:50.012405 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7dd9c-f3d0-467f-8330-d8e10490ff69 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:50.012814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7dd9c-f3d0-467f-8330-d8e10490ff69 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:50.012961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7dd9c-f3d0-467f-8330-d8e10490ff69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:50.078303 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-abc7dd9c-f3d0-467f-8330-d8e10490ff69 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:50.079573 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-abc7dd9c-f3d0-467f-8330-d8e10490ff69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:50.132434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:50.177105 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 743/1489] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:50.218099 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b89b0-523d-4724-a3c5-a6606971ee04 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:50.219648 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-110b89b0-523d-4724-a3c5-a6606971ee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:50.255796 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:50.323170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b89b0-523d-4724-a3c5-a6606971ee04 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:50.398784 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e42b24-315d-4a12-a22f-9e13019e459d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:50.399686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e42b24-315d-4a12-a22f-9e13019e459d service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:50.399975 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e42b24-315d-4a12-a22f-9e13019e459d service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:50.400252 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e42b24-315d-4a12-a22f-9e13019e459d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:50.401914 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-a8e42b24-315d-4a12-a22f-9e13019e459d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:50.484554 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:50.515301 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e42b24-315d-4a12-a22f-9e13019e459d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:50.516660 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e42b24-315d-4a12-a22f-9e13019e459d service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:50.534193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 747/1490] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:52.942824 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32db31-1843-4398-aa29-84f7f03304ab None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:52.943393 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32db31-1843-4398-aa29-84f7f03304ab None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:52.943393 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32db31-1843-4398-aa29-84f7f03304ab None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:52.944746 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 744/1491] 10.222.0.64 () {54 vars in 926 bytes} [Wed Aug 3 12:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:52.949975 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2cfd2-998e-458c-bf64-fdc5d9e6fa68 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:52.950371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2cfd2-998e-458c-bf64-fdc5d9e6fa68 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:52.950544 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2cfd2-998e-458c-bf64-fdc5d9e6fa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:53.015932 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-7aa2cfd2-998e-458c-bf64-fdc5d9e6fa68 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:53.017148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-7aa2cfd2-998e-458c-bf64-fdc5d9e6fa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:53.112897 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 748/1492] 10.222.0.64 () {58 vars in 1023 bytes} [Wed Aug 3 12:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:53.151989 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32db31-1843-4398-aa29-84f7f03304ab None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:53.153599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-fa32db31-1843-4398-aa29-84f7f03304ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:53.257277 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32db31-1843-4398-aa29-84f7f03304ab None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:53.329548 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961c76a-4f4b-435c-917e-e4df9decb37c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:53.330161 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961c76a-4f4b-435c-917e-e4df9decb37c service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:53.330451 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961c76a-4f4b-435c-917e-e4df9decb37c service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:53.330752 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961c76a-4f4b-435c-917e-e4df9decb37c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:53.332398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3961c76a-4f4b-435c-917e-e4df9decb37c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:53.346583 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:53.449860 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961c76a-4f4b-435c-917e-e4df9decb37c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:53.451337 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961c76a-4f4b-435c-917e-e4df9decb37c service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:53.469585 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 745/1493] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:54:03.111107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=82 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:03.467311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=50 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:35.993892 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e3d02-174f-42cd-9c93-44921d7c924d None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:35.994485 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e3d02-174f-42cd-9c93-44921d7c924d None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:35.994485 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e3d02-174f-42cd-9c93-44921d7c924d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:36.068675 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-b43e3d02-174f-42cd-9c93-44921d7c924d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:55:36.069897 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b43e3d02-174f-42cd-9c93-44921d7c924d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:36.173916 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 749/1494] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:55:36.181973 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4531496-a293-4453-9e01-101e50e9925f None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:36.182431 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4531496-a293-4453-9e01-101e50e9925f None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:36.182546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4531496-a293-4453-9e01-101e50e9925f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:36.257644 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-b4531496-a293-4453-9e01-101e50e9925f None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:55:36.258817 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b4531496-a293-4453-9e01-101e50e9925f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:36.354876 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 746/1495] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:55:36.359489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e3d02-174f-42cd-9c93-44921d7c924d None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:36.360728 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b43e3d02-174f-42cd-9c93-44921d7c924d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:36.372102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e3d02-174f-42cd-9c93-44921d7c924d None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:36.432740 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:36.468774 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183115d-15bd-4d59-af50-e260db5cf52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:36.469422 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183115d-15bd-4d59-af50-e260db5cf52a admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:36.469706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183115d-15bd-4d59-af50-e260db5cf52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:36.470037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183115d-15bd-4d59-af50-e260db5cf52a admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:36.470757 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183115d-15bd-4d59-af50-e260db5cf52a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:55:36.471065 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183115d-15bd-4d59-af50-e260db5cf52a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:36.472070 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: WARNING py.warnings [None req-b183115d-15bd-4d59-af50-e260db5cf52a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:55:36.472070 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: warnings.warn(msg) Aug 03 12:55:36.472070 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: Aug 03 12:55:36.472957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183115d-15bd-4d59-af50-e260db5cf52a admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:36.483934 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 750/1496] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 12:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:55:36.492261 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4531496-a293-4453-9e01-101e50e9925f None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:36.501904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4531496-a293-4453-9e01-101e50e9925f None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:36.562329 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:36.596576 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989eb20-1142-4027-8523-0d2beda4f162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:36.597196 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989eb20-1142-4027-8523-0d2beda4f162 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:36.597476 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989eb20-1142-4027-8523-0d2beda4f162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:36.597750 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989eb20-1142-4027-8523-0d2beda4f162 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:36.598412 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989eb20-1142-4027-8523-0d2beda4f162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:36.600291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: WARNING py.warnings [None req-e989eb20-1142-4027-8523-0d2beda4f162 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:55:36.600291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: warnings.warn(msg) Aug 03 12:55:36.600291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: Aug 03 12:55:36.601482 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989eb20-1142-4027-8523-0d2beda4f162 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:36.721450 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 747/1497] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:55:36 2022] POST /identity/v3/projects => generated 377 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:55:36.725615 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183115d-15bd-4d59-af50-e260db5cf52a admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:36.727162 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b183115d-15bd-4d59-af50-e260db5cf52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:36.761994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183115d-15bd-4d59-af50-e260db5cf52a admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:36.854269 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c952bb-aef6-4954-9021-5f30d32f21d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:36.854883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c952bb-aef6-4954-9021-5f30d32f21d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:36.855168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c952bb-aef6-4954-9021-5f30d32f21d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:36.855449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c952bb-aef6-4954-9021-5f30d32f21d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:36.856125 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c952bb-aef6-4954-9021-5f30d32f21d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:36.857131 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: WARNING py.warnings [None req-51c952bb-aef6-4954-9021-5f30d32f21d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:55:36.857131 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: warnings.warn(msg) Aug 03 12:55:36.857131 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: Aug 03 12:55:36.858353 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c952bb-aef6-4954-9021-5f30d32f21d4 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:36.955405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 751/1498] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:55:36 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:55:36.959679 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989eb20-1142-4027-8523-0d2beda4f162 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:36.961219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e989eb20-1142-4027-8523-0d2beda4f162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:37.022602 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989eb20-1142-4027-8523-0d2beda4f162 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:37.104375 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:37.115121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879f6ca-5d09-4e20-a98a-6ddead2372da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:37.115742 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879f6ca-5d09-4e20-a98a-6ddead2372da admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:37.116024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879f6ca-5d09-4e20-a98a-6ddead2372da admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:37.116301 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879f6ca-5d09-4e20-a98a-6ddead2372da admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:37.116995 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879f6ca-5d09-4e20-a98a-6ddead2372da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:37.118015 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: WARNING py.warnings [None req-9879f6ca-5d09-4e20-a98a-6ddead2372da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:55:37.118015 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: warnings.warn(msg) Aug 03 12:55:37.118015 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: Aug 03 12:55:37.118933 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879f6ca-5d09-4e20-a98a-6ddead2372da admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:37.131250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 748/1499] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:55:37.135297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c952bb-aef6-4954-9021-5f30d32f21d4 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:37.136887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-51c952bb-aef6-4954-9021-5f30d32f21d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:37.148634 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c952bb-aef6-4954-9021-5f30d32f21d4 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:37.175280 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:37.244919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a8094-95a9-461a-b389-d2095360f3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:37.245539 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a8094-95a9-461a-b389-d2095360f3fb admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:37.245824 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a8094-95a9-461a-b389-d2095360f3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:37.246092 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a8094-95a9-461a-b389-d2095360f3fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:37.246811 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a8094-95a9-461a-b389-d2095360f3fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:37.247809 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: WARNING py.warnings [None req-260a8094-95a9-461a-b389-d2095360f3fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:55:37.247809 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: warnings.warn(msg) Aug 03 12:55:37.247809 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: Aug 03 12:55:37.248684 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a8094-95a9-461a-b389-d2095360f3fb admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:37.260737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 752/1500] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:55:37.264930 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879f6ca-5d09-4e20-a98a-6ddead2372da admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:37.266459 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-9879f6ca-5d09-4e20-a98a-6ddead2372da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:37.300655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879f6ca-5d09-4e20-a98a-6ddead2372da admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:37.391591 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acadfd8-0778-43ec-b39d-9317bcd479e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:37.392197 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acadfd8-0778-43ec-b39d-9317bcd479e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:37.392487 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acadfd8-0778-43ec-b39d-9317bcd479e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:37.392770 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acadfd8-0778-43ec-b39d-9317bcd479e0 admin admin] PATH_INFO: `/v3/projects/ad76e5b9ef1e4f6f838cc419d0d529d7/users/fac4ecced97f4d61af68a231e0c39a79/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:37.415201 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acadfd8-0778-43ec-b39d-9317bcd479e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad76e5b9ef1e4f6f838cc419d0d529d7, user_id=fac4ecced97f4d61af68a231e0c39a79, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:37.416272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: WARNING py.warnings [None req-8acadfd8-0778-43ec-b39d-9317bcd479e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:55:37.416272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: warnings.warn(msg) Aug 03 12:55:37.416272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: Aug 03 12:55:37.418200 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acadfd8-0778-43ec-b39d-9317bcd479e0 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:37.533065 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 749/1501] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:55:37 2022] PUT /identity/v3/projects/ad76e5b9ef1e4f6f838cc419d0d529d7/users/fac4ecced97f4d61af68a231e0c39a79/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:55:37.545532 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6f4cb-dd5d-4aba-a677-cf645413c04d None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:37.545823 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6f4cb-dd5d-4aba-a677-cf645413c04d None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:37.546103 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6f4cb-dd5d-4aba-a677-cf645413c04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:37.603349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-37b6f4cb-dd5d-4aba-a677-cf645413c04d None None] MFA Rules not processed for user `fac4ecced97f4d61af68a231e0c39a79`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:55:37.604616 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-37b6f4cb-dd5d-4aba-a677-cf645413c04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:37.682428 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 753/1502] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:55:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:55:37.695603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81535d68-915b-47b1-b1d5-f805ff84041f None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:37.695902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81535d68-915b-47b1-b1d5-f805ff84041f None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:37.696187 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81535d68-915b-47b1-b1d5-f805ff84041f None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:37.697536 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 750/1503] 10.222.0.64 () {54 vars in 964 bytes} [Wed Aug 3 12:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:55:37.702106 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba595a5-adbc-4a1f-b109-858835da74ec None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:37.702397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba595a5-adbc-4a1f-b109-858835da74ec None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:37.702682 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba595a5-adbc-4a1f-b109-858835da74ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:37.734925 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:37.780046 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-0ba595a5-adbc-4a1f-b109-858835da74ec None None] MFA Rules not processed for user `19337279eb414e62b529feb6e7c9b1b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:55:37.781263 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-0ba595a5-adbc-4a1f-b109-858835da74ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:37.856755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 754/1504] 10.222.0.64 () {58 vars in 1061 bytes} [Wed Aug 3 12:55:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:55:37.864508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81535d68-915b-47b1-b1d5-f805ff84041f None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:37.866038 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-81535d68-915b-47b1-b1d5-f805ff84041f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:37.917095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:37.970046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81535d68-915b-47b1-b1d5-f805ff84041f None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:38.044893 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cea8c-8119-4901-b5a7-8ffa0a9f905b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:38.045512 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cea8c-8119-4901-b5a7-8ffa0a9f905b service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:38.045799 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cea8c-8119-4901-b5a7-8ffa0a9f905b service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:38.046079 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cea8c-8119-4901-b5a7-8ffa0a9f905b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:38.047740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-bd5cea8c-8119-4901-b5a7-8ffa0a9f905b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:38.145082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cea8c-8119-4901-b5a7-8ffa0a9f905b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:38.146528 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cea8c-8119-4901-b5a7-8ffa0a9f905b service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:38.150119 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:38.165131 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 751/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:55:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:55:38.210569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199441fe-f1ac-41b8-89a8-bc449362b469 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:38.211005 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199441fe-f1ac-41b8-89a8-bc449362b469 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:38.211182 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199441fe-f1ac-41b8-89a8-bc449362b469 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:38.212450 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 755/1506] 10.222.0.64 () {52 vars in 830 bytes} [Wed Aug 3 12:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:55:38.215970 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cea8c-8119-4901-b5a7-8ffa0a9f905b service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:38.217213 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-bd5cea8c-8119-4901-b5a7-8ffa0a9f905b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:38.315566 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cea8c-8119-4901-b5a7-8ffa0a9f905b service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:38.406723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea10e2-a4ef-4a11-9911-35aa17345c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:38.407396 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea10e2-a4ef-4a11-9911-35aa17345c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:38.407673 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea10e2-a4ef-4a11-9911-35aa17345c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:38.407942 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea10e2-a4ef-4a11-9911-35aa17345c9b admin admin] PATH_INFO: `/v3/users/fac4ecced97f4d61af68a231e0c39a79` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:38.419969 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea10e2-a4ef-4a11-9911-35aa17345c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fac4ecced97f4d61af68a231e0c39a79)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:38.421021 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: WARNING py.warnings [None req-8aea10e2-a4ef-4a11-9911-35aa17345c9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:55:38.421021 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: warnings.warn(msg) Aug 03 12:55:38.421021 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: Aug 03 12:55:38.422222 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea10e2-a4ef-4a11-9911-35aa17345c9b admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:38.432183 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:38.677245 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-8aea10e2-a4ef-4a11-9911-35aa17345c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fac4ecced97f4d61af68a231e0c39a79'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:55:38.691497 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-8aea10e2-a4ef-4a11-9911-35aa17345c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fac4ecced97f4d61af68a231e0c39a79'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:55:38.748684 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-8aea10e2-a4ef-4a11-9911-35aa17345c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fac4ecced97f4d61af68a231e0c39a79'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:55:38.749269 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-8aea10e2-a4ef-4a11-9911-35aa17345c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fac4ecced97f4d61af68a231e0c39a79'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:55:38.772920 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-8aea10e2-a4ef-4a11-9911-35aa17345c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fac4ecced97f4d61af68a231e0c39a79'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:55:38.778542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 752/1507] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 12:55:38 2022] DELETE /identity/v3/users/fac4ecced97f4d61af68a231e0c39a79 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:55:38.783540 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bf980-4862-4bb7-8920-7776ce216a69 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:38.783831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bf980-4862-4bb7-8920-7776ce216a69 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:38.784112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bf980-4862-4bb7-8920-7776ce216a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:38.839768 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-403bf980-4862-4bb7-8920-7776ce216a69 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:55:38.840977 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-403bf980-4862-4bb7-8920-7776ce216a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:38.915506 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:38.928779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 756/1508] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:55:38.938264 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea10e2-a4ef-4a11-9911-35aa17345c9b admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:38.939526 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-8aea10e2-a4ef-4a11-9911-35aa17345c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:39.038696 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea10e2-a4ef-4a11-9911-35aa17345c9b admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:39.093886 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:39.112883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5f247-5f89-4b81-b17e-44ae4407f5ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:39.113506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5f247-5f89-4b81-b17e-44ae4407f5ce service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:39.113794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5f247-5f89-4b81-b17e-44ae4407f5ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:39.114074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5f247-5f89-4b81-b17e-44ae4407f5ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:39.115752 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-c5d5f247-5f89-4b81-b17e-44ae4407f5ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:39.224892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5f247-5f89-4b81-b17e-44ae4407f5ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:39.226268 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5f247-5f89-4b81-b17e-44ae4407f5ce service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:39.244433 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 753/1509] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:55:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:55:39.796682 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bf980-4862-4bb7-8920-7776ce216a69 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:39.798457 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-403bf980-4862-4bb7-8920-7776ce216a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:39.810193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bf980-4862-4bb7-8920-7776ce216a69 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:39.905977 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfade7-f2e7-459b-8b16-66ddcdb37288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:39.906621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfade7-f2e7-459b-8b16-66ddcdb37288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:39.906932 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfade7-f2e7-459b-8b16-66ddcdb37288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:39.907212 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfade7-f2e7-459b-8b16-66ddcdb37288 admin admin] PATH_INFO: `/v3/projects/ad76e5b9ef1e4f6f838cc419d0d529d7` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:39.917185 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfade7-f2e7-459b-8b16-66ddcdb37288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad76e5b9ef1e4f6f838cc419d0d529d7)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:39.918205 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: WARNING py.warnings [None req-d1cfade7-f2e7-459b-8b16-66ddcdb37288 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:55:39.918205 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: warnings.warn(msg) Aug 03 12:55:39.918205 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: Aug 03 12:55:39.919455 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfade7-f2e7-459b-8b16-66ddcdb37288 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:40.050616 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d1cfade7-f2e7-459b-8b16-66ddcdb37288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad76e5b9ef1e4f6f838cc419d0d529d7', 'request_id': 'req-d1cfade7-f2e7-459b-8b16-66ddcdb37288'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:55:40.064299 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d1cfade7-f2e7-459b-8b16-66ddcdb37288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad76e5b9ef1e4f6f838cc419d0d529d7', 'request_id': 'req-d1cfade7-f2e7-459b-8b16-66ddcdb37288'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:55:40.120042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d1cfade7-f2e7-459b-8b16-66ddcdb37288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad76e5b9ef1e4f6f838cc419d0d529d7', 'request_id': 'req-d1cfade7-f2e7-459b-8b16-66ddcdb37288'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:55:40.142455 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d1cfade7-f2e7-459b-8b16-66ddcdb37288 admin admin] The token cache is being invalidate because project ad76e5b9ef1e4f6f838cc419d0d529d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:55:40.142771 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d1cfade7-f2e7-459b-8b16-66ddcdb37288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:55:40.143216 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d1cfade7-f2e7-459b-8b16-66ddcdb37288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:55:40.144662 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 757/1510] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 12:55:39 2022] DELETE /identity/v3/projects/ad76e5b9ef1e4f6f838cc419d0d529d7 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:55:49.242237 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=62 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:50.140613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:21.053791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a74ada-a898-4aa4-9bcd-d40b7e433f95 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:21.054349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a74ada-a898-4aa4-9bcd-d40b7e433f95 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:21.054349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a74ada-a898-4aa4-9bcd-d40b7e433f95 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:21.055761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:57:21.060784 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3292c4-8f4e-4261-9446-c7e65f7535e2 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:21.061207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3292c4-8f4e-4261-9446-c7e65f7535e2 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:21.061342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3292c4-8f4e-4261-9446-c7e65f7535e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:21.143238 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-9f3292c4-8f4e-4261-9446-c7e65f7535e2 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:57:21.144450 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-9f3292c4-8f4e-4261-9446-c7e65f7535e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:21.254681 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:57:21.406340 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a74ada-a898-4aa4-9bcd-d40b7e433f95 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:21.409014 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-08a74ada-a898-4aa4-9bcd-d40b7e433f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:21.528466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a74ada-a898-4aa4-9bcd-d40b7e433f95 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:21.534823 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104f102-60eb-4325-bedd-2c58597c1579 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:21.535440 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104f102-60eb-4325-bedd-2c58597c1579 service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:21.535727 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104f102-60eb-4325-bedd-2c58597c1579 service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:21.536005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104f102-60eb-4325-bedd-2c58597c1579 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:21.544020 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104f102-60eb-4325-bedd-2c58597c1579 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:21.545607 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104f102-60eb-4325-bedd-2c58597c1579 service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:21.555589 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 755/1513] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:57:22.386853 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320f98b-657f-41b0-b8c5-a0403717c25e None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:22.387385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320f98b-657f-41b0-b8c5-a0403717c25e None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:22.387501 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320f98b-657f-41b0-b8c5-a0403717c25e None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:22.388782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:57:22.393511 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60326fe-f31c-42b7-bbf9-0afc38f2312d None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:22.393958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60326fe-f31c-42b7-bbf9-0afc38f2312d None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:22.394064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60326fe-f31c-42b7-bbf9-0afc38f2312d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:22.413376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-f60326fe-f31c-42b7-bbf9-0afc38f2312d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:57:22.414572 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-f60326fe-f31c-42b7-bbf9-0afc38f2312d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:22.422893 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:57:22.573373 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320f98b-657f-41b0-b8c5-a0403717c25e None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:22.587379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320f98b-657f-41b0-b8c5-a0403717c25e None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:22.592764 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022a05d-fdbc-4517-a57d-f1dabfcbbc9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:22.593364 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022a05d-fdbc-4517-a57d-f1dabfcbbc9f service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:22.593646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022a05d-fdbc-4517-a57d-f1dabfcbbc9f service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:22.593919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022a05d-fdbc-4517-a57d-f1dabfcbbc9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:22.601797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022a05d-fdbc-4517-a57d-f1dabfcbbc9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:22.603394 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022a05d-fdbc-4517-a57d-f1dabfcbbc9f service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:22.613217 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 760/1516] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:57:23.207522 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f562e-b0ad-45b3-b35c-f7d3255e864a None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:23.207871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f562e-b0ad-45b3-b35c-f7d3255e864a None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:23.208081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f562e-b0ad-45b3-b35c-f7d3255e864a None None] PATH_INFO: `/v3` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:23.209406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 757/1517] 10.222.0.73 () {54 vars in 925 bytes} [Wed Aug 3 12:57:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:57:23.216779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41f318-6575-4d1d-8515-829521402820 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:23.217066 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41f318-6575-4d1d-8515-829521402820 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:23.217354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41f318-6575-4d1d-8515-829521402820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:23.277484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-ba41f318-6575-4d1d-8515-829521402820 None None] MFA Rules not processed for user `de27d25fad634658a1abcb776d9a7b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:57:23.278772 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ba41f318-6575-4d1d-8515-829521402820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:23.295744 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:23.352062 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 761/1518] 10.222.0.73 () {58 vars in 1015 bytes} [Wed Aug 3 12:57:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:57:32.408559 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=56 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:33.008117 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe5a22-cab0-4a62-a99b-467c94173209 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:33.008322 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe5a22-cab0-4a62-a99b-467c94173209 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:33.008598 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe5a22-cab0-4a62-a99b-467c94173209 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:33.009973 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 758/1519] 10.222.0.64 () {54 vars in 961 bytes} [Wed Aug 3 12:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:57:33.015737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7795e6-cb92-4ff7-844b-845ae5ff18f1 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:33.016222 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7795e6-cb92-4ff7-844b-845ae5ff18f1 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:33.016326 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7795e6-cb92-4ff7-844b-845ae5ff18f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:33.036779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-ad7795e6-cb92-4ff7-844b-845ae5ff18f1 None None] MFA Rules not processed for user `de27d25fad634658a1abcb776d9a7b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:57:33.038103 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ad7795e6-cb92-4ff7-844b-845ae5ff18f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:33.046990 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 762/1520] 10.222.0.64 () {58 vars in 1058 bytes} [Wed Aug 3 12:57:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:57:33.054464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe5a22-cab0-4a62-a99b-467c94173209 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:33.068616 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe5a22-cab0-4a62-a99b-467c94173209 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:33.073550 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dc604-cdfd-461d-940b-2c7cb36fed25 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de27d25fad634658a1abcb776d9a7b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:33.074160 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dc604-cdfd-461d-940b-2c7cb36fed25 service placement] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:33.074443 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dc604-cdfd-461d-940b-2c7cb36fed25 service placement] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:33.074715 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dc604-cdfd-461d-940b-2c7cb36fed25 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:33.083614 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dc604-cdfd-461d-940b-2c7cb36fed25 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:33.085190 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dc604-cdfd-461d-940b-2c7cb36fed25 service placement] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:33.095618 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 759/1521] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:57:33.848299 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c508439-ee4c-4237-86ea-5bc3d97cdcd3 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:33.850486 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c508439-ee4c-4237-86ea-5bc3d97cdcd3 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:33.850486 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c508439-ee4c-4237-86ea-5bc3d97cdcd3 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:33.850486 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:57:33.855070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e120ff-54c8-4341-9fe5-531d9fcbee01 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:33.855514 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e120ff-54c8-4341-9fe5-531d9fcbee01 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:33.855619 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e120ff-54c8-4341-9fe5-531d9fcbee01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:33.875880 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-68e120ff-54c8-4341-9fe5-531d9fcbee01 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:57:33.877194 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-68e120ff-54c8-4341-9fe5-531d9fcbee01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:33.885300 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:57:34.042091 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c508439-ee4c-4237-86ea-5bc3d97cdcd3 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:34.058104 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c508439-ee4c-4237-86ea-5bc3d97cdcd3 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:34.064520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94651076-8f6b-4bad-8ab3-ed054d7ac1b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:34.065142 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94651076-8f6b-4bad-8ab3-ed054d7ac1b4 service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:34.065494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94651076-8f6b-4bad-8ab3-ed054d7ac1b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:34.065778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94651076-8f6b-4bad-8ab3-ed054d7ac1b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:34.074642 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94651076-8f6b-4bad-8ab3-ed054d7ac1b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:34.076269 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94651076-8f6b-4bad-8ab3-ed054d7ac1b4 service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:34.086910 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 764/1524] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:57:34.904066 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ab41d-f4dc-4ba4-9ab0-29f2143fa44d None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:34.904596 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ab41d-f4dc-4ba4-9ab0-29f2143fa44d None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:34.904596 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ab41d-f4dc-4ba4-9ab0-29f2143fa44d None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:34.905946 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:57:34.911060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45103442-8354-4bf7-8511-bc6f6a14f27e None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:34.911347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45103442-8354-4bf7-8511-bc6f6a14f27e None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:34.911626 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45103442-8354-4bf7-8511-bc6f6a14f27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:34.930701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-45103442-8354-4bf7-8511-bc6f6a14f27e None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:57:34.931964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-45103442-8354-4bf7-8511-bc6f6a14f27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:34.940267 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:57:35.091999 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ab41d-f4dc-4ba4-9ab0-29f2143fa44d None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:35.106389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ab41d-f4dc-4ba4-9ab0-29f2143fa44d None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:35.112344 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f1973-52fc-48e3-bcde-8267ca66072e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:35.112951 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f1973-52fc-48e3-bcde-8267ca66072e service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:35.113238 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f1973-52fc-48e3-bcde-8267ca66072e service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:35.113512 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f1973-52fc-48e3-bcde-8267ca66072e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:35.121748 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f1973-52fc-48e3-bcde-8267ca66072e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:35.123379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f1973-52fc-48e3-bcde-8267ca66072e service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:35.133382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 762/1527] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:57:38.954965 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130f466-4abe-4606-a88f-2e3b082c4213 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:38.955526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130f466-4abe-4606-a88f-2e3b082c4213 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:38.955526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130f466-4abe-4606-a88f-2e3b082c4213 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:38.956872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:57:38.962140 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7446702-23a3-44d2-b955-c2d8b9c9a61f None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:38.962585 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7446702-23a3-44d2-b955-c2d8b9c9a61f None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:38.962689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7446702-23a3-44d2-b955-c2d8b9c9a61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:38.981608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-e7446702-23a3-44d2-b955-c2d8b9c9a61f None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:57:38.982842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e7446702-23a3-44d2-b955-c2d8b9c9a61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:38.991325 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:57:39.063898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130f466-4abe-4606-a88f-2e3b082c4213 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:39.065635 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-5130f466-4abe-4606-a88f-2e3b082c4213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:39.143563 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130f466-4abe-4606-a88f-2e3b082c4213 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:39.147308 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2280d-12fe-4ba0-a3c1-7fe3664fa279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:39.147929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2280d-12fe-4ba0-a3c1-7fe3664fa279 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:39.148216 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2280d-12fe-4ba0-a3c1-7fe3664fa279 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:39.148498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2280d-12fe-4ba0-a3c1-7fe3664fa279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:39.158003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2280d-12fe-4ba0-a3c1-7fe3664fa279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:39.159735 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2280d-12fe-4ba0-a3c1-7fe3664fa279 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:39.169170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 767/1530] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:57:41.155450 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c095b1-a01b-4ea4-bbd6-30744a47357e None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:41.156574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c095b1-a01b-4ea4-bbd6-30744a47357e None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:41.156574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c095b1-a01b-4ea4-bbd6-30744a47357e None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:41.157866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:57:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:57:41.163394 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07602e-8fa7-4946-aedd-e98f21b1f584 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:41.163905 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07602e-8fa7-4946-aedd-e98f21b1f584 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:41.164013 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07602e-8fa7-4946-aedd-e98f21b1f584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:41.183544 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-4d07602e-8fa7-4946-aedd-e98f21b1f584 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:57:41.184759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-4d07602e-8fa7-4946-aedd-e98f21b1f584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:41.197634 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:57:41.234513 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c095b1-a01b-4ea4-bbd6-30744a47357e None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:41.245364 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c095b1-a01b-4ea4-bbd6-30744a47357e None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:41.248896 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69974833-2a88-4d7a-95c2-40acc590162f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:41.253621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69974833-2a88-4d7a-95c2-40acc590162f service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:41.253621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69974833-2a88-4d7a-95c2-40acc590162f service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:41.253621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69974833-2a88-4d7a-95c2-40acc590162f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:41.258950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69974833-2a88-4d7a-95c2-40acc590162f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:41.260383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69974833-2a88-4d7a-95c2-40acc590162f service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:41.270265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 765/1533] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:57:44.682374 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4f469-10cf-4df4-bf3f-ae73169a22e7 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:44.682940 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4f469-10cf-4df4-bf3f-ae73169a22e7 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:44.682940 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4f469-10cf-4df4-bf3f-ae73169a22e7 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:44.684315 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:57:44.689941 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bf792-18de-44c0-9906-648adfe3f4be None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:44.690355 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bf792-18de-44c0-9906-648adfe3f4be None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:44.690551 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bf792-18de-44c0-9906-648adfe3f4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:44.710311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-652bf792-18de-44c0-9906-648adfe3f4be None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:57:44.711486 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-652bf792-18de-44c0-9906-648adfe3f4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:44.719386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:57:45.024567 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4f469-10cf-4df4-bf3f-ae73169a22e7 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:45.026269 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-fab4f469-10cf-4df4-bf3f-ae73169a22e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:45.092319 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:45.105467 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4f469-10cf-4df4-bf3f-ae73169a22e7 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:45.109684 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301cee53-8407-4639-b36d-b8e1085dcb14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:45.110301 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cee53-8407-4639-b36d-b8e1085dcb14 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:45.128926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cee53-8407-4639-b36d-b8e1085dcb14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:45.128926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cee53-8407-4639-b36d-b8e1085dcb14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:45.128926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301cee53-8407-4639-b36d-b8e1085dcb14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:45.128926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301cee53-8407-4639-b36d-b8e1085dcb14 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:45.131262 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 770/1536] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:57:47.163121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade45ca-c65d-43be-b6db-9892f28e4298 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:47.163522 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade45ca-c65d-43be-b6db-9892f28e4298 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:47.163690 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade45ca-c65d-43be-b6db-9892f28e4298 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:47.165050 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:57:47.170043 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd789366-2fbd-486f-9826-dcb74744d213 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:47.170936 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd789366-2fbd-486f-9826-dcb74744d213 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:47.171224 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd789366-2fbd-486f-9826-dcb74744d213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:47.198172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-bd789366-2fbd-486f-9826-dcb74744d213 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:57:47.199489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-bd789366-2fbd-486f-9826-dcb74744d213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:47.210992 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:57:47.510393 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade45ca-c65d-43be-b6db-9892f28e4298 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:47.512117 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-8ade45ca-c65d-43be-b6db-9892f28e4298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:47.525682 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade45ca-c65d-43be-b6db-9892f28e4298 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:47.529190 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc939e-59a5-4d77-914d-5b69c1e1f823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:47.529799 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc939e-59a5-4d77-914d-5b69c1e1f823 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:47.530091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc939e-59a5-4d77-914d-5b69c1e1f823 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:47.530398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc939e-59a5-4d77-914d-5b69c1e1f823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:47.540581 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc939e-59a5-4d77-914d-5b69c1e1f823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:47.542018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc939e-59a5-4d77-914d-5b69c1e1f823 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:47.551535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 768/1539] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:57:57.189912 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=11 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:57.547393 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=33 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:17.378757 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f19b5-6ca4-49eb-98f0-b68fa828e235 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:17.394426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f19b5-6ca4-49eb-98f0-b68fa828e235 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:17.394426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f19b5-6ca4-49eb-98f0-b68fa828e235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:17.432060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-d71f19b5-6ca4-49eb-98f0-b68fa828e235 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:17.440786 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d71f19b5-6ca4-49eb-98f0-b68fa828e235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:17.450578 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 772/1540] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:17.460982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6640f9-9a1e-4ace-92f0-a170080bc5df None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:17.461597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6640f9-9a1e-4ace-92f0-a170080bc5df None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:17.461597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6640f9-9a1e-4ace-92f0-a170080bc5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:17.494670 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-2c6640f9-9a1e-4ace-92f0-a170080bc5df None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:17.496607 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-2c6640f9-9a1e-4ace-92f0-a170080bc5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:17.511831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ad53e-ea1d-45f8-9355-67df08cfcb7a None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:17.512241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ad53e-ea1d-45f8-9355-67df08cfcb7a None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:17.512439 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ad53e-ea1d-45f8-9355-67df08cfcb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:17.521648 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 769/1541] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:17.535141 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6640f9-9a1e-4ace-92f0-a170080bc5df None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:17.539638 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-6d3ad53e-ea1d-45f8-9355-67df08cfcb7a None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:17.541194 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-6d3ad53e-ea1d-45f8-9355-67df08cfcb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:17.549870 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6640f9-9a1e-4ace-92f0-a170080bc5df None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:17.559615 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 773/1542] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:17.567970 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5ab62-25c6-415b-b6bb-78d18c5c688a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:17.568771 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5ab62-25c6-415b-b6bb-78d18c5c688a admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:17.569065 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5ab62-25c6-415b-b6bb-78d18c5c688a admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:17.569348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5ab62-25c6-415b-b6bb-78d18c5c688a admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:17.570082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5ab62-25c6-415b-b6bb-78d18c5c688a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:59:17.570394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5ab62-25c6-415b-b6bb-78d18c5c688a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:17.571466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: WARNING py.warnings [None req-80c5ab62-25c6-415b-b6bb-78d18c5c688a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:59:17.571466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: warnings.warn(msg) Aug 03 12:59:17.571466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: Aug 03 12:59:17.572353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5ab62-25c6-415b-b6bb-78d18c5c688a admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:17.581946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cfae7-de57-4978-ba3e-84eaa5c10bc2 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:17.582283 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cfae7-de57-4978-ba3e-84eaa5c10bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:17.582529 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cfae7-de57-4978-ba3e-84eaa5c10bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:17.593467 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 770/1543] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 12:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:59:17.594905 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4d8c2-5739-4de6-b60b-af43e52b9e0c None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:17.595217 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4d8c2-5739-4de6-b60b-af43e52b9e0c None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:17.595504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4d8c2-5739-4de6-b60b-af43e52b9e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:17.613807 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-af8cfae7-de57-4978-ba3e-84eaa5c10bc2 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:17.615158 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-af8cfae7-de57-4978-ba3e-84eaa5c10bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:17.624958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-2cc4d8c2-5739-4de6-b60b-af43e52b9e0c None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:17.627578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-2cc4d8c2-5739-4de6-b60b-af43e52b9e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:17.631085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 774/1544] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:17.631888 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cfae7-de57-4978-ba3e-84eaa5c10bc2 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:17.650661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cfae7-de57-4978-ba3e-84eaa5c10bc2 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:17.652673 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 771/1545] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:17.653519 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4d8c2-5739-4de6-b60b-af43e52b9e0c None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:17.664129 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205200fd-eb9e-432f-8550-d85243e17db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:17.664763 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205200fd-eb9e-432f-8550-d85243e17db4 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:17.665049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205200fd-eb9e-432f-8550-d85243e17db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:17.665330 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205200fd-eb9e-432f-8550-d85243e17db4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:17.666011 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205200fd-eb9e-432f-8550-d85243e17db4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:17.667237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: WARNING py.warnings [None req-205200fd-eb9e-432f-8550-d85243e17db4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:59:17.667237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: warnings.warn(msg) Aug 03 12:59:17.667237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: Aug 03 12:59:17.668442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205200fd-eb9e-432f-8550-d85243e17db4 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:17.675181 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4d8c2-5739-4de6-b60b-af43e52b9e0c None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:17.690389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5180c8a-d292-4328-aa35-4a446443eefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:17.691313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5180c8a-d292-4328-aa35-4a446443eefc admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:17.691610 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5180c8a-d292-4328-aa35-4a446443eefc admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:17.691903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5180c8a-d292-4328-aa35-4a446443eefc admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:17.692597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5180c8a-d292-4328-aa35-4a446443eefc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:59:17.692906 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5180c8a-d292-4328-aa35-4a446443eefc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:17.695320 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5180c8a-d292-4328-aa35-4a446443eefc admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:17.710404 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 772/1546] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 12:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:59:17.712029 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0584fd-9e96-4b01-80be-399ed08c1171 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:17.712332 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0584fd-9e96-4b01-80be-399ed08c1171 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:17.712619 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0584fd-9e96-4b01-80be-399ed08c1171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:17.756812 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-6d0584fd-9e96-4b01-80be-399ed08c1171 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:17.758060 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-6d0584fd-9e96-4b01-80be-399ed08c1171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:17.772490 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 773/1547] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:17.774039 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d4fe5-6db4-4ddc-a6a3-31474c1e8fec None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:17.774330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d4fe5-6db4-4ddc-a6a3-31474c1e8fec None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:17.774611 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d4fe5-6db4-4ddc-a6a3-31474c1e8fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:17.804449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-a41d4fe5-6db4-4ddc-a6a3-31474c1e8fec None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:17.809487 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a41d4fe5-6db4-4ddc-a6a3-31474c1e8fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:17.819042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 774/1548] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:17.819858 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d4fe5-6db4-4ddc-a6a3-31474c1e8fec None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:17.835056 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d4fe5-6db4-4ddc-a6a3-31474c1e8fec None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:17.836063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 775/1549] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:17 2022] POST /identity/v3/projects => generated 393 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:17.836843 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205200fd-eb9e-432f-8550-d85243e17db4 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:17.909085 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebdda2-2e46-4be8-8f10-012321c34890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:17.909346 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205200fd-eb9e-432f-8550-d85243e17db4 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:17.909697 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebdda2-2e46-4be8-8f10-012321c34890 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:17.909978 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebdda2-2e46-4be8-8f10-012321c34890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:17.910255 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebdda2-2e46-4be8-8f10-012321c34890 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:17.910955 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebdda2-2e46-4be8-8f10-012321c34890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:17.912973 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebdda2-2e46-4be8-8f10-012321c34890 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:17.914220 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0126d-dcee-4d5e-953c-fd808dae504c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:17.914878 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0126d-dcee-4d5e-953c-fd808dae504c admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:17.915173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0126d-dcee-4d5e-953c-fd808dae504c admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:17.915458 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0126d-dcee-4d5e-953c-fd808dae504c admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:17.916165 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0126d-dcee-4d5e-953c-fd808dae504c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:59:17.916519 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0126d-dcee-4d5e-953c-fd808dae504c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:17.918650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0126d-dcee-4d5e-953c-fd808dae504c admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:17.938228 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 776/1550] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 12:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:59:17.939706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba77d66-6473-4e3b-bc03-bf40f5e9c394 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:17.940003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba77d66-6473-4e3b-bc03-bf40f5e9c394 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:17.940290 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba77d66-6473-4e3b-bc03-bf40f5e9c394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:17.960349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-8ba77d66-6473-4e3b-bc03-bf40f5e9c394 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:17.964727 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-8ba77d66-6473-4e3b-bc03-bf40f5e9c394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:17.969799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 777/1551] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:17.971069 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ecb38-6518-4a46-8177-c6656178d01f None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:17.971362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ecb38-6518-4a46-8177-c6656178d01f None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:17.971645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ecb38-6518-4a46-8177-c6656178d01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:17.986380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 775/1552] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:17 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:17.989385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac94e71-ec3a-487f-be1a-fb2f66875690 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:17.989385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac94e71-ec3a-487f-be1a-fb2f66875690 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:17.989385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac94e71-ec3a-487f-be1a-fb2f66875690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:17.994481 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-633ecb38-6518-4a46-8177-c6656178d01f None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:17.997004 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-633ecb38-6518-4a46-8177-c6656178d01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:18.008911 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-dac94e71-ec3a-487f-be1a-fb2f66875690 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:18.010405 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-dac94e71-ec3a-487f-be1a-fb2f66875690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:18.070790 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 778/1553] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:18.072090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098de2f6-ff21-42a0-9d0a-1dbfaede05f5 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.072491 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098de2f6-ff21-42a0-9d0a-1dbfaede05f5 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.072766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098de2f6-ff21-42a0-9d0a-1dbfaede05f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.075906 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 776/1554] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:18.077326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac94e71-ec3a-487f-be1a-fb2f66875690 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:18.088425 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac94e71-ec3a-487f-be1a-fb2f66875690 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:18.093172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ae42d-e2d0-4def-b452-b26006d419af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:18.093792 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ae42d-e2d0-4def-b452-b26006d419af admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.094078 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ae42d-e2d0-4def-b452-b26006d419af admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.094361 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ae42d-e2d0-4def-b452-b26006d419af admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.095073 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ae42d-e2d0-4def-b452-b26006d419af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:18.096127 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: WARNING py.warnings [None req-d56ae42d-e2d0-4def-b452-b26006d419af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:59:18.096127 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: warnings.warn(msg) Aug 03 12:59:18.096127 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: Aug 03 12:59:18.097344 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ae42d-e2d0-4def-b452-b26006d419af admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:18.103324 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-098de2f6-ff21-42a0-9d0a-1dbfaede05f5 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:18.105731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-098de2f6-ff21-42a0-9d0a-1dbfaede05f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:18.118436 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 779/1555] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:18.120955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630033c7-f2c2-46af-b056-0d617e32ed97 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.121415 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630033c7-f2c2-46af-b056-0d617e32ed97 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.121868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630033c7-f2c2-46af-b056-0d617e32ed97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.150651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-630033c7-f2c2-46af-b056-0d617e32ed97 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:18.152631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-630033c7-f2c2-46af-b056-0d617e32ed97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:18.165517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 780/1556] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:18.166727 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630033c7-f2c2-46af-b056-0d617e32ed97 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:18.183557 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630033c7-f2c2-46af-b056-0d617e32ed97 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:18.190887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606f187-e4ca-44df-bfbb-4c521cfa22f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:18.191903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606f187-e4ca-44df-bfbb-4c521cfa22f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.192390 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606f187-e4ca-44df-bfbb-4c521cfa22f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.192860 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606f187-e4ca-44df-bfbb-4c521cfa22f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.193974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606f187-e4ca-44df-bfbb-4c521cfa22f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:18.194632 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 777/1557] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:18 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:18.196006 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ccdf4-78d2-4194-9bf0-928fbf2c84d0 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.196240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ccdf4-78d2-4194-9bf0-928fbf2c84d0 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.196523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ccdf4-78d2-4194-9bf0-928fbf2c84d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.197443 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606f187-e4ca-44df-bfbb-4c521cfa22f9 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:18.217595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-e02ccdf4-78d2-4194-9bf0-928fbf2c84d0 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:18.218873 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e02ccdf4-78d2-4194-9bf0-928fbf2c84d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:18.231506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 778/1558] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:18.232814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ccdf4-78d2-4194-9bf0-928fbf2c84d0 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:18.245966 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ccdf4-78d2-4194-9bf0-928fbf2c84d0 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:18.250699 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eed179-3210-43cc-827c-7974aaeeaf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:18.251339 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eed179-3210-43cc-827c-7974aaeeaf59 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.251623 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eed179-3210-43cc-827c-7974aaeeaf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.251970 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eed179-3210-43cc-827c-7974aaeeaf59 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.252655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eed179-3210-43cc-827c-7974aaeeaf59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:18.254570 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eed179-3210-43cc-827c-7974aaeeaf59 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:18.263448 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:18.275133 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 781/1559] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:18 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:18.277037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17521040-8eb0-4c25-9ad8-84d3a205da42 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.277324 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17521040-8eb0-4c25-9ad8-84d3a205da42 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.277600 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17521040-8eb0-4c25-9ad8-84d3a205da42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.285417 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:18.297963 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-17521040-8eb0-4c25-9ad8-84d3a205da42 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:18.301711 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-17521040-8eb0-4c25-9ad8-84d3a205da42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:18.354649 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 779/1560] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:18 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:18.358619 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eed179-3210-43cc-827c-7974aaeeaf59 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:18.369164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 782/1561] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:18.369323 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eed179-3210-43cc-827c-7974aaeeaf59 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:18.369448 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799dcdf-ee76-4806-911b-5bd4d1e02eaf None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.369448 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799dcdf-ee76-4806-911b-5bd4d1e02eaf None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.369448 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799dcdf-ee76-4806-911b-5bd4d1e02eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.372019 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994c71f-a704-4d07-ba78-3acd73fc9557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:18.372640 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994c71f-a704-4d07-ba78-3acd73fc9557 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.372925 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994c71f-a704-4d07-ba78-3acd73fc9557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.373200 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994c71f-a704-4d07-ba78-3acd73fc9557 admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.373904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994c71f-a704-4d07-ba78-3acd73fc9557 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:59:18.374209 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994c71f-a704-4d07-ba78-3acd73fc9557 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:18.375852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994c71f-a704-4d07-ba78-3acd73fc9557 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:18.397888 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 780/1562] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 12:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:59:18.397888 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff6580-ab0a-4a46-a3a3-3b3b0e8ce906 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.397888 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff6580-ab0a-4a46-a3a3-3b3b0e8ce906 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.398292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-8799dcdf-ee76-4806-911b-5bd4d1e02eaf None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:18.398776 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff6580-ab0a-4a46-a3a3-3b3b0e8ce906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.398899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-8799dcdf-ee76-4806-911b-5bd4d1e02eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:18.406509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 783/1563] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:18.411603 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799dcdf-ee76-4806-911b-5bd4d1e02eaf None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:18.417560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799dcdf-ee76-4806-911b-5bd4d1e02eaf None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:18.418322 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-11ff6580-ab0a-4a46-a3a3-3b3b0e8ce906 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:18.419559 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-11ff6580-ab0a-4a46-a3a3-3b3b0e8ce906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:18.422507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ddaa5-b738-43e4-a75e-93be8eae1537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:18.423167 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ddaa5-b738-43e4-a75e-93be8eae1537 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.423455 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ddaa5-b738-43e4-a75e-93be8eae1537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.423737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ddaa5-b738-43e4-a75e-93be8eae1537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.424442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ddaa5-b738-43e4-a75e-93be8eae1537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:18.426050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ddaa5-b738-43e4-a75e-93be8eae1537 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:18.429345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 781/1564] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:18.432993 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff6580-ab0a-4a46-a3a3-3b3b0e8ce906 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:18.437347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 784/1565] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:18.438123 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ddaa5-b738-43e4-a75e-93be8eae1537 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:18.443186 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff6580-ab0a-4a46-a3a3-3b3b0e8ce906 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:18.447925 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319d161-9328-431f-b833-80e8324f6e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:18.448116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ddaa5-b738-43e4-a75e-93be8eae1537 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:18.448517 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319d161-9328-431f-b833-80e8324f6e39 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.448801 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319d161-9328-431f-b833-80e8324f6e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.449079 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319d161-9328-431f-b833-80e8324f6e39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.449851 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319d161-9328-431f-b833-80e8324f6e39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:59:18.450181 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319d161-9328-431f-b833-80e8324f6e39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:18.451825 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319d161-9328-431f-b833-80e8324f6e39 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:18.452977 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b9b84-d226-4afa-a641-aa37ca3879ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:18.453608 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b9b84-d226-4afa-a641-aa37ca3879ff admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.453889 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b9b84-d226-4afa-a641-aa37ca3879ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.454170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b9b84-d226-4afa-a641-aa37ca3879ff admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.454885 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b9b84-d226-4afa-a641-aa37ca3879ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:18.456817 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b9b84-d226-4afa-a641-aa37ca3879ff admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:18.464662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 782/1566] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 12:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:59:18.465585 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319d161-9328-431f-b833-80e8324f6e39 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:18.476887 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319d161-9328-431f-b833-80e8324f6e39 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:18.482211 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fd1e2-1480-4fcd-95cb-912de8c610c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:18.483853 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fd1e2-1480-4fcd-95cb-912de8c610c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.483853 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fd1e2-1480-4fcd-95cb-912de8c610c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.483853 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fd1e2-1480-4fcd-95cb-912de8c610c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.484179 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185fd1e2-1480-4fcd-95cb-912de8c610c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:18.485805 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185fd1e2-1480-4fcd-95cb-912de8c610c5 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:18.496468 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 783/1567] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:18.497423 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fd1e2-1480-4fcd-95cb-912de8c610c5 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:18.507739 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fd1e2-1480-4fcd-95cb-912de8c610c5 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:18.512450 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd9932-7614-495e-83d5-a2a6c9098b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:18.513063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd9932-7614-495e-83d5-a2a6c9098b4f admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.513345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd9932-7614-495e-83d5-a2a6c9098b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.513622 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd9932-7614-495e-83d5-a2a6c9098b4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.514313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd9932-7614-495e-83d5-a2a6c9098b4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:59:18.514645 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd9932-7614-495e-83d5-a2a6c9098b4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:18.516316 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd9932-7614-495e-83d5-a2a6c9098b4f admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:18.528421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 784/1568] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 12:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:59:18.529350 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd9932-7614-495e-83d5-a2a6c9098b4f admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:18.539377 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd9932-7614-495e-83d5-a2a6c9098b4f admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:18.544644 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30e504-3c2f-47e8-bd9c-413b504f8c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:18.545259 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30e504-3c2f-47e8-bd9c-413b504f8c63 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.545536 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30e504-3c2f-47e8-bd9c-413b504f8c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.545813 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30e504-3c2f-47e8-bd9c-413b504f8c63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.546475 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30e504-3c2f-47e8-bd9c-413b504f8c63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:18.548405 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30e504-3c2f-47e8-bd9c-413b504f8c63 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:18.552256 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 785/1569] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:18 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:18.552256 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b9b84-d226-4afa-a641-aa37ca3879ff admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:18.560606 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b9b84-d226-4afa-a641-aa37ca3879ff admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:18.565512 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8976c8-d6a1-4a9b-bf16-d0b2018a2cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:18.566171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8976c8-d6a1-4a9b-bf16-d0b2018a2cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.566475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8976c8-d6a1-4a9b-bf16-d0b2018a2cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.566799 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8976c8-d6a1-4a9b-bf16-d0b2018a2cf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.567516 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8976c8-d6a1-4a9b-bf16-d0b2018a2cf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:59:18.567810 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8976c8-d6a1-4a9b-bf16-d0b2018a2cf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:18.569447 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8976c8-d6a1-4a9b-bf16-d0b2018a2cf8 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:18.581783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 786/1570] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 12:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:59:18.582594 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8976c8-d6a1-4a9b-bf16-d0b2018a2cf8 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:18.592933 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8976c8-d6a1-4a9b-bf16-d0b2018a2cf8 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:18.597657 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786b0c3-4e09-46f7-82f4-9b790ea0b767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:18.598259 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786b0c3-4e09-46f7-82f4-9b790ea0b767 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.598545 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786b0c3-4e09-46f7-82f4-9b790ea0b767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.598861 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786b0c3-4e09-46f7-82f4-9b790ea0b767 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.599552 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786b0c3-4e09-46f7-82f4-9b790ea0b767 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:59:18.599858 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786b0c3-4e09-46f7-82f4-9b790ea0b767 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:18.601446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786b0c3-4e09-46f7-82f4-9b790ea0b767 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:18.613862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 787/1571] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 12:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:59:18.614716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786b0c3-4e09-46f7-82f4-9b790ea0b767 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:18.625624 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786b0c3-4e09-46f7-82f4-9b790ea0b767 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:18.636630 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 785/1572] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:18 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:18.636808 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad04f91-36f4-4fdf-8670-fd92ddf95ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:18.636908 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30e504-3c2f-47e8-bd9c-413b504f8c63 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:18.637008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad04f91-36f4-4fdf-8670-fd92ddf95ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.637008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad04f91-36f4-4fdf-8670-fd92ddf95ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.637008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad04f91-36f4-4fdf-8670-fd92ddf95ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.637008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad04f91-36f4-4fdf-8670-fd92ddf95ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:18.637543 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad04f91-36f4-4fdf-8670-fd92ddf95ff8 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:18.648776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 788/1573] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:18.649562 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad04f91-36f4-4fdf-8670-fd92ddf95ff8 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:18.659916 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad04f91-36f4-4fdf-8670-fd92ddf95ff8 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:18.701194 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30e504-3c2f-47e8-bd9c-413b504f8c63 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:18.705763 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78347c48-5f26-49ba-857e-c8fcdeee758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:18.706406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78347c48-5f26-49ba-857e-c8fcdeee758a admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.706686 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78347c48-5f26-49ba-857e-c8fcdeee758a admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.706992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78347c48-5f26-49ba-857e-c8fcdeee758a admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.707655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78347c48-5f26-49ba-857e-c8fcdeee758a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:18.709589 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78347c48-5f26-49ba-857e-c8fcdeee758a admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:18.717955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd209781-e967-421f-9396-6875155ce6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:18.718575 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd209781-e967-421f-9396-6875155ce6ed admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.718886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd209781-e967-421f-9396-6875155ce6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.719168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd209781-e967-421f-9396-6875155ce6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.719871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd209781-e967-421f-9396-6875155ce6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:18.721466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd209781-e967-421f-9396-6875155ce6ed admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:18.735005 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 789/1574] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:18.735005 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd209781-e967-421f-9396-6875155ce6ed admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:18.741996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd209781-e967-421f-9396-6875155ce6ed admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:18.747234 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea65185-e03b-4c78-9a2e-838ab55f5600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:18.747808 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea65185-e03b-4c78-9a2e-838ab55f5600 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.748093 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea65185-e03b-4c78-9a2e-838ab55f5600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.748374 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea65185-e03b-4c78-9a2e-838ab55f5600 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.749021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea65185-e03b-4c78-9a2e-838ab55f5600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:18.750917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea65185-e03b-4c78-9a2e-838ab55f5600 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:18.795750 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 786/1575] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:18 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:18.796732 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78347c48-5f26-49ba-857e-c8fcdeee758a admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:18.853502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:18.857614 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78347c48-5f26-49ba-857e-c8fcdeee758a admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:18.862306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2418a-180a-4573-b8f8-f1a379737315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:18.862941 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2418a-180a-4573-b8f8-f1a379737315 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.863266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2418a-180a-4573-b8f8-f1a379737315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.863505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2418a-180a-4573-b8f8-f1a379737315 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.864198 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2418a-180a-4573-b8f8-f1a379737315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:18.865793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2418a-180a-4573-b8f8-f1a379737315 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:18.876078 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 787/1576] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:18.876833 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2418a-180a-4573-b8f8-f1a379737315 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:18.886307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2418a-180a-4573-b8f8-f1a379737315 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:18.895403 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 790/1577] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:18 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:18.895403 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea65185-e03b-4c78-9a2e-838ab55f5600 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:18.895403 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:18.946469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89684f-71b3-41c3-a432-63ec85cca972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:18.947522 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89684f-71b3-41c3-a432-63ec85cca972 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.947972 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89684f-71b3-41c3-a432-63ec85cca972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.948445 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89684f-71b3-41c3-a432-63ec85cca972 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.949332 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89684f-71b3-41c3-a432-63ec85cca972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:18.951379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89684f-71b3-41c3-a432-63ec85cca972 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:18.957712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea65185-e03b-4c78-9a2e-838ab55f5600 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:18.962673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3db517-4825-41b6-a13e-c1688275e029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:18.963340 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3db517-4825-41b6-a13e-c1688275e029 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:18.966665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3db517-4825-41b6-a13e-c1688275e029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:18.966665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3db517-4825-41b6-a13e-c1688275e029 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:18.966665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3db517-4825-41b6-a13e-c1688275e029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:18.967275 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3db517-4825-41b6-a13e-c1688275e029 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:19.078451 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 788/1578] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:18 2022] POST /identity/v3/projects => generated 365 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:19.079311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89684f-71b3-41c3-a432-63ec85cca972 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:19.091510 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 791/1579] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:18 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:19.092497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3db517-4825-41b6-a13e-c1688275e029 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:19.144986 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89684f-71b3-41c3-a432-63ec85cca972 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:19.167682 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3db517-4825-41b6-a13e-c1688275e029 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:19.172926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bee0e-2901-410c-a891-ff15ed51ccf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:19.173587 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bee0e-2901-410c-a891-ff15ed51ccf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:19.173870 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bee0e-2901-410c-a891-ff15ed51ccf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:19.174142 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bee0e-2901-410c-a891-ff15ed51ccf1 admin admin] PATH_INFO: `/v3/projects/6be1056fe005471f83a0633c99c0b349/users/bb5f78a0ee0642c7bbde2ecf34e090d0/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:19.190981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bee0e-2901-410c-a891-ff15ed51ccf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be1056fe005471f83a0633c99c0b349, user_id=bb5f78a0ee0642c7bbde2ecf34e090d0, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:19.192112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: WARNING py.warnings [None req-6f2bee0e-2901-410c-a891-ff15ed51ccf1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:59:19.192112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: warnings.warn(msg) Aug 03 12:59:19.192112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: Aug 03 12:59:19.194271 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bee0e-2901-410c-a891-ff15ed51ccf1 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:19.205729 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37641472-13d4-4f1c-8555-16e4920d0633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:19.206410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37641472-13d4-4f1c-8555-16e4920d0633 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:19.206798 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37641472-13d4-4f1c-8555-16e4920d0633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:19.207231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37641472-13d4-4f1c-8555-16e4920d0633 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:19.207963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37641472-13d4-4f1c-8555-16e4920d0633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:19.210633 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37641472-13d4-4f1c-8555-16e4920d0633 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:19.295298 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 792/1580] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:19 2022] PUT /identity/v3/projects/6be1056fe005471f83a0633c99c0b349/users/bb5f78a0ee0642c7bbde2ecf34e090d0/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:19.296171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bee0e-2901-410c-a891-ff15ed51ccf1 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:19.306048 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 789/1581] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:19 2022] POST /identity/v3/users => generated 290 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:19.306937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37641472-13d4-4f1c-8555-16e4920d0633 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:19.316764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37641472-13d4-4f1c-8555-16e4920d0633 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:19.328030 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:19.359523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bee0e-2901-410c-a891-ff15ed51ccf1 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:19.364154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d464ee-2017-4766-9e16-0f6b9cca245f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:19.364916 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d464ee-2017-4766-9e16-0f6b9cca245f admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:19.365106 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d464ee-2017-4766-9e16-0f6b9cca245f admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:19.365380 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d464ee-2017-4766-9e16-0f6b9cca245f admin admin] PATH_INFO: `/v3/projects/b4c4a2f8c7864ee692c5b1b55b4aacac/users/bbf46bef60464329afdf2df75842a41e/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:19.374145 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1a1a5-2ff8-484d-96d1-759058448e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:19.374894 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1a1a5-2ff8-484d-96d1-759058448e4c admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:19.375184 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1a1a5-2ff8-484d-96d1-759058448e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:19.375461 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1a1a5-2ff8-484d-96d1-759058448e4c admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:19.376132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1a1a5-2ff8-484d-96d1-759058448e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:19.378146 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1a1a5-2ff8-484d-96d1-759058448e4c admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:19.380909 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d464ee-2017-4766-9e16-0f6b9cca245f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4c4a2f8c7864ee692c5b1b55b4aacac, user_id=bbf46bef60464329afdf2df75842a41e, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:19.383563 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d464ee-2017-4766-9e16-0f6b9cca245f admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:19.387129 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:19.466488 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 793/1582] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:19 2022] PUT /identity/v3/projects/b4c4a2f8c7864ee692c5b1b55b4aacac/users/bbf46bef60464329afdf2df75842a41e/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:19.467270 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d464ee-2017-4766-9e16-0f6b9cca245f admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:19.477556 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 790/1583] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:19 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:19.478442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1a1a5-2ff8-484d-96d1-759058448e4c admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:19.488431 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1a1a5-2ff8-484d-96d1-759058448e4c admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:19.529872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d464ee-2017-4766-9e16-0f6b9cca245f admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:19.535298 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905579d1-6900-4f35-912c-588af181f918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:19.535916 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905579d1-6900-4f35-912c-588af181f918 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:19.536196 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905579d1-6900-4f35-912c-588af181f918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:19.536468 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905579d1-6900-4f35-912c-588af181f918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:19.537162 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905579d1-6900-4f35-912c-588af181f918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:19.538810 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905579d1-6900-4f35-912c-588af181f918 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:19.546012 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439afad0-4468-4100-8b66-aa685b745f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:19.546631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439afad0-4468-4100-8b66-aa685b745f0c admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:19.546943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439afad0-4468-4100-8b66-aa685b745f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:19.547223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439afad0-4468-4100-8b66-aa685b745f0c admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:19.547890 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439afad0-4468-4100-8b66-aa685b745f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:19.549126 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 794/1584] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:19.549805 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439afad0-4468-4100-8b66-aa685b745f0c admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:19.549997 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905579d1-6900-4f35-912c-588af181f918 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:19.559217 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905579d1-6900-4f35-912c-588af181f918 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:19.563791 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38c840-f67a-466e-b3fd-4a875a9eb4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:19.564397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38c840-f67a-466e-b3fd-4a875a9eb4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:19.564712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38c840-f67a-466e-b3fd-4a875a9eb4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:19.564987 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38c840-f67a-466e-b3fd-4a875a9eb4d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:19.565639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38c840-f67a-466e-b3fd-4a875a9eb4d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:19.567563 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38c840-f67a-466e-b3fd-4a875a9eb4d1 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:19.655063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 791/1585] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:19 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:19.655956 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439afad0-4468-4100-8b66-aa685b745f0c admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:19.665756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439afad0-4468-4100-8b66-aa685b745f0c admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:19.670336 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31ac4b-bf5f-4f71-99df-c171829242bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:19.670956 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31ac4b-bf5f-4f71-99df-c171829242bd admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:19.671242 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31ac4b-bf5f-4f71-99df-c171829242bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:19.671523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31ac4b-bf5f-4f71-99df-c171829242bd admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:19.672168 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31ac4b-bf5f-4f71-99df-c171829242bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:19.674077 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31ac4b-bf5f-4f71-99df-c171829242bd admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:19.686921 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 795/1586] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:19 2022] POST /identity/v3/users => generated 283 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:19.686921 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79737ed-833e-4567-832a-4752a5eb9f07 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:19.686921 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79737ed-833e-4567-832a-4752a5eb9f07 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:19.686921 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79737ed-833e-4567-832a-4752a5eb9f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:19.704569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-f79737ed-833e-4567-832a-4752a5eb9f07 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:19.705819 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-f79737ed-833e-4567-832a-4752a5eb9f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:19.714275 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 796/1587] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:19.715129 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79737ed-833e-4567-832a-4752a5eb9f07 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:19.724621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79737ed-833e-4567-832a-4752a5eb9f07 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:19.729238 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7c970-559b-4fef-8c08-9fa6a4011281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:19.729834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7c970-559b-4fef-8c08-9fa6a4011281 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:19.730124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7c970-559b-4fef-8c08-9fa6a4011281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:19.730403 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7c970-559b-4fef-8c08-9fa6a4011281 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:19.731131 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7c970-559b-4fef-8c08-9fa6a4011281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:19.732720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7c970-559b-4fef-8c08-9fa6a4011281 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:19.742625 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 797/1588] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:19.743780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6909b6-1180-47d6-b055-0f99be63d906 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:19.744070 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6909b6-1180-47d6-b055-0f99be63d906 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:19.744352 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6909b6-1180-47d6-b055-0f99be63d906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:19.760383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 792/1589] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:19 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:19.762106 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31ac4b-bf5f-4f71-99df-c171829242bd admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:19.763257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-6f6909b6-1180-47d6-b055-0f99be63d906 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:19.767119 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-6f6909b6-1180-47d6-b055-0f99be63d906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:19.772427 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31ac4b-bf5f-4f71-99df-c171829242bd admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:19.772666 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 798/1590] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:19.773422 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6909b6-1180-47d6-b055-0f99be63d906 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:19.780685 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a6d61-3008-46bf-978e-6b518aaf3779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:19.781312 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a6d61-3008-46bf-978e-6b518aaf3779 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:19.781647 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a6d61-3008-46bf-978e-6b518aaf3779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:19.781879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a6d61-3008-46bf-978e-6b518aaf3779 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:19.783097 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a6d61-3008-46bf-978e-6b518aaf3779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:19.783989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6909b6-1180-47d6-b055-0f99be63d906 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:19.784696 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a6d61-3008-46bf-978e-6b518aaf3779 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:19.788668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a096de0-07f9-4cc7-976c-eed23dca0ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:19.789332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a096de0-07f9-4cc7-976c-eed23dca0ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:19.789621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a096de0-07f9-4cc7-976c-eed23dca0ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:19.789905 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a096de0-07f9-4cc7-976c-eed23dca0ee9 admin admin] PATH_INFO: `/v3/projects/e20045ed345344aa827297413436e734/users/cd605450595c446e887edf13518f542b/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:19.795640 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 793/1591] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:19.796443 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a6d61-3008-46bf-978e-6b518aaf3779 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:19.805640 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a096de0-07f9-4cc7-976c-eed23dca0ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20045ed345344aa827297413436e734, user_id=cd605450595c446e887edf13518f542b, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:19.805882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a6d61-3008-46bf-978e-6b518aaf3779 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:19.808896 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a096de0-07f9-4cc7-976c-eed23dca0ee9 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:19.811056 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812eb2b-673a-44b4-b77d-5701b2d02b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:19.811652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812eb2b-673a-44b4-b77d-5701b2d02b82 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:19.812289 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812eb2b-673a-44b4-b77d-5701b2d02b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:19.812289 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812eb2b-673a-44b4-b77d-5701b2d02b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:19.812878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812eb2b-673a-44b4-b77d-5701b2d02b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:19.814442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812eb2b-673a-44b4-b77d-5701b2d02b82 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:19.824881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 794/1592] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:19.825649 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812eb2b-673a-44b4-b77d-5701b2d02b82 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:19.834872 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812eb2b-673a-44b4-b77d-5701b2d02b82 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:19.839463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f789f-bf35-4f12-a853-51ca8be02387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:19.840026 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f789f-bf35-4f12-a853-51ca8be02387 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:19.840309 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f789f-bf35-4f12-a853-51ca8be02387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:19.840584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f789f-bf35-4f12-a853-51ca8be02387 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:19.841237 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f789f-bf35-4f12-a853-51ca8be02387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:19.842767 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f789f-bf35-4f12-a853-51ca8be02387 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:19.852727 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 795/1593] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:19.853495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f789f-bf35-4f12-a853-51ca8be02387 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:19.868067 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 799/1594] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:19 2022] PUT /identity/v3/projects/e20045ed345344aa827297413436e734/users/cd605450595c446e887edf13518f542b/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:19.879062 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a096de0-07f9-4cc7-976c-eed23dca0ee9 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:19.901188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:19.910866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f789f-bf35-4f12-a853-51ca8be02387 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:19.949761 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a096de0-07f9-4cc7-976c-eed23dca0ee9 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:19.955236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9e8f9-7b83-4e25-ae51-b5af65c56f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:19.955855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9e8f9-7b83-4e25-ae51-b5af65c56f86 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:19.956294 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9e8f9-7b83-4e25-ae51-b5af65c56f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:19.956560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9e8f9-7b83-4e25-ae51-b5af65c56f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:19.957266 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9e8f9-7b83-4e25-ae51-b5af65c56f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:19.958905 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9e8f9-7b83-4e25-ae51-b5af65c56f86 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:19.961175 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795f2f2-1a06-4d4c-9a2e-450017b29dfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:19.961805 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795f2f2-1a06-4d4c-9a2e-450017b29dfb service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:19.962267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795f2f2-1a06-4d4c-9a2e-450017b29dfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:19.962696 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795f2f2-1a06-4d4c-9a2e-450017b29dfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:19.976109 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 800/1595] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:19.976306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795f2f2-1a06-4d4c-9a2e-450017b29dfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:19.976406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9e8f9-7b83-4e25-ae51-b5af65c56f86 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:19.976492 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795f2f2-1a06-4d4c-9a2e-450017b29dfb service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:19.983307 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9e8f9-7b83-4e25-ae51-b5af65c56f86 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:19.984858 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 796/1596] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:19.986259 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795f2f2-1a06-4d4c-9a2e-450017b29dfb service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:19.988010 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa22b78-fe36-457a-ba43-8bf60864843f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:19.988616 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa22b78-fe36-457a-ba43-8bf60864843f admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:19.988897 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa22b78-fe36-457a-ba43-8bf60864843f admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:19.989172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa22b78-fe36-457a-ba43-8bf60864843f admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:19.989853 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa22b78-fe36-457a-ba43-8bf60864843f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:19.991487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa22b78-fe36-457a-ba43-8bf60864843f admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:19.996112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795f2f2-1a06-4d4c-9a2e-450017b29dfb service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:20.001941 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bef97-a929-46b3-9cb1-7fc4af99a018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:20.002206 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 801/1597] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:20.003068 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa22b78-fe36-457a-ba43-8bf60864843f admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:20.003435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bef97-a929-46b3-9cb1-7fc4af99a018 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:20.004040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bef97-a929-46b3-9cb1-7fc4af99a018 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:20.004539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bef97-a929-46b3-9cb1-7fc4af99a018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:20.014882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa22b78-fe36-457a-ba43-8bf60864843f admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:20.017498 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14bef97-a929-46b3-9cb1-7fc4af99a018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:20.017498 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14bef97-a929-46b3-9cb1-7fc4af99a018 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:20.020493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248aa64-2ffe-4a08-b513-d8ee10859426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:20.021197 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248aa64-2ffe-4a08-b513-d8ee10859426 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:20.021479 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248aa64-2ffe-4a08-b513-d8ee10859426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:20.021761 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248aa64-2ffe-4a08-b513-d8ee10859426 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:20.022566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248aa64-2ffe-4a08-b513-d8ee10859426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:20.024680 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248aa64-2ffe-4a08-b513-d8ee10859426 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:20.027568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 797/1598] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:20.028380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bef97-a929-46b3-9cb1-7fc4af99a018 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:20.031950 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:20.041053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 802/1599] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:20.041220 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bef97-a929-46b3-9cb1-7fc4af99a018 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:20.041350 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248aa64-2ffe-4a08-b513-d8ee10859426 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:20.048173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d9493-f027-4627-a29b-ea9ae93d960c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:20.048812 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d9493-f027-4627-a29b-ea9ae93d960c admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:20.049129 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d9493-f027-4627-a29b-ea9ae93d960c admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:20.049364 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d9493-f027-4627-a29b-ea9ae93d960c admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:20.049893 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248aa64-2ffe-4a08-b513-d8ee10859426 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:20.050047 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d9493-f027-4627-a29b-ea9ae93d960c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:20.051703 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d9493-f027-4627-a29b-ea9ae93d960c admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:20.055072 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f89b77-f5c8-43f1-a9f5-d4760eefd28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:20.055750 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f89b77-f5c8-43f1-a9f5-d4760eefd28a admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:20.056038 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f89b77-f5c8-43f1-a9f5-d4760eefd28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:20.056346 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f89b77-f5c8-43f1-a9f5-d4760eefd28a admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:20.057039 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f89b77-f5c8-43f1-a9f5-d4760eefd28a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:20.058866 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f89b77-f5c8-43f1-a9f5-d4760eefd28a admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:20.062245 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 798/1600] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:20.063513 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cb767-cf83-40bc-82b9-bff67c611455 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:20.063804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cb767-cf83-40bc-82b9-bff67c611455 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:20.064086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cb767-cf83-40bc-82b9-bff67c611455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:20.072625 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 803/1601] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:20.073508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f89b77-f5c8-43f1-a9f5-d4760eefd28a admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:20.083888 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f89b77-f5c8-43f1-a9f5-d4760eefd28a admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:20.089667 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99be47a-1d2a-47c1-87d1-45a1fdca6ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:20.090433 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99be47a-1d2a-47c1-87d1-45a1fdca6ff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:20.090724 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99be47a-1d2a-47c1-87d1-45a1fdca6ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:20.091036 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99be47a-1d2a-47c1-87d1-45a1fdca6ff0 admin admin] PATH_INFO: `/v3/projects/f801054b0c7b41b48c98dec9b1de85a0/users/84f37cf8cc55438786351c884d2f5843/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:20.092909 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-0e3cb767-cf83-40bc-82b9-bff67c611455 None None] MFA Rules not processed for user `cd605450595c446e887edf13518f542b`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:20.094774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-0e3cb767-cf83-40bc-82b9-bff67c611455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:20.109388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99be47a-1d2a-47c1-87d1-45a1fdca6ff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f801054b0c7b41b48c98dec9b1de85a0, user_id=84f37cf8cc55438786351c884d2f5843, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:20.112105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99be47a-1d2a-47c1-87d1-45a1fdca6ff0 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:20.168061 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 799/1602] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:20.168943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cb767-cf83-40bc-82b9-bff67c611455 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:20.183306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cb767-cf83-40bc-82b9-bff67c611455 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:20.187959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a005c-d9de-46c4-af66-b3f3b9880925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:20.188581 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a005c-d9de-46c4-af66-b3f3b9880925 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:20.188884 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a005c-d9de-46c4-af66-b3f3b9880925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:20.189138 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a005c-d9de-46c4-af66-b3f3b9880925 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:20.189839 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a005c-d9de-46c4-af66-b3f3b9880925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:20.191527 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a005c-d9de-46c4-af66-b3f3b9880925 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:20.202949 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 800/1603] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:20.203811 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a005c-d9de-46c4-af66-b3f3b9880925 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:20.215385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a005c-d9de-46c4-af66-b3f3b9880925 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:20.218334 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 804/1604] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:20 2022] PUT /identity/v3/projects/f801054b0c7b41b48c98dec9b1de85a0/users/84f37cf8cc55438786351c884d2f5843/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:20.220745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99be47a-1d2a-47c1-87d1-45a1fdca6ff0 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:20.279915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:20.286041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ff7fd-9c57-4660-bb13-c80d4f276ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:20.286718 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ff7fd-9c57-4660-bb13-c80d4f276ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:20.287043 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ff7fd-9c57-4660-bb13-c80d4f276ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:20.287323 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ff7fd-9c57-4660-bb13-c80d4f276ea5 admin admin] PATH_INFO: `/v3/projects/3a420d95334148b68d78a6497e0d95f5/users/6ec4b53cb3a64c3aa9cb6a186a61c1fe/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:20.290088 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99be47a-1d2a-47c1-87d1-45a1fdca6ff0 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:20.295113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7270654-0fbb-48e7-b192-c958207e5941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:20.295883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7270654-0fbb-48e7-b192-c958207e5941 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:20.296075 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7270654-0fbb-48e7-b192-c958207e5941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:20.296355 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7270654-0fbb-48e7-b192-c958207e5941 admin admin] PATH_INFO: `/v3/projects/755dcaa4b12d47a18a0603b7fa44a8c3/users/bc9f481cb12e4575b31b2f192fa881ba/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:20.301934 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ff7fd-9c57-4660-bb13-c80d4f276ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a420d95334148b68d78a6497e0d95f5, user_id=6ec4b53cb3a64c3aa9cb6a186a61c1fe, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:20.304616 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ff7fd-9c57-4660-bb13-c80d4f276ea5 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:20.311265 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7270654-0fbb-48e7-b192-c958207e5941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=755dcaa4b12d47a18a0603b7fa44a8c3, user_id=bc9f481cb12e4575b31b2f192fa881ba, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:20.313992 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7270654-0fbb-48e7-b192-c958207e5941 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:20.396010 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 805/1605] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:20 2022] PUT /identity/v3/projects/755dcaa4b12d47a18a0603b7fa44a8c3/users/bc9f481cb12e4575b31b2f192fa881ba/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:20.396893 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 801/1606] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:20 2022] PUT /identity/v3/projects/3a420d95334148b68d78a6497e0d95f5/users/6ec4b53cb3a64c3aa9cb6a186a61c1fe/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:20.397142 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7270654-0fbb-48e7-b192-c958207e5941 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:20.397331 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da680e2-0475-4390-8ce1-959c8fd2cbd3 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:20.397331 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da680e2-0475-4390-8ce1-959c8fd2cbd3 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:20.397331 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da680e2-0475-4390-8ce1-959c8fd2cbd3 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:20.397331 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 802/1607] 10.222.0.64 () {54 vars in 962 bytes} [Wed Aug 3 12:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:59:20.397331 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da680e2-0475-4390-8ce1-959c8fd2cbd3 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:20.477515 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7270654-0fbb-48e7-b192-c958207e5941 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:20.483068 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3b2f8-39c4-4a54-895b-2e49c5bf9533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:20.483910 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3b2f8-39c4-4a54-895b-2e49c5bf9533 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:20.484278 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3b2f8-39c4-4a54-895b-2e49c5bf9533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:20.484676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3b2f8-39c4-4a54-895b-2e49c5bf9533 admin admin] PATH_INFO: `/v3/projects/e45fc343453f4d16a684a034f2ce00a8/users/dfb810a14ad547be8fdb21acb13cd23b/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:20.489561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da680e2-0475-4390-8ce1-959c8fd2cbd3 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:20.494046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae2519-4575-46e9-be1b-19fbca933a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:20.502492 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae2519-4575-46e9-be1b-19fbca933a29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:20.502492 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae2519-4575-46e9-be1b-19fbca933a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:20.502492 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae2519-4575-46e9-be1b-19fbca933a29 admin admin] PATH_INFO: `/v3/projects/23cfcb8de5e448b8af185376a035263b/users/36693fa42a7b41279c8d8c59ecafb243/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:20.509503 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3b2f8-39c4-4a54-895b-2e49c5bf9533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45fc343453f4d16a684a034f2ce00a8, user_id=dfb810a14ad547be8fdb21acb13cd23b, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:20.515578 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3b2f8-39c4-4a54-895b-2e49c5bf9533 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:20.521943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae2519-4575-46e9-be1b-19fbca933a29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23cfcb8de5e448b8af185376a035263b, user_id=36693fa42a7b41279c8d8c59ecafb243, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:20.525030 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae2519-4575-46e9-be1b-19fbca933a29 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:20.621652 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 806/1608] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:20 2022] PUT /identity/v3/projects/e45fc343453f4d16a684a034f2ce00a8/users/dfb810a14ad547be8fdb21acb13cd23b/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:20.626807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 803/1609] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:20 2022] PUT /identity/v3/projects/23cfcb8de5e448b8af185376a035263b/users/36693fa42a7b41279c8d8c59ecafb243/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:20.626807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def1aff-9146-45ec-a99d-e5176f4edfad None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:20.626807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def1aff-9146-45ec-a99d-e5176f4edfad None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:20.626807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def1aff-9146-45ec-a99d-e5176f4edfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:20.635207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e51fc-1ff4-4593-b733-280e30df3931 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:20.635207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e51fc-1ff4-4593-b733-280e30df3931 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:20.635508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e51fc-1ff4-4593-b733-280e30df3931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:20.667603 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-f71e51fc-1ff4-4593-b733-280e30df3931 None None] MFA Rules not processed for user `84f37cf8cc55438786351c884d2f5843`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:20.670612 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-f71e51fc-1ff4-4593-b733-280e30df3931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:20.672806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-8def1aff-9146-45ec-a99d-e5176f4edfad None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:20.674173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-8def1aff-9146-45ec-a99d-e5176f4edfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:20.695101 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:20.745317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 804/1610] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:20.750111 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cc995-ab1a-49e1-9bb3-5359c9d79e66 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:20.750903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cc995-ab1a-49e1-9bb3-5359c9d79e66 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:20.751635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cc995-ab1a-49e1-9bb3-5359c9d79e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:20.756261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 807/1611] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:20.758063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06194a2-e76d-4fb6-9acd-d5dbebc08e2d None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:20.758530 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06194a2-e76d-4fb6-9acd-d5dbebc08e2d None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:20.758842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06194a2-e76d-4fb6-9acd-d5dbebc08e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:20.791366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-d06194a2-e76d-4fb6-9acd-d5dbebc08e2d None None] MFA Rules not processed for user `bc9f481cb12e4575b31b2f192fa881ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:20.792962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d06194a2-e76d-4fb6-9acd-d5dbebc08e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:20.812027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-198cc995-ab1a-49e1-9bb3-5359c9d79e66 None None] MFA Rules not processed for user `bc939818c9224b0ebe2dbaa1eaaec5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:20.813533 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-198cc995-ab1a-49e1-9bb3-5359c9d79e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:20.903090 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:20.924537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 808/1612] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:20.925751 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334ae2e-a7dc-4aa8-b29e-b74b774672b8 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:20.926080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334ae2e-a7dc-4aa8-b29e-b74b774672b8 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:20.926326 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334ae2e-a7dc-4aa8-b29e-b74b774672b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:20.946870 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 805/1613] 10.222.0.64 () {58 vars in 1059 bytes} [Wed Aug 3 12:59:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:20.948637 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830bb16-8deb-405b-970c-d943fc546693 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:20.950552 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830bb16-8deb-405b-970c-d943fc546693 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:20.951006 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830bb16-8deb-405b-970c-d943fc546693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:20.951252 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-f334ae2e-a7dc-4aa8-b29e-b74b774672b8 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:20.952684 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-f334ae2e-a7dc-4aa8-b29e-b74b774672b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:20.961980 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 809/1614] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:20.963674 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334ae2e-a7dc-4aa8-b29e-b74b774672b8 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:20.975078 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334ae2e-a7dc-4aa8-b29e-b74b774672b8 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:20.982146 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606a2cf-3669-456c-bd35-f12353980e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:20.983299 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606a2cf-3669-456c-bd35-f12353980e81 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:20.983742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606a2cf-3669-456c-bd35-f12353980e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:20.984176 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606a2cf-3669-456c-bd35-f12353980e81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:20.984395 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-f830bb16-8deb-405b-970c-d943fc546693 None None] MFA Rules not processed for user `dfb810a14ad547be8fdb21acb13cd23b`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:20.985272 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606a2cf-3669-456c-bd35-f12353980e81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:20.986114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-f830bb16-8deb-405b-970c-d943fc546693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:20.987614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606a2cf-3669-456c-bd35-f12353980e81 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:21.060158 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 806/1615] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:21.065775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830bb16-8deb-405b-970c-d943fc546693 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:21.067661 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-f830bb16-8deb-405b-970c-d943fc546693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:21.082331 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 810/1616] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:20 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:21.084057 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930255e-23ee-4ec9-98c1-0ae54a0ba5ac None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:21.084471 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930255e-23ee-4ec9-98c1-0ae54a0ba5ac None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:21.084750 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930255e-23ee-4ec9-98c1-0ae54a0ba5ac None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:21.091702 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 811/1617] 10.222.0.64 () {54 vars in 962 bytes} [Wed Aug 3 12:59:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:59:21.092557 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930255e-23ee-4ec9-98c1-0ae54a0ba5ac None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:21.158139 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830bb16-8deb-405b-970c-d943fc546693 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:21.192025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930255e-23ee-4ec9-98c1-0ae54a0ba5ac None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:21.197603 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67881e73-4d37-4f2a-9123-243d246f3a86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:21.198845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67881e73-4d37-4f2a-9123-243d246f3a86 service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:21.199127 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67881e73-4d37-4f2a-9123-243d246f3a86 service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:21.199399 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67881e73-4d37-4f2a-9123-243d246f3a86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:21.220255 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700a911-13a9-49d1-8d46-c9aa8498d1f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:21.220894 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700a911-13a9-49d1-8d46-c9aa8498d1f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:21.221034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:21.221425 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700a911-13a9-49d1-8d46-c9aa8498d1f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:21.221720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700a911-13a9-49d1-8d46-c9aa8498d1f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:21.280910 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67881e73-4d37-4f2a-9123-243d246f3a86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:21.283539 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67881e73-4d37-4f2a-9123-243d246f3a86 service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:21.309927 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700a911-13a9-49d1-8d46-c9aa8498d1f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:21.311744 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700a911-13a9-49d1-8d46-c9aa8498d1f9 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:21.314329 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 812/1618] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:21.318987 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67881e73-4d37-4f2a-9123-243d246f3a86 service nova] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:21.328389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 807/1619] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:21.329389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700a911-13a9-49d1-8d46-c9aa8498d1f9 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:21.343292 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:21.361221 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67881e73-4d37-4f2a-9123-243d246f3a86 service nova] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:21.365835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd793b-c95d-46f5-b0fd-1886e055eca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:21.366686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd793b-c95d-46f5-b0fd-1886e055eca5 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:21.367152 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd793b-c95d-46f5-b0fd-1886e055eca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:21.367597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd793b-c95d-46f5-b0fd-1886e055eca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:21.379332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd793b-c95d-46f5-b0fd-1886e055eca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:21.380992 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd793b-c95d-46f5-b0fd-1886e055eca5 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:21.391968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 813/1620] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:21.392917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd793b-c95d-46f5-b0fd-1886e055eca5 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:21.394522 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700a911-13a9-49d1-8d46-c9aa8498d1f9 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:21.398501 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0d298-d174-4519-b558-dd1f542fd86c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:21.399665 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0d298-d174-4519-b558-dd1f542fd86c service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:21.400105 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0d298-d174-4519-b558-dd1f542fd86c service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:21.400549 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0d298-d174-4519-b558-dd1f542fd86c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:21.403587 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd793b-c95d-46f5-b0fd-1886e055eca5 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:21.409193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3c5c8-af7a-44a5-b166-411bd8f68fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:21.409809 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3c5c8-af7a-44a5-b166-411bd8f68fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:21.410096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3c5c8-af7a-44a5-b166-411bd8f68fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:21.410375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3c5c8-af7a-44a5-b166-411bd8f68fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:21.411117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3c5c8-af7a-44a5-b166-411bd8f68fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:21.414120 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3c5c8-af7a-44a5-b166-411bd8f68fd0 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:21.464601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0d298-d174-4519-b558-dd1f542fd86c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:21.466171 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0d298-d174-4519-b558-dd1f542fd86c service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:21.475905 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 808/1621] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:21.477173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912758c3-1883-41f7-ab99-0b820c652eb5 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:21.477423 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912758c3-1883-41f7-ab99-0b820c652eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:21.483409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912758c3-1883-41f7-ab99-0b820c652eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:21.499208 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-912758c3-1883-41f7-ab99-0b820c652eb5 None None] MFA Rules not processed for user `bc939818c9224b0ebe2dbaa1eaaec5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:21.500824 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-912758c3-1883-41f7-ab99-0b820c652eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:21.513418 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 809/1622] 10.222.0.64 () {58 vars in 1059 bytes} [Wed Aug 3 12:59:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:21.521446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912758c3-1883-41f7-ab99-0b820c652eb5 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:21.540781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 814/1623] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:21 2022] POST /identity/v3/users => generated 297 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:21.541360 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912758c3-1883-41f7-ab99-0b820c652eb5 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:21.541626 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3c5c8-af7a-44a5-b166-411bd8f68fd0 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:21.555821 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07e58b-a90d-4640-a534-034c6b4ba3ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:21.556467 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07e58b-a90d-4640-a534-034c6b4ba3ef service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:21.556757 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07e58b-a90d-4640-a534-034c6b4ba3ef service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:21.557871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07e58b-a90d-4640-a534-034c6b4ba3ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:21.578541 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3c5c8-af7a-44a5-b166-411bd8f68fd0 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:21.599623 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce53fa-7e63-42c0-ab48-12420761d881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:21.600933 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce53fa-7e63-42c0-ab48-12420761d881 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:21.601385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce53fa-7e63-42c0-ab48-12420761d881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:21.601811 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce53fa-7e63-42c0-ab48-12420761d881 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:21.602673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce53fa-7e63-42c0-ab48-12420761d881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:21.605160 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce53fa-7e63-42c0-ab48-12420761d881 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:21.643369 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 815/1624] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:21.644305 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce53fa-7e63-42c0-ab48-12420761d881 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:21.665018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07e58b-a90d-4640-a534-034c6b4ba3ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:21.667692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce53fa-7e63-42c0-ab48-12420761d881 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:21.667828 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07e58b-a90d-4640-a534-034c6b4ba3ef service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:21.683656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 810/1625] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:59:21.700735 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291db37-4381-46c4-b46c-8a22bebc68d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:21.701572 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291db37-4381-46c4-b46c-8a22bebc68d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:21.701947 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291db37-4381-46c4-b46c-8a22bebc68d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:21.702470 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291db37-4381-46c4-b46c-8a22bebc68d1 admin admin] PATH_INFO: `/v3/projects/dae007515a884e93965432f1408603a9/users/61fdca7a7c2a4353ad01441312afe8a5/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:21.726175 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce245b-8dcc-41b9-af73-be543c24e403 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:21.726858 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce245b-8dcc-41b9-af73-be543c24e403 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:21.727352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce245b-8dcc-41b9-af73-be543c24e403 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:21.729777 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 811/1626] 10.222.0.64 () {54 vars in 912 bytes} [Wed Aug 3 12:59:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:59:21.735859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52d820-a6ca-40c5-b020-a5a71859a234 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:21.736351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52d820-a6ca-40c5-b020-a5a71859a234 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:21.736822 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52d820-a6ca-40c5-b020-a5a71859a234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:21.742257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291db37-4381-46c4-b46c-8a22bebc68d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae007515a884e93965432f1408603a9, user_id=61fdca7a7c2a4353ad01441312afe8a5, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:21.747489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291db37-4381-46c4-b46c-8a22bebc68d1 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:21.759282 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-eb52d820-a6ca-40c5-b020-a5a71859a234 None None] MFA Rules not processed for user `bc939818c9224b0ebe2dbaa1eaaec5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:21.760955 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-eb52d820-a6ca-40c5-b020-a5a71859a234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:21.782273 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 812/1627] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 3 12:59:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:59:21.787484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52d820-a6ca-40c5-b020-a5a71859a234 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:21.799575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52d820-a6ca-40c5-b020-a5a71859a234 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:21.815899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad90e0-ea14-4dfc-b566-edaa8d0bf7e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:21.818154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad90e0-ea14-4dfc-b566-edaa8d0bf7e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:21.818454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad90e0-ea14-4dfc-b566-edaa8d0bf7e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:21.818762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad90e0-ea14-4dfc-b566-edaa8d0bf7e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:21.848601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad90e0-ea14-4dfc-b566-edaa8d0bf7e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:21.850069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad90e0-ea14-4dfc-b566-edaa8d0bf7e5 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:21.850965 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 816/1628] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:21 2022] PUT /identity/v3/projects/dae007515a884e93965432f1408603a9/users/61fdca7a7c2a4353ad01441312afe8a5/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:21.855321 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291db37-4381-46c4-b46c-8a22bebc68d1 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:21.882380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 813/1629] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:59:21.992472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291db37-4381-46c4-b46c-8a22bebc68d1 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:22.001234 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f6b96-2c2d-4e05-9194-200b66379a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:22.002151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f6b96-2c2d-4e05-9194-200b66379a47 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:22.002493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f6b96-2c2d-4e05-9194-200b66379a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:22.002871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f6b96-2c2d-4e05-9194-200b66379a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:22.003777 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f6b96-2c2d-4e05-9194-200b66379a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:22.005519 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f6b96-2c2d-4e05-9194-200b66379a47 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:22.020488 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 817/1630] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:59:22.024262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad90e0-ea14-4dfc-b566-edaa8d0bf7e5 service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:22.031592 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:22.038159 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad90e0-ea14-4dfc-b566-edaa8d0bf7e5 service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:22.049471 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8e5b9-f9bd-4d54-9a53-88141a7a7733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:22.049471 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8e5b9-f9bd-4d54-9a53-88141a7a7733 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:22.049751 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8e5b9-f9bd-4d54-9a53-88141a7a7733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:22.049992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8e5b9-f9bd-4d54-9a53-88141a7a7733 admin admin] PATH_INFO: `/v3/projects/dae007515a884e93965432f1408603a9/users/61fdca7a7c2a4353ad01441312afe8a5/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:22.054436 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8e5b9-f9bd-4d54-9a53-88141a7a7733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae007515a884e93965432f1408603a9, user_id=61fdca7a7c2a4353ad01441312afe8a5, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:22.058809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8e5b9-f9bd-4d54-9a53-88141a7a7733 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:22.077883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 814/1631] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:22 2022] PUT /identity/v3/projects/dae007515a884e93965432f1408603a9/users/61fdca7a7c2a4353ad01441312afe8a5/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:22.097060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7437b3-8ab4-46db-9433-634ee8e7a4e1 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:22.098020 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7437b3-8ab4-46db-9433-634ee8e7a4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:22.098401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7437b3-8ab4-46db-9433-634ee8e7a4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:22.180059 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-8e7437b3-8ab4-46db-9433-634ee8e7a4e1 None None] MFA Rules not processed for user `61fdca7a7c2a4353ad01441312afe8a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:22.181894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-8e7437b3-8ab4-46db-9433-634ee8e7a4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:22.228367 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d813f-aa56-4593-b583-25067528edb5 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:22.228670 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d813f-aa56-4593-b583-25067528edb5 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:22.228959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d813f-aa56-4593-b583-25067528edb5 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:22.231241 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 815/1632] 10.222.0.64 () {54 vars in 912 bytes} [Wed Aug 3 12:59:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:59:22.238638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a69865-2ebb-4779-b3ed-8bd5c5487031 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:22.239008 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a69865-2ebb-4779-b3ed-8bd5c5487031 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:22.239290 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a69865-2ebb-4779-b3ed-8bd5c5487031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:22.274926 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-56a69865-2ebb-4779-b3ed-8bd5c5487031 None None] MFA Rules not processed for user `bc939818c9224b0ebe2dbaa1eaaec5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:22.278938 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-56a69865-2ebb-4779-b3ed-8bd5c5487031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:22.290414 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:22.349341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 818/1633] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:22.350433 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7437b3-8ab4-46db-9433-634ee8e7a4e1 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:22.393198 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 816/1634] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 3 12:59:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:59:22.401804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a69865-2ebb-4779-b3ed-8bd5c5487031 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:22.435966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7437b3-8ab4-46db-9433-634ee8e7a4e1 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:22.443101 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be23c25-0562-4a16-8619-06fffe799626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:22.443972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be23c25-0562-4a16-8619-06fffe799626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:22.444356 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be23c25-0562-4a16-8619-06fffe799626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:22.444741 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be23c25-0562-4a16-8619-06fffe799626 admin admin] PATH_INFO: `/v3/users/cd605450595c446e887edf13518f542b` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:22.446318 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be23c25-0562-4a16-8619-06fffe799626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd605450595c446e887edf13518f542b)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:22.447641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: WARNING py.warnings [None req-0be23c25-0562-4a16-8619-06fffe799626 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:59:22.447641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: warnings.warn(msg) Aug 03 12:59:22.447641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: Aug 03 12:59:22.449674 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be23c25-0562-4a16-8619-06fffe799626 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:22.512059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a69865-2ebb-4779-b3ed-8bd5c5487031 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:22.516091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c4176-eb5b-44fb-a33a-a412ed25152b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:22.516742 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c4176-eb5b-44fb-a33a-a412ed25152b service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:22.517030 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c4176-eb5b-44fb-a33a-a412ed25152b service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:22.517314 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c4176-eb5b-44fb-a33a-a412ed25152b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:22.534297 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c4176-eb5b-44fb-a33a-a412ed25152b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:22.535820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c4176-eb5b-44fb-a33a-a412ed25152b service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:22.548171 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 817/1635] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:22.614222 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c4176-eb5b-44fb-a33a-a412ed25152b service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:22.629930 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c4176-eb5b-44fb-a33a-a412ed25152b service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:22.634942 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0986e18-a57e-4ccf-a9df-7f98ffbeb5aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:22.636559 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0986e18-a57e-4ccf-a9df-7f98ffbeb5aa service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:22.636887 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0986e18-a57e-4ccf-a9df-7f98ffbeb5aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:22.637922 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0986e18-a57e-4ccf-a9df-7f98ffbeb5aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:22.651895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0986e18-a57e-4ccf-a9df-7f98ffbeb5aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:22.653689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0986e18-a57e-4ccf-a9df-7f98ffbeb5aa service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:22.666631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 818/1636] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:22.768849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0be23c25-0562-4a16-8619-06fffe799626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd605450595c446e887edf13518f542b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:22.789556 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0be23c25-0562-4a16-8619-06fffe799626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd605450595c446e887edf13518f542b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:22.789898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0be23c25-0562-4a16-8619-06fffe799626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd605450595c446e887edf13518f542b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:22.832671 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0be23c25-0562-4a16-8619-06fffe799626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd605450595c446e887edf13518f542b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:22.833596 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0be23c25-0562-4a16-8619-06fffe799626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd605450595c446e887edf13518f542b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:22.984758 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 819/1637] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 12:59:22 2022] DELETE /identity/v3/users/cd605450595c446e887edf13518f542b => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:22.989863 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe6eab-0d57-4573-8692-f279e3d778e1 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:22.990182 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe6eab-0d57-4573-8692-f279e3d778e1 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:22.990468 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe6eab-0d57-4573-8692-f279e3d778e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:23.026032 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-16fe6eab-0d57-4573-8692-f279e3d778e1 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:23.029707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-16fe6eab-0d57-4573-8692-f279e3d778e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:23.184986 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 819/1638] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:23.214434 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be23c25-0562-4a16-8619-06fffe799626 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:23.214434 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-0be23c25-0562-4a16-8619-06fffe799626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:23.596332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be23c25-0562-4a16-8619-06fffe799626 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:23.596332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f0b0f-a8d6-4c31-8e85-cf7bec902c09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:23.596332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f0b0f-a8d6-4c31-8e85-cf7bec902c09 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:23.596332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f0b0f-a8d6-4c31-8e85-cf7bec902c09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:23.597184 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f0b0f-a8d6-4c31-8e85-cf7bec902c09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:23.597184 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:23.597184 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f0b0f-a8d6-4c31-8e85-cf7bec902c09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:23.597184 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f0b0f-a8d6-4c31-8e85-cf7bec902c09 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:23.597184 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 820/1639] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:24.514288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe6eab-0d57-4573-8692-f279e3d778e1 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:24.515843 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-16fe6eab-0d57-4573-8692-f279e3d778e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:24.558834 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:24.727366 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe6eab-0d57-4573-8692-f279e3d778e1 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:24.736015 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97540db-2ff8-4ea0-bf6e-77ba134baf74 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fdca7a7c2a4353ad01441312afe8a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae007515a884e93965432f1408603a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:24.736967 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97540db-2ff8-4ea0-bf6e-77ba134baf74 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:24.737249 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97540db-2ff8-4ea0-bf6e-77ba134baf74 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:24.737526 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97540db-2ff8-4ea0-bf6e-77ba134baf74 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:24.738249 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97540db-2ff8-4ea0-bf6e-77ba134baf74 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:59:24.738758 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97540db-2ff8-4ea0-bf6e-77ba134baf74 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:24.740589 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97540db-2ff8-4ea0-bf6e-77ba134baf74 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:24.761407 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 820/1640] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 12:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:59:24.765467 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f0b0f-a8d6-4c31-8e85-cf7bec902c09 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:24.777079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f0b0f-a8d6-4c31-8e85-cf7bec902c09 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:24.792111 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c1ffc-f99c-4dff-a910-2e34a40fe5b4 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fdca7a7c2a4353ad01441312afe8a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae007515a884e93965432f1408603a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:24.792994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c1ffc-f99c-4dff-a910-2e34a40fe5b4 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:24.793286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c1ffc-f99c-4dff-a910-2e34a40fe5b4 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:24.793566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c1ffc-f99c-4dff-a910-2e34a40fe5b4 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:24.794279 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c1ffc-f99c-4dff-a910-2e34a40fe5b4 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:24.796249 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c1ffc-f99c-4dff-a910-2e34a40fe5b4 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:24.905498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 821/1641] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:24 2022] POST /identity/v3/projects => generated 353 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:24.910299 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97540db-2ff8-4ea0-bf6e-77ba134baf74 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:24.925842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97540db-2ff8-4ea0-bf6e-77ba134baf74 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:25.041055 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c1ffc-f99c-4dff-a910-2e34a40fe5b4 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:25.043504 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-0a6c1ffc-f99c-4dff-a910-2e34a40fe5b4 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:25.068854 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007aa37-ed74-488f-b4d2-2c9ce95728ba tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fdca7a7c2a4353ad01441312afe8a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae007515a884e93965432f1408603a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:25.070283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007aa37-ed74-488f-b4d2-2c9ce95728ba tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:25.070683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007aa37-ed74-488f-b4d2-2c9ce95728ba tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:25.071183 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007aa37-ed74-488f-b4d2-2c9ce95728ba tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:25.072829 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007aa37-ed74-488f-b4d2-2c9ce95728ba tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:59:25.073378 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007aa37-ed74-488f-b4d2-2c9ce95728ba tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:25.078538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007aa37-ed74-488f-b4d2-2c9ce95728ba tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:25.108782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 821/1642] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 12:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:59:25.201496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007aa37-ed74-488f-b4d2-2c9ce95728ba tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:25.219870 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007aa37-ed74-488f-b4d2-2c9ce95728ba tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:25.230388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c1ffc-f99c-4dff-a910-2e34a40fe5b4 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:25.238006 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b6fa3-092b-4da6-bf06-ce6f0461b6c2 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61fdca7a7c2a4353ad01441312afe8a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae007515a884e93965432f1408603a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:25.238691 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b6fa3-092b-4da6-bf06-ce6f0461b6c2 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:25.239030 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b6fa3-092b-4da6-bf06-ce6f0461b6c2 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:25.239310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b6fa3-092b-4da6-bf06-ce6f0461b6c2 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] PATH_INFO: `/v3/projects/344d72ba5f89450aa8b9a1921cde2f2d` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:25.240559 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b6fa3-092b-4da6-bf06-ce6f0461b6c2 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] RBAC: Authorizing `identity:delete_project(project_id=344d72ba5f89450aa8b9a1921cde2f2d)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:25.241332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232a4d9-ea63-4c44-a1b9-9af1d219baf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:25.242181 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232a4d9-ea63-4c44-a1b9-9af1d219baf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:25.242611 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232a4d9-ea63-4c44-a1b9-9af1d219baf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:25.243250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: WARNING py.warnings [None req-9b3b6fa3-092b-4da6-bf06-ce6f0461b6c2 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:59:25.243250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: warnings.warn(msg) Aug 03 12:59:25.243250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: Aug 03 12:59:25.243777 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232a4d9-ea63-4c44-a1b9-9af1d219baf4 admin admin] PATH_INFO: `/v3/projects/e20045ed345344aa827297413436e734` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:25.244438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b6fa3-092b-4da6-bf06-ce6f0461b6c2 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:25.245783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232a4d9-ea63-4c44-a1b9-9af1d219baf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e20045ed345344aa827297413436e734)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:25.248234 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232a4d9-ea63-4c44-a1b9-9af1d219baf4 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:25.408176 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5232a4d9-ea63-4c44-a1b9-9af1d219baf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e20045ed345344aa827297413436e734', 'request_id': 'req-5232a4d9-ea63-4c44-a1b9-9af1d219baf4'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:25.433074 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5232a4d9-ea63-4c44-a1b9-9af1d219baf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e20045ed345344aa827297413436e734', 'request_id': 'req-5232a4d9-ea63-4c44-a1b9-9af1d219baf4'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:25.556169 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-9b3b6fa3-092b-4da6-bf06-ce6f0461b6c2 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '344d72ba5f89450aa8b9a1921cde2f2d', 'request_id': 'req-9b3b6fa3-092b-4da6-bf06-ce6f0461b6c2'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:25.556169 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-9b3b6fa3-092b-4da6-bf06-ce6f0461b6c2 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '344d72ba5f89450aa8b9a1921cde2f2d', 'request_id': 'req-9b3b6fa3-092b-4da6-bf06-ce6f0461b6c2'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:25.662576 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5232a4d9-ea63-4c44-a1b9-9af1d219baf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e20045ed345344aa827297413436e734', 'request_id': 'req-5232a4d9-ea63-4c44-a1b9-9af1d219baf4'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:25.684448 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5232a4d9-ea63-4c44-a1b9-9af1d219baf4 admin admin] The token cache is being invalidate because project e20045ed345344aa827297413436e734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:59:25.684675 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5232a4d9-ea63-4c44-a1b9-9af1d219baf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:25.686025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5232a4d9-ea63-4c44-a1b9-9af1d219baf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:25.687953 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 822/1643] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 12:59:25 2022] DELETE /identity/v3/projects/e20045ed345344aa827297413436e734 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:25.692763 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb29e31-3a02-4752-8668-b555ed11aa36 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:25.693061 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb29e31-3a02-4752-8668-b555ed11aa36 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:25.693527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb29e31-3a02-4752-8668-b555ed11aa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:25.731827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-deb29e31-3a02-4752-8668-b555ed11aa36 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:25.733138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-deb29e31-3a02-4752-8668-b555ed11aa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:25.808933 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-9b3b6fa3-092b-4da6-bf06-ce6f0461b6c2 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '344d72ba5f89450aa8b9a1921cde2f2d', 'request_id': 'req-9b3b6fa3-092b-4da6-bf06-ce6f0461b6c2'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:25.823705 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 823/1644] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:59:25.826320 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb44ace-8d0b-4099-a107-1a7e1ec70413 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:25.826880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb44ace-8d0b-4099-a107-1a7e1ec70413 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:25.827380 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb44ace-8d0b-4099-a107-1a7e1ec70413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:25.829465 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-9b3b6fa3-092b-4da6-bf06-ce6f0461b6c2 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] The token cache is being invalidate because project 344d72ba5f89450aa8b9a1921cde2f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:59:25.829465 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-9b3b6fa3-092b-4da6-bf06-ce6f0461b6c2 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:25.830182 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-9b3b6fa3-092b-4da6-bf06-ce6f0461b6c2 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:25.832218 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 822/1645] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 12:59:25 2022] DELETE /identity/v3/projects/344d72ba5f89450aa8b9a1921cde2f2d => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:25.868906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-bcb44ace-8d0b-4099-a107-1a7e1ec70413 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:25.870521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-bcb44ace-8d0b-4099-a107-1a7e1ec70413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:25.889192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b6fa3-092b-4da6-bf06-ce6f0461b6c2 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:25.889545 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 824/1646] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:25.903915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b6fa3-092b-4da6-bf06-ce6f0461b6c2 tempest-VolumeQuotaClassesTest-2120171371 tempest-VolumeQuotaClassesTest-2120171371-project-admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:25.920261 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacd019-9575-4d8d-a4ab-9db74ef4ea3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:25.920922 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacd019-9575-4d8d-a4ab-9db74ef4ea3a admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:25.921439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacd019-9575-4d8d-a4ab-9db74ef4ea3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:25.921638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacd019-9575-4d8d-a4ab-9db74ef4ea3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:25.922369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcacd019-9575-4d8d-a4ab-9db74ef4ea3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:59:25.922689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcacd019-9575-4d8d-a4ab-9db74ef4ea3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:25.924392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcacd019-9575-4d8d-a4ab-9db74ef4ea3a admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:25.956716 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 823/1647] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 12:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:59:25.958172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb44ace-8d0b-4099-a107-1a7e1ec70413 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:25.983592 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb44ace-8d0b-4099-a107-1a7e1ec70413 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:25.995677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889e117-ce07-46a3-a03b-ca6ee20a9c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:25.996326 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889e117-ce07-46a3-a03b-ca6ee20a9c26 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:25.996616 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889e117-ce07-46a3-a03b-ca6ee20a9c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:25.996900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889e117-ce07-46a3-a03b-ca6ee20a9c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:25.997591 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889e117-ce07-46a3-a03b-ca6ee20a9c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:25.999552 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889e117-ce07-46a3-a03b-ca6ee20a9c26 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:26.161468 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 825/1648] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:25 2022] POST /identity/v3/projects => generated 387 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:59:26.165524 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacd019-9575-4d8d-a4ab-9db74ef4ea3a admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:26.188084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacd019-9575-4d8d-a4ab-9db74ef4ea3a admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:26.291418 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c2cd2-d0d0-4297-bd6f-9079b1db237b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:26.299122 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c2cd2-d0d0-4297-bd6f-9079b1db237b admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:26.299122 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c2cd2-d0d0-4297-bd6f-9079b1db237b admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:26.299122 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c2cd2-d0d0-4297-bd6f-9079b1db237b admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:26.299122 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c2cd2-d0d0-4297-bd6f-9079b1db237b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:26.299122 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c2cd2-d0d0-4297-bd6f-9079b1db237b admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:26.400412 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889e117-ce07-46a3-a03b-ca6ee20a9c26 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:26.406435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 824/1649] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:26 2022] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:26.426055 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889e117-ce07-46a3-a03b-ca6ee20a9c26 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:26.450593 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865172bf-bcdb-4081-a7df-5e1d9eff8bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:26.456439 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865172bf-bcdb-4081-a7df-5e1d9eff8bab admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:26.456439 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865172bf-bcdb-4081-a7df-5e1d9eff8bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:26.456439 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865172bf-bcdb-4081-a7df-5e1d9eff8bab admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:26.459493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865172bf-bcdb-4081-a7df-5e1d9eff8bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:26.461400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865172bf-bcdb-4081-a7df-5e1d9eff8bab admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:26.498038 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 826/1650] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:26.498295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c2cd2-d0d0-4297-bd6f-9079b1db237b admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:26.528673 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c2cd2-d0d0-4297-bd6f-9079b1db237b admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:26.543975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe13ac-0c1e-4830-bf42-c35875cd18df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:26.545726 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe13ac-0c1e-4830-bf42-c35875cd18df admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:26.546787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe13ac-0c1e-4830-bf42-c35875cd18df admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:26.548035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe13ac-0c1e-4830-bf42-c35875cd18df admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:26.549294 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe13ac-0c1e-4830-bf42-c35875cd18df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:26.555071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe13ac-0c1e-4830-bf42-c35875cd18df admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:26.596699 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 825/1651] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:26.597728 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865172bf-bcdb-4081-a7df-5e1d9eff8bab admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:26.612444 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865172bf-bcdb-4081-a7df-5e1d9eff8bab admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:26.626055 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91240461-1ff2-440a-a0d3-0a3d0fe20568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:26.627044 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91240461-1ff2-440a-a0d3-0a3d0fe20568 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:26.627478 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91240461-1ff2-440a-a0d3-0a3d0fe20568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:26.627902 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91240461-1ff2-440a-a0d3-0a3d0fe20568 admin admin] PATH_INFO: `/v3/projects/90aac386ff81446491632f21206e2648/users/09df5a81d97e4850993073b36fae5e31/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:26.648636 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:26.673451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91240461-1ff2-440a-a0d3-0a3d0fe20568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90aac386ff81446491632f21206e2648, user_id=09df5a81d97e4850993073b36fae5e31, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:26.676225 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91240461-1ff2-440a-a0d3-0a3d0fe20568 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:26.802223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe13ac-0c1e-4830-bf42-c35875cd18df admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:26.804653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-53fe13ac-0c1e-4830-bf42-c35875cd18df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:26.812235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 827/1652] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:26 2022] PUT /identity/v3/projects/90aac386ff81446491632f21206e2648/users/09df5a81d97e4850993073b36fae5e31/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:26.823595 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a27b1-90ad-4c8d-9ac5-4cf88a44a5fb None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:26.823895 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a27b1-90ad-4c8d-9ac5-4cf88a44a5fb None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:26.824420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a27b1-90ad-4c8d-9ac5-4cf88a44a5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:26.854582 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe13ac-0c1e-4830-bf42-c35875cd18df admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:26.908561 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-210a27b1-90ad-4c8d-9ac5-4cf88a44a5fb None None] MFA Rules not processed for user `09df5a81d97e4850993073b36fae5e31`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:26.915077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-210a27b1-90ad-4c8d-9ac5-4cf88a44a5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:26.987529 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:27.081172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 828/1653] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:27.085282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a27b1-90ad-4c8d-9ac5-4cf88a44a5fb None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:27.092155 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51024bd7-5d80-4635-ac43-29d6b364e98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:27.093010 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51024bd7-5d80-4635-ac43-29d6b364e98b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:27.093305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51024bd7-5d80-4635-ac43-29d6b364e98b admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:27.095834 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51024bd7-5d80-4635-ac43-29d6b364e98b admin admin] PATH_INFO: `/v3/users/84f37cf8cc55438786351c884d2f5843` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:27.102539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51024bd7-5d80-4635-ac43-29d6b364e98b admin admin] RBAC: Authorizing `identity:delete_user(user_id=84f37cf8cc55438786351c884d2f5843)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:27.109317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51024bd7-5d80-4635-ac43-29d6b364e98b admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:27.110668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a27b1-90ad-4c8d-9ac5-4cf88a44a5fb None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:27.123736 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda638f2-17ec-4671-80d8-59fa0b93b0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:27.124763 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda638f2-17ec-4671-80d8-59fa0b93b0cd admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:27.125291 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda638f2-17ec-4671-80d8-59fa0b93b0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:27.125768 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda638f2-17ec-4671-80d8-59fa0b93b0cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:27.126630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda638f2-17ec-4671-80d8-59fa0b93b0cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:27.128912 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda638f2-17ec-4671-80d8-59fa0b93b0cd admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:27.246586 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 829/1654] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:27 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:59:27.249961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda638f2-17ec-4671-80d8-59fa0b93b0cd admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:27.375687 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-51024bd7-5d80-4635-ac43-29d6b364e98b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84f37cf8cc55438786351c884d2f5843'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:27.380128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda638f2-17ec-4671-80d8-59fa0b93b0cd admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:27.391726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551b0c9-d743-498a-a313-082d2f2d6021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:27.392490 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551b0c9-d743-498a-a313-082d2f2d6021 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:27.392851 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551b0c9-d743-498a-a313-082d2f2d6021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:27.393763 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551b0c9-d743-498a-a313-082d2f2d6021 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:27.393933 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-51024bd7-5d80-4635-ac43-29d6b364e98b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84f37cf8cc55438786351c884d2f5843'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:27.394627 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551b0c9-d743-498a-a313-082d2f2d6021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:27.396772 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551b0c9-d743-498a-a313-082d2f2d6021 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:27.473932 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-51024bd7-5d80-4635-ac43-29d6b364e98b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84f37cf8cc55438786351c884d2f5843'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:27.475190 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-51024bd7-5d80-4635-ac43-29d6b364e98b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84f37cf8cc55438786351c884d2f5843'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:27.484189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 830/1655] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:27 2022] POST /identity/v3/users => generated 300 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:27.487745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551b0c9-d743-498a-a313-082d2f2d6021 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:27.518256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-51024bd7-5d80-4635-ac43-29d6b364e98b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84f37cf8cc55438786351c884d2f5843'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:27.521998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551b0c9-d743-498a-a313-082d2f2d6021 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:27.533291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 826/1656] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 12:59:26 2022] DELETE /identity/v3/users/84f37cf8cc55438786351c884d2f5843 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:59:27.534791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1692d9-ab2c-4121-a948-4b28c9925cdd None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:27.535091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1692d9-ab2c-4121-a948-4b28c9925cdd None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:27.535376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1692d9-ab2c-4121-a948-4b28c9925cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:27.538918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cf229-b686-4401-89cf-35ab7f471258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:27.539646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cf229-b686-4401-89cf-35ab7f471258 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:27.540307 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cf229-b686-4401-89cf-35ab7f471258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:27.540738 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cf229-b686-4401-89cf-35ab7f471258 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:27.541425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cf229-b686-4401-89cf-35ab7f471258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:27.543711 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cf229-b686-4401-89cf-35ab7f471258 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:27.566305 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 831/1657] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:59:27.571154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cf229-b686-4401-89cf-35ab7f471258 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:27.572777 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-9e1692d9-ab2c-4121-a948-4b28c9925cdd None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:27.574425 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-9e1692d9-ab2c-4121-a948-4b28c9925cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:27.575342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-749cf229-b686-4401-89cf-35ab7f471258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:27.602120 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cf229-b686-4401-89cf-35ab7f471258 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:27.713043 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 827/1658] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:27.726437 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a8fb2-4d73-4a0b-9956-22ca07f63fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:27.727663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a8fb2-4d73-4a0b-9956-22ca07f63fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:27.728171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a8fb2-4d73-4a0b-9956-22ca07f63fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:27.728648 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a8fb2-4d73-4a0b-9956-22ca07f63fe3 admin admin] PATH_INFO: `/v3/projects/a188bea26f1c463faa373ab07d54def5/users/b1ca16a909f44a53bef229d16a3e224d/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:27.748526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a8fb2-4d73-4a0b-9956-22ca07f63fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a188bea26f1c463faa373ab07d54def5, user_id=b1ca16a909f44a53bef229d16a3e224d, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:27.752556 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a8fb2-4d73-4a0b-9956-22ca07f63fe3 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:27.768899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1692d9-ab2c-4121-a948-4b28c9925cdd None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:27.771644 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-9e1692d9-ab2c-4121-a948-4b28c9925cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:27.849547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1692d9-ab2c-4121-a948-4b28c9925cdd None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:27.853986 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b6be0-1de5-4bf0-a4a5-95cb95e35db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:27.854628 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b6be0-1de5-4bf0-a4a5-95cb95e35db4 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:27.854945 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b6be0-1de5-4bf0-a4a5-95cb95e35db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:27.855227 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b6be0-1de5-4bf0-a4a5-95cb95e35db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:27.865788 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b6be0-1de5-4bf0-a4a5-95cb95e35db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:27.867315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b6be0-1de5-4bf0-a4a5-95cb95e35db4 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:27.879982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 828/1659] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:27.897794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 832/1660] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:27 2022] PUT /identity/v3/projects/a188bea26f1c463faa373ab07d54def5/users/b1ca16a909f44a53bef229d16a3e224d/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:27.905034 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b6be0-1de5-4bf0-a4a5-95cb95e35db4 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:27.917667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b6be0-1de5-4bf0-a4a5-95cb95e35db4 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:27.995814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7499f-ff98-4df0-b18e-3ffc009c29a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:27.995814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7499f-ff98-4df0-b18e-3ffc009c29a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:27.995814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7499f-ff98-4df0-b18e-3ffc009c29a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:27.995814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7499f-ff98-4df0-b18e-3ffc009c29a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:27.996221 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7499f-ff98-4df0-b18e-3ffc009c29a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:27.997955 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7499f-ff98-4df0-b18e-3ffc009c29a0 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:28.015345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 829/1661] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:28.015680 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a8fb2-4d73-4a0b-9956-22ca07f63fe3 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:28.030270 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a8fb2-4d73-4a0b-9956-22ca07f63fe3 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:28.035973 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1628e21-092d-4df4-9700-8f1fc13fdf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:28.036966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1628e21-092d-4df4-9700-8f1fc13fdf34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:28.037266 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1628e21-092d-4df4-9700-8f1fc13fdf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:28.037552 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1628e21-092d-4df4-9700-8f1fc13fdf34 admin admin] PATH_INFO: `/v3/projects/a188bea26f1c463faa373ab07d54def5/users/b1ca16a909f44a53bef229d16a3e224d/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:28.040227 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1628e21-092d-4df4-9700-8f1fc13fdf34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a188bea26f1c463faa373ab07d54def5, user_id=b1ca16a909f44a53bef229d16a3e224d, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:28.045762 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1628e21-092d-4df4-9700-8f1fc13fdf34 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:28.059891 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 833/1662] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:28 2022] PUT /identity/v3/projects/a188bea26f1c463faa373ab07d54def5/users/b1ca16a909f44a53bef229d16a3e224d/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:28.071857 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36b716-e485-48a5-a170-946295e1ff07 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:28.072124 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36b716-e485-48a5-a170-946295e1ff07 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:28.072418 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36b716-e485-48a5-a170-946295e1ff07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:28.113577 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-aa36b716-e485-48a5-a170-946295e1ff07 None None] MFA Rules not processed for user `b1ca16a909f44a53bef229d16a3e224d`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:28.115615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-aa36b716-e485-48a5-a170-946295e1ff07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:28.226804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 830/1663] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:28 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:28.239402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1628e21-092d-4df4-9700-8f1fc13fdf34 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:28.243653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b1628e21-092d-4df4-9700-8f1fc13fdf34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:28.484480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1628e21-092d-4df4-9700-8f1fc13fdf34 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:28.502324 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92525a9f-8c1b-4b61-9d79-1f07682d65a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:28.504690 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92525a9f-8c1b-4b61-9d79-1f07682d65a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:28.505265 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92525a9f-8c1b-4b61-9d79-1f07682d65a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:28.506115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92525a9f-8c1b-4b61-9d79-1f07682d65a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:28.537710 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92525a9f-8c1b-4b61-9d79-1f07682d65a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:28.539504 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92525a9f-8c1b-4b61-9d79-1f07682d65a3 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:28.597176 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 834/1664] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:28 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:59:28.647102 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36b716-e485-48a5-a170-946295e1ff07 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:28.648766 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-aa36b716-e485-48a5-a170-946295e1ff07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:28.725385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:28.791147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92525a9f-8c1b-4b61-9d79-1f07682d65a3 service cinder] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:28.861575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36b716-e485-48a5-a170-946295e1ff07 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:28.872111 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e166a07-d9dc-49c6-a37b-4983a2bcea9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:28.873495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e166a07-d9dc-49c6-a37b-4983a2bcea9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:28.873495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e166a07-d9dc-49c6-a37b-4983a2bcea9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:28.873495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e166a07-d9dc-49c6-a37b-4983a2bcea9d admin admin] PATH_INFO: `/v3/users/bc9f481cb12e4575b31b2f192fa881ba` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:28.883450 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e166a07-d9dc-49c6-a37b-4983a2bcea9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc9f481cb12e4575b31b2f192fa881ba)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:28.887845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e166a07-d9dc-49c6-a37b-4983a2bcea9d admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:28.956422 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92525a9f-8c1b-4b61-9d79-1f07682d65a3 service cinder] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:28.977063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f958481-4439-49fd-a790-f1b727d8bfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:28.978670 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f958481-4439-49fd-a790-f1b727d8bfda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:28.984433 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f958481-4439-49fd-a790-f1b727d8bfda admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:28.984433 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f958481-4439-49fd-a790-f1b727d8bfda admin admin] PATH_INFO: `/v3/users/09df5a81d97e4850993073b36fae5e31` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:28.985922 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f958481-4439-49fd-a790-f1b727d8bfda admin admin] RBAC: Authorizing `identity:delete_user(user_id=09df5a81d97e4850993073b36fae5e31)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:28.991425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f958481-4439-49fd-a790-f1b727d8bfda admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:29.084161 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:29.243785 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0e166a07-d9dc-49c6-a37b-4983a2bcea9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc9f481cb12e4575b31b2f192fa881ba'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:29.275380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0e166a07-d9dc-49c6-a37b-4983a2bcea9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc9f481cb12e4575b31b2f192fa881ba'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:29.338666 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-1f958481-4439-49fd-a790-f1b727d8bfda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09df5a81d97e4850993073b36fae5e31'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:29.381786 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-1f958481-4439-49fd-a790-f1b727d8bfda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09df5a81d97e4850993073b36fae5e31'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:29.383845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-1f958481-4439-49fd-a790-f1b727d8bfda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09df5a81d97e4850993073b36fae5e31'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:29.415423 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0e166a07-d9dc-49c6-a37b-4983a2bcea9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc9f481cb12e4575b31b2f192fa881ba'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:29.417020 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0e166a07-d9dc-49c6-a37b-4983a2bcea9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc9f481cb12e4575b31b2f192fa881ba'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:29.458144 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-1f958481-4439-49fd-a790-f1b727d8bfda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09df5a81d97e4850993073b36fae5e31'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:29.460234 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0e166a07-d9dc-49c6-a37b-4983a2bcea9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc9f481cb12e4575b31b2f192fa881ba'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:29.460841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-1f958481-4439-49fd-a790-f1b727d8bfda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09df5a81d97e4850993073b36fae5e31'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:29.473632 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 831/1665] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 12:59:28 2022] DELETE /identity/v3/users/bc9f481cb12e4575b31b2f192fa881ba => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:29.478188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9537a0-b24c-456c-ac2b-30fb30faf42d None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:29.479396 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9537a0-b24c-456c-ac2b-30fb30faf42d None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:29.484602 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9537a0-b24c-456c-ac2b-30fb30faf42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:29.534697 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-8e9537a0-b24c-456c-ac2b-30fb30faf42d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:29.538765 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-8e9537a0-b24c-456c-ac2b-30fb30faf42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:29.619053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 835/1666] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 12:59:28 2022] DELETE /identity/v3/users/09df5a81d97e4850993073b36fae5e31 => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:29.623854 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11805866-627b-4e8c-8c18-bcbd7ecd18cf None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:29.624283 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11805866-627b-4e8c-8c18-bcbd7ecd18cf None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:29.624831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11805866-627b-4e8c-8c18-bcbd7ecd18cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:29.708245 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-11805866-627b-4e8c-8c18-bcbd7ecd18cf None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:29.715509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-11805866-627b-4e8c-8c18-bcbd7ecd18cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:29.794452 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 832/1667] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:29.923790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9537a0-b24c-456c-ac2b-30fb30faf42d None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:29.925625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-8e9537a0-b24c-456c-ac2b-30fb30faf42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:30.026237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:30.042966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 836/1668] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:59:30.075411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11805866-627b-4e8c-8c18-bcbd7ecd18cf None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:30.077502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-11805866-627b-4e8c-8c18-bcbd7ecd18cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:30.139419 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9537a0-b24c-456c-ac2b-30fb30faf42d None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:30.263859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11805866-627b-4e8c-8c18-bcbd7ecd18cf None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:30.267280 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98acdf8-7eb6-4cba-9733-5488c51ebc74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:30.268220 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98acdf8-7eb6-4cba-9733-5488c51ebc74 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:30.268754 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98acdf8-7eb6-4cba-9733-5488c51ebc74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:30.269226 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98acdf8-7eb6-4cba-9733-5488c51ebc74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:30.276351 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7abf4e-4f25-4a13-8ed0-5368d50eb9c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:30.276803 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7abf4e-4f25-4a13-8ed0-5368d50eb9c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:30.277099 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7abf4e-4f25-4a13-8ed0-5368d50eb9c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:30.277410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7abf4e-4f25-4a13-8ed0-5368d50eb9c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:30.297797 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98acdf8-7eb6-4cba-9733-5488c51ebc74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:30.299776 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98acdf8-7eb6-4cba-9733-5488c51ebc74 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:30.304887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7abf4e-4f25-4a13-8ed0-5368d50eb9c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:30.306460 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7abf4e-4f25-4a13-8ed0-5368d50eb9c5 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:30.342662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 833/1669] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:59:30.350329 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 837/1670] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:59:30.662677 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98acdf8-7eb6-4cba-9733-5488c51ebc74 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:30.664664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b98acdf8-7eb6-4cba-9733-5488c51ebc74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:30.696234 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98acdf8-7eb6-4cba-9733-5488c51ebc74 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:30.712433 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09677fac-4eec-46e6-ab9b-c4768131ad95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:30.713158 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09677fac-4eec-46e6-ab9b-c4768131ad95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:30.713791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09677fac-4eec-46e6-ab9b-c4768131ad95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:30.713791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09677fac-4eec-46e6-ab9b-c4768131ad95 admin admin] PATH_INFO: `/v3/projects/f801054b0c7b41b48c98dec9b1de85a0` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:30.716323 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09677fac-4eec-46e6-ab9b-c4768131ad95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f801054b0c7b41b48c98dec9b1de85a0)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:30.718618 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09677fac-4eec-46e6-ab9b-c4768131ad95 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:30.778439 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef5ff6-ca17-4f9a-84ab-8513de863116 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:30.778790 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef5ff6-ca17-4f9a-84ab-8513de863116 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:30.779076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef5ff6-ca17-4f9a-84ab-8513de863116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:30.857578 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-9eef5ff6-ca17-4f9a-84ab-8513de863116 None None] MFA Rules not processed for user `bb5f78a0ee0642c7bbde2ecf34e090d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:30.857578 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-9eef5ff6-ca17-4f9a-84ab-8513de863116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:30.912117 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-09677fac-4eec-46e6-ab9b-c4768131ad95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f801054b0c7b41b48c98dec9b1de85a0', 'request_id': 'req-09677fac-4eec-46e6-ab9b-c4768131ad95'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:30.933609 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-09677fac-4eec-46e6-ab9b-c4768131ad95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f801054b0c7b41b48c98dec9b1de85a0', 'request_id': 'req-09677fac-4eec-46e6-ab9b-c4768131ad95'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:31.072398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-09677fac-4eec-46e6-ab9b-c4768131ad95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f801054b0c7b41b48c98dec9b1de85a0', 'request_id': 'req-09677fac-4eec-46e6-ab9b-c4768131ad95'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:31.104318 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-09677fac-4eec-46e6-ab9b-c4768131ad95 admin admin] The token cache is being invalidate because project f801054b0c7b41b48c98dec9b1de85a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:59:31.104318 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-09677fac-4eec-46e6-ab9b-c4768131ad95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:31.104318 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-09677fac-4eec-46e6-ab9b-c4768131ad95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:31.108771 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 834/1671] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 12:59:30 2022] DELETE /identity/v3/projects/f801054b0c7b41b48c98dec9b1de85a0 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:31.109750 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09677fac-4eec-46e6-ab9b-c4768131ad95 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:31.111287 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-09677fac-4eec-46e6-ab9b-c4768131ad95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:31.132185 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 838/1672] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:31.145198 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bc03b-3ef1-4243-8945-391646089c65 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:31.146898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bc03b-3ef1-4243-8945-391646089c65 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:31.148090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bc03b-3ef1-4243-8945-391646089c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:31.226616 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-d39bc03b-3ef1-4243-8945-391646089c65 None None] MFA Rules not processed for user `bb5f78a0ee0642c7bbde2ecf34e090d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:31.230004 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d39bc03b-3ef1-4243-8945-391646089c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:31.232846 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09677fac-4eec-46e6-ab9b-c4768131ad95 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:31.250418 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6bd83-08dd-4c18-b9d9-b476728f3483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:31.251021 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6bd83-08dd-4c18-b9d9-b476728f3483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:31.251308 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6bd83-08dd-4c18-b9d9-b476728f3483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:31.251584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6bd83-08dd-4c18-b9d9-b476728f3483 admin admin] PATH_INFO: `/v3/users/61fdca7a7c2a4353ad01441312afe8a5` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:31.255353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc6bd83-08dd-4c18-b9d9-b476728f3483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61fdca7a7c2a4353ad01441312afe8a5)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:31.259378 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc6bd83-08dd-4c18-b9d9-b476728f3483 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:31.285690 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:31.377833 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 839/1673] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:31.377833 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bc03b-3ef1-4243-8945-391646089c65 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:31.378633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d39bc03b-3ef1-4243-8945-391646089c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:31.408758 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bc03b-3ef1-4243-8945-391646089c65 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:31.414005 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb93ee-da1d-4e33-b553-979e039c032e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:31.415846 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb93ee-da1d-4e33-b553-979e039c032e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:31.416956 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb93ee-da1d-4e33-b553-979e039c032e admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:31.417452 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb93ee-da1d-4e33-b553-979e039c032e admin admin] PATH_INFO: `/v3/projects/90aac386ff81446491632f21206e2648` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:31.419485 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb93ee-da1d-4e33-b553-979e039c032e admin admin] RBAC: Authorizing `identity:delete_project(project_id=90aac386ff81446491632f21206e2648)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:31.423185 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb93ee-da1d-4e33-b553-979e039c032e admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:31.507585 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ddc6bd83-08dd-4c18-b9d9-b476728f3483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61fdca7a7c2a4353ad01441312afe8a5'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:31.537102 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ddc6bd83-08dd-4c18-b9d9-b476728f3483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61fdca7a7c2a4353ad01441312afe8a5'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:31.629800 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-4abb93ee-da1d-4e33-b553-979e039c032e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90aac386ff81446491632f21206e2648', 'request_id': 'req-4abb93ee-da1d-4e33-b553-979e039c032e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:31.648835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-4abb93ee-da1d-4e33-b553-979e039c032e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90aac386ff81446491632f21206e2648', 'request_id': 'req-4abb93ee-da1d-4e33-b553-979e039c032e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:31.663700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ddc6bd83-08dd-4c18-b9d9-b476728f3483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61fdca7a7c2a4353ad01441312afe8a5'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:31.664817 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ddc6bd83-08dd-4c18-b9d9-b476728f3483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61fdca7a7c2a4353ad01441312afe8a5'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:31.684234 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ddc6bd83-08dd-4c18-b9d9-b476728f3483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61fdca7a7c2a4353ad01441312afe8a5'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:31.729391 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 835/1674] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 12:59:31 2022] DELETE /identity/v3/users/61fdca7a7c2a4353ad01441312afe8a5 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:31.729391 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6bd83-08dd-4c18-b9d9-b476728f3483 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:31.733510 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-4abb93ee-da1d-4e33-b553-979e039c032e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90aac386ff81446491632f21206e2648', 'request_id': 'req-4abb93ee-da1d-4e33-b553-979e039c032e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:31.736523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-ddc6bd83-08dd-4c18-b9d9-b476728f3483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:31.762465 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-4abb93ee-da1d-4e33-b553-979e039c032e admin admin] The token cache is being invalidate because project 90aac386ff81446491632f21206e2648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:59:31.763104 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-4abb93ee-da1d-4e33-b553-979e039c032e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:31.764422 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-4abb93ee-da1d-4e33-b553-979e039c032e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:31.768481 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 840/1675] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 12:59:31 2022] DELETE /identity/v3/projects/90aac386ff81446491632f21206e2648 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:31.770018 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb93ee-da1d-4e33-b553-979e039c032e admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:31.776798 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-4abb93ee-da1d-4e33-b553-979e039c032e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:31.846788 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:32.036704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6bd83-08dd-4c18-b9d9-b476728f3483 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:32.058372 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c98fe-6a33-4155-83b8-1e9310516ac3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:32.059196 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c98fe-6a33-4155-83b8-1e9310516ac3 service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:32.059588 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c98fe-6a33-4155-83b8-1e9310516ac3 service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:32.060025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c98fe-6a33-4155-83b8-1e9310516ac3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:32.064424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-985c98fe-6a33-4155-83b8-1e9310516ac3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:32.094591 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb93ee-da1d-4e33-b553-979e039c032e admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:32.149250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:32.240270 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c98fe-6a33-4155-83b8-1e9310516ac3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:32.242028 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c98fe-6a33-4155-83b8-1e9310516ac3 service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:32.255089 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef12ca3-72d1-4c6f-a6c5-3973b615709d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:32.255812 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef12ca3-72d1-4c6f-a6c5-3973b615709d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:32.256137 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef12ca3-72d1-4c6f-a6c5-3973b615709d admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:32.256426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef12ca3-72d1-4c6f-a6c5-3973b615709d admin admin] PATH_INFO: `/v3/projects/755dcaa4b12d47a18a0603b7fa44a8c3` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:32.258336 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef12ca3-72d1-4c6f-a6c5-3973b615709d admin admin] RBAC: Authorizing `identity:delete_project(project_id=755dcaa4b12d47a18a0603b7fa44a8c3)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:32.261278 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef12ca3-72d1-4c6f-a6c5-3973b615709d admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:32.285762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 836/1676] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:31 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:32.286072 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c98fe-6a33-4155-83b8-1e9310516ac3 service nova] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:32.292914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-985c98fe-6a33-4155-83b8-1e9310516ac3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:32.342466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c98fe-6a33-4155-83b8-1e9310516ac3 service nova] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:32.356204 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa787d-efbc-46e8-b087-e160d91c2321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:32.357045 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa787d-efbc-46e8-b087-e160d91c2321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:32.370154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa787d-efbc-46e8-b087-e160d91c2321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:32.370154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa787d-efbc-46e8-b087-e160d91c2321 admin admin] PATH_INFO: `/v3/users/b1ca16a909f44a53bef229d16a3e224d` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:32.370154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa787d-efbc-46e8-b087-e160d91c2321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1ca16a909f44a53bef229d16a3e224d)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:32.372346 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa787d-efbc-46e8-b087-e160d91c2321 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:32.475763 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9ef12ca3-72d1-4c6f-a6c5-3973b615709d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755dcaa4b12d47a18a0603b7fa44a8c3', 'request_id': 'req-9ef12ca3-72d1-4c6f-a6c5-3973b615709d'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:32.495668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9ef12ca3-72d1-4c6f-a6c5-3973b615709d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755dcaa4b12d47a18a0603b7fa44a8c3', 'request_id': 'req-9ef12ca3-72d1-4c6f-a6c5-3973b615709d'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:32.606161 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9ef12ca3-72d1-4c6f-a6c5-3973b615709d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755dcaa4b12d47a18a0603b7fa44a8c3', 'request_id': 'req-9ef12ca3-72d1-4c6f-a6c5-3973b615709d'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:32.632090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9ef12ca3-72d1-4c6f-a6c5-3973b615709d admin admin] The token cache is being invalidate because project 755dcaa4b12d47a18a0603b7fa44a8c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:59:32.632251 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9ef12ca3-72d1-4c6f-a6c5-3973b615709d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:32.634225 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9ef12ca3-72d1-4c6f-a6c5-3973b615709d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:32.639322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 841/1677] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 12:59:31 2022] DELETE /identity/v3/projects/755dcaa4b12d47a18a0603b7fa44a8c3 => generated 0 bytes in 870 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:32.651173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-4eaa787d-efbc-46e8-b087-e160d91c2321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1ca16a909f44a53bef229d16a3e224d'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:32.652017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decb5eb-dc82-4971-8ea9-31ec7750e318 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:32.652017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decb5eb-dc82-4971-8ea9-31ec7750e318 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:32.652017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decb5eb-dc82-4971-8ea9-31ec7750e318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:32.661610 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-4eaa787d-efbc-46e8-b087-e160d91c2321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1ca16a909f44a53bef229d16a3e224d'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:32.708902 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-0decb5eb-dc82-4971-8ea9-31ec7750e318 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:32.711828 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-0decb5eb-dc82-4971-8ea9-31ec7750e318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:32.770919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-4eaa787d-efbc-46e8-b087-e160d91c2321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1ca16a909f44a53bef229d16a3e224d'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:32.771613 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-4eaa787d-efbc-46e8-b087-e160d91c2321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1ca16a909f44a53bef229d16a3e224d'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:32.797116 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-4eaa787d-efbc-46e8-b087-e160d91c2321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1ca16a909f44a53bef229d16a3e224d'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:32.824981 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 837/1678] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 12:59:32 2022] DELETE /identity/v3/users/b1ca16a909f44a53bef229d16a3e224d => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:32.850366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 842/1679] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:32.856250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7456ca-1f89-4d07-a507-c221ee95851f None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:32.856542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7456ca-1f89-4d07-a507-c221ee95851f None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:32.856826 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7456ca-1f89-4d07-a507-c221ee95851f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:32.904848 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-3f7456ca-1f89-4d07-a507-c221ee95851f None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:32.908322 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3f7456ca-1f89-4d07-a507-c221ee95851f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:33.035198 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 838/1680] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:33.036142 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decb5eb-dc82-4971-8ea9-31ec7750e318 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:33.049677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decb5eb-dc82-4971-8ea9-31ec7750e318 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:33.062020 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28860d35-ac92-4b99-a5a9-66da51bbe2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:33.062672 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28860d35-ac92-4b99-a5a9-66da51bbe2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:33.062985 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28860d35-ac92-4b99-a5a9-66da51bbe2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:33.063268 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28860d35-ac92-4b99-a5a9-66da51bbe2e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:33.063987 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28860d35-ac92-4b99-a5a9-66da51bbe2e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:59:33.065032 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28860d35-ac92-4b99-a5a9-66da51bbe2e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:33.066474 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28860d35-ac92-4b99-a5a9-66da51bbe2e8 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:33.116071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7456ca-1f89-4d07-a507-c221ee95851f None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:33.148280 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 843/1681] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 12:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:59:33.151951 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7456ca-1f89-4d07-a507-c221ee95851f None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:33.168213 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927670d6-f488-4b70-99c1-64f80f2f49e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:33.168213 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927670d6-f488-4b70-99c1-64f80f2f49e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:33.168213 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927670d6-f488-4b70-99c1-64f80f2f49e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:33.168213 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927670d6-f488-4b70-99c1-64f80f2f49e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:33.168791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927670d6-f488-4b70-99c1-64f80f2f49e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:33.168791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927670d6-f488-4b70-99c1-64f80f2f49e7 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:33.348373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 839/1682] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:33 2022] POST /identity/v3/projects => generated 373 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:33.352829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28860d35-ac92-4b99-a5a9-66da51bbe2e8 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:33.368875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28860d35-ac92-4b99-a5a9-66da51bbe2e8 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:33.607494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437a9ff-b74c-4bd9-9472-805dad17530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:33.608245 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437a9ff-b74c-4bd9-9472-805dad17530c admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:33.609691 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437a9ff-b74c-4bd9-9472-805dad17530c admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:33.610947 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437a9ff-b74c-4bd9-9472-805dad17530c admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:33.611768 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437a9ff-b74c-4bd9-9472-805dad17530c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:33.617530 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437a9ff-b74c-4bd9-9472-805dad17530c admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:33.767577 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 844/1683] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:33 2022] POST /identity/v3/users => generated 287 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:33.771867 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927670d6-f488-4b70-99c1-64f80f2f49e7 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:33.789877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927670d6-f488-4b70-99c1-64f80f2f49e7 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:33.805721 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff8f1f-01e1-4006-a5cf-b501d5fe54f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:33.809089 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff8f1f-01e1-4006-a5cf-b501d5fe54f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:33.809611 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff8f1f-01e1-4006-a5cf-b501d5fe54f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:33.810093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff8f1f-01e1-4006-a5cf-b501d5fe54f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:33.811074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff8f1f-01e1-4006-a5cf-b501d5fe54f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:33.815076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff8f1f-01e1-4006-a5cf-b501d5fe54f4 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:33.848680 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437a9ff-b74c-4bd9-9472-805dad17530c admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:33.857756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 840/1684] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:33.865744 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437a9ff-b74c-4bd9-9472-805dad17530c admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:33.877154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:33.878539 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d09c2-6acc-4e80-bad9-8d4020a0893b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:33.881526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d09c2-6acc-4e80-bad9-8d4020a0893b admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:33.881526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d09c2-6acc-4e80-bad9-8d4020a0893b admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:33.881526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d09c2-6acc-4e80-bad9-8d4020a0893b admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:33.883179 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d09c2-6acc-4e80-bad9-8d4020a0893b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:33.885860 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d09c2-6acc-4e80-bad9-8d4020a0893b admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:33.917231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 845/1685] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:33.922248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff8f1f-01e1-4006-a5cf-b501d5fe54f4 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:33.934706 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff8f1f-01e1-4006-a5cf-b501d5fe54f4 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:33.947682 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cd1a2-99db-43d3-96eb-9c9904e04082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:33.949025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cd1a2-99db-43d3-96eb-9c9904e04082 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:33.949547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cd1a2-99db-43d3-96eb-9c9904e04082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:33.950011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cd1a2-99db-43d3-96eb-9c9904e04082 admin admin] PATH_INFO: `/v3/projects/87529b9c30a64e7b99fd296d71445b3d/users/0c5d0ffd70f14cadbd134fa136ed81da/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:33.989728 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cd1a2-99db-43d3-96eb-9c9904e04082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87529b9c30a64e7b99fd296d71445b3d, user_id=0c5d0ffd70f14cadbd134fa136ed81da, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:34.006657 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cd1a2-99db-43d3-96eb-9c9904e04082 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:34.044063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d09c2-6acc-4e80-bad9-8d4020a0893b admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:34.046199 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-133d09c2-6acc-4e80-bad9-8d4020a0893b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:34.080612 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:34.091000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d09c2-6acc-4e80-bad9-8d4020a0893b admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:34.124250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 841/1686] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:33 2022] PUT /identity/v3/projects/87529b9c30a64e7b99fd296d71445b3d/users/0c5d0ffd70f14cadbd134fa136ed81da/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:34.125604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a1dd9-54ec-4a0a-8407-9f9a4c1f4016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:34.127911 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a1dd9-54ec-4a0a-8407-9f9a4c1f4016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:34.128451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a1dd9-54ec-4a0a-8407-9f9a4c1f4016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:34.128868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a1dd9-54ec-4a0a-8407-9f9a4c1f4016 admin admin] PATH_INFO: `/v3/projects/a188bea26f1c463faa373ab07d54def5` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:34.131521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a1dd9-54ec-4a0a-8407-9f9a4c1f4016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a188bea26f1c463faa373ab07d54def5)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:34.141139 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bc5df-fd06-48cb-8d62-f3b83130f01f None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:34.141590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bc5df-fd06-48cb-8d62-f3b83130f01f None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:34.142164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bc5df-fd06-48cb-8d62-f3b83130f01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:34.155138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a1dd9-54ec-4a0a-8407-9f9a4c1f4016 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:34.249105 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-7f9bc5df-fd06-48cb-8d62-f3b83130f01f None None] MFA Rules not processed for user `0c5d0ffd70f14cadbd134fa136ed81da`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:34.252007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-7f9bc5df-fd06-48cb-8d62-f3b83130f01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:34.349309 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 842/1687] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:34.370498 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bc5df-fd06-48cb-8d62-f3b83130f01f None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:34.436745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-640a1dd9-54ec-4a0a-8407-9f9a4c1f4016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a188bea26f1c463faa373ab07d54def5', 'request_id': 'req-640a1dd9-54ec-4a0a-8407-9f9a4c1f4016'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:34.465484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-640a1dd9-54ec-4a0a-8407-9f9a4c1f4016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a188bea26f1c463faa373ab07d54def5', 'request_id': 'req-640a1dd9-54ec-4a0a-8407-9f9a4c1f4016'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:34.546545 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-640a1dd9-54ec-4a0a-8407-9f9a4c1f4016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a188bea26f1c463faa373ab07d54def5', 'request_id': 'req-640a1dd9-54ec-4a0a-8407-9f9a4c1f4016'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:34.566482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-640a1dd9-54ec-4a0a-8407-9f9a4c1f4016 admin admin] The token cache is being invalidate because project a188bea26f1c463faa373ab07d54def5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:59:34.567558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-640a1dd9-54ec-4a0a-8407-9f9a4c1f4016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:34.569953 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-640a1dd9-54ec-4a0a-8407-9f9a4c1f4016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:34.575466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 846/1688] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 12:59:34 2022] DELETE /identity/v3/projects/a188bea26f1c463faa373ab07d54def5 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:59:34.579993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357cca6-dec3-48b1-bd38-fc66701d35a7 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:34.580297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357cca6-dec3-48b1-bd38-fc66701d35a7 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:34.580828 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357cca6-dec3-48b1-bd38-fc66701d35a7 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:34.586516 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 847/1689] 10.222.0.64 () {54 vars in 912 bytes} [Wed Aug 3 12:59:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:59:34.587718 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f702c1f-ef8d-463f-9b5c-b641c1c9b89d None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:34.590169 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bc5df-fd06-48cb-8d62-f3b83130f01f None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:34.590959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f702c1f-ef8d-463f-9b5c-b641c1c9b89d None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:34.591238 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f702c1f-ef8d-463f-9b5c-b641c1c9b89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:34.695336 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-3f702c1f-ef8d-463f-9b5c-b641c1c9b89d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:34.700435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-3f702c1f-ef8d-463f-9b5c-b641c1c9b89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:34.872102 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1bc09-ebdd-4ea6-a776-44970a9b30a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:34.881606 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1bc09-ebdd-4ea6-a776-44970a9b30a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:34.881960 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1bc09-ebdd-4ea6-a776-44970a9b30a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:34.882243 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1bc09-ebdd-4ea6-a776-44970a9b30a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:34.889759 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1bc09-ebdd-4ea6-a776-44970a9b30a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:34.897012 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1bc09-ebdd-4ea6-a776-44970a9b30a4 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:34.960944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 848/1690] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:34.962299 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356952d7-31b3-40bc-992f-a26e97aeef33 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:34.962596 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356952d7-31b3-40bc-992f-a26e97aeef33 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:34.963158 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356952d7-31b3-40bc-992f-a26e97aeef33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:35.058622 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 843/1691] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:34 2022] POST /identity/v3/projects => generated 373 bytes in 698 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:35.060848 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1bc09-ebdd-4ea6-a776-44970a9b30a4 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:35.065230 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-53a1bc09-ebdd-4ea6-a776-44970a9b30a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:35.081755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-356952d7-31b3-40bc-992f-a26e97aeef33 None None] MFA Rules not processed for user `05c4c07ff52c43ebb5056484eac94afa`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:35.083051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-356952d7-31b3-40bc-992f-a26e97aeef33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:35.219147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 849/1692] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 3 12:59:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:35.220723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023a32a-3c75-45d2-9a04-4ec0787f607f None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:35.220980 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023a32a-3c75-45d2-9a04-4ec0787f607f None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:35.221252 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023a32a-3c75-45d2-9a04-4ec0787f607f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:35.258883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-e023a32a-3c75-45d2-9a04-4ec0787f607f None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:35.260807 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e023a32a-3c75-45d2-9a04-4ec0787f607f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:35.282923 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1bc09-ebdd-4ea6-a776-44970a9b30a4 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:35.294875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 850/1693] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:35.294875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023a32a-3c75-45d2-9a04-4ec0787f607f None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:35.294875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e023a32a-3c75-45d2-9a04-4ec0787f607f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:35.298273 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b1e6c-6764-4e56-89bc-f88ed5f7fe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:35.299446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b1e6c-6764-4e56-89bc-f88ed5f7fe6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:35.302117 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b1e6c-6764-4e56-89bc-f88ed5f7fe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:35.302650 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b1e6c-6764-4e56-89bc-f88ed5f7fe6d admin admin] PATH_INFO: `/v3/projects/dae007515a884e93965432f1408603a9` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:35.305068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b1e6c-6764-4e56-89bc-f88ed5f7fe6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae007515a884e93965432f1408603a9)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:35.309969 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b1e6c-6764-4e56-89bc-f88ed5f7fe6d admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:35.316305 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023a32a-3c75-45d2-9a04-4ec0787f607f None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:35.345748 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90969fd-cebc-4f60-a362-6bdd04116b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:35.346462 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90969fd-cebc-4f60-a362-6bdd04116b06 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:35.346726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90969fd-cebc-4f60-a362-6bdd04116b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:35.347070 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90969fd-cebc-4f60-a362-6bdd04116b06 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:35.347786 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90969fd-cebc-4f60-a362-6bdd04116b06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:35.351274 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90969fd-cebc-4f60-a362-6bdd04116b06 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:35.475451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 851/1694] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:35 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:35.476831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f5544-f28c-4355-b4d9-f89d8696e758 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:35.477146 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f5544-f28c-4355-b4d9-f89d8696e758 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:35.479200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f5544-f28c-4355-b4d9-f89d8696e758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:35.547199 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b96b1e6c-6764-4e56-89bc-f88ed5f7fe6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae007515a884e93965432f1408603a9', 'request_id': 'req-b96b1e6c-6764-4e56-89bc-f88ed5f7fe6d'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:35.559247 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b96b1e6c-6764-4e56-89bc-f88ed5f7fe6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae007515a884e93965432f1408603a9', 'request_id': 'req-b96b1e6c-6764-4e56-89bc-f88ed5f7fe6d'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:35.610625 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-252f5544-f28c-4355-b4d9-f89d8696e758 None None] MFA Rules not processed for user `bbf46bef60464329afdf2df75842a41e`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:35.614257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-252f5544-f28c-4355-b4d9-f89d8696e758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:35.642551 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b96b1e6c-6764-4e56-89bc-f88ed5f7fe6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae007515a884e93965432f1408603a9', 'request_id': 'req-b96b1e6c-6764-4e56-89bc-f88ed5f7fe6d'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:35.660092 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:35.674666 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b96b1e6c-6764-4e56-89bc-f88ed5f7fe6d admin admin] The token cache is being invalidate because project dae007515a884e93965432f1408603a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:59:35.674666 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b96b1e6c-6764-4e56-89bc-f88ed5f7fe6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:35.680996 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b96b1e6c-6764-4e56-89bc-f88ed5f7fe6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:35.689739 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 844/1695] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 12:59:35 2022] DELETE /identity/v3/projects/dae007515a884e93965432f1408603a9 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:35.699032 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b1e6c-6764-4e56-89bc-f88ed5f7fe6d admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:35.703000 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b96b1e6c-6764-4e56-89bc-f88ed5f7fe6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:35.872422 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 852/1696] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:35.876404 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f5544-f28c-4355-b4d9-f89d8696e758 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:35.880842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-252f5544-f28c-4355-b4d9-f89d8696e758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:35.901729 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b1e6c-6764-4e56-89bc-f88ed5f7fe6d admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:35.908660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:35.920069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbb490-3b52-4a4b-8452-bb3bde336e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:35.920069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbb490-3b52-4a4b-8452-bb3bde336e98 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:35.920069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbb490-3b52-4a4b-8452-bb3bde336e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:35.920069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbb490-3b52-4a4b-8452-bb3bde336e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:35.920413 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3bdbb490-3b52-4a4b-8452-bb3bde336e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:35.935161 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbb490-3b52-4a4b-8452-bb3bde336e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:35.937373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbb490-3b52-4a4b-8452-bb3bde336e98 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:35.956225 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 845/1697] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:35.957170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbb490-3b52-4a4b-8452-bb3bde336e98 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:35.959150 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3bdbb490-3b52-4a4b-8452-bb3bde336e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:36.064251 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f5544-f28c-4355-b4d9-f89d8696e758 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:36.074968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbb490-3b52-4a4b-8452-bb3bde336e98 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:36.084219 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a9a29-5cef-4af4-8114-cef9d9d3c15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:36.085473 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a9a29-5cef-4af4-8114-cef9d9d3c15a admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:36.088484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a9a29-5cef-4af4-8114-cef9d9d3c15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:36.089001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a9a29-5cef-4af4-8114-cef9d9d3c15a admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:36.091612 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a61965-37ef-4978-a083-d9ed336927f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:36.092255 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a61965-37ef-4978-a083-d9ed336927f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:36.092540 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a61965-37ef-4978-a083-d9ed336927f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:36.093807 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a9a29-5cef-4af4-8114-cef9d9d3c15a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:59:36.094657 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a61965-37ef-4978-a083-d9ed336927f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:36.095261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a9a29-5cef-4af4-8114-cef9d9d3c15a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:36.095470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a61965-37ef-4978-a083-d9ed336927f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:36.099389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a61965-37ef-4978-a083-d9ed336927f3 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:36.100386 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a9a29-5cef-4af4-8114-cef9d9d3c15a admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:36.126062 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 846/1698] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:36.129269 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa331437-f283-4800-8071-5e77edbdbbd0 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:36.129541 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa331437-f283-4800-8071-5e77edbdbbd0 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:36.129829 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa331437-f283-4800-8071-5e77edbdbbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:36.134506 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 853/1699] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 12:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:59:36.136667 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af148a9-8936-4705-976c-afbd674f612d None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:36.139007 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af148a9-8936-4705-976c-afbd674f612d None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:36.140622 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af148a9-8936-4705-976c-afbd674f612d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:36.176825 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-aa331437-f283-4800-8071-5e77edbdbbd0 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:36.187486 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-aa331437-f283-4800-8071-5e77edbdbbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:36.196522 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-3af148a9-8936-4705-976c-afbd674f612d None None] MFA Rules not processed for user `bbf46bef60464329afdf2df75842a41e`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:36.201259 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-3af148a9-8936-4705-976c-afbd674f612d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:36.209009 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 847/1700] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:36.209982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa331437-f283-4800-8071-5e77edbdbbd0 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:36.224654 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 854/1701] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:36.229133 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af148a9-8936-4705-976c-afbd674f612d None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:36.239736 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa331437-f283-4800-8071-5e77edbdbbd0 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:36.250575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305c778-c9ac-48b6-bd54-f5c4e687ddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:36.252690 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305c778-c9ac-48b6-bd54-f5c4e687ddff admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:36.252981 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305c778-c9ac-48b6-bd54-f5c4e687ddff admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:36.253255 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305c778-c9ac-48b6-bd54-f5c4e687ddff admin admin] PATH_INFO: `/v3/projects/b78894db96f54681b14db6f566957996/users/ea0f9e138fd64fa48e16a0143ee25d55/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:36.260340 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af148a9-8936-4705-976c-afbd674f612d None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:36.279756 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d0851-6fc6-49d3-82e5-2c8071fdacad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:36.281826 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d0851-6fc6-49d3-82e5-2c8071fdacad admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:36.282201 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d0851-6fc6-49d3-82e5-2c8071fdacad admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:36.282776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d0851-6fc6-49d3-82e5-2c8071fdacad admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:36.284865 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d0851-6fc6-49d3-82e5-2c8071fdacad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:36.290307 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d0851-6fc6-49d3-82e5-2c8071fdacad admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:36.291203 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305c778-c9ac-48b6-bd54-f5c4e687ddff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78894db96f54681b14db6f566957996, user_id=ea0f9e138fd64fa48e16a0143ee25d55, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:36.298712 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305c778-c9ac-48b6-bd54-f5c4e687ddff admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:36.378490 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 848/1702] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:36 2022] PUT /identity/v3/projects/b78894db96f54681b14db6f566957996/users/ea0f9e138fd64fa48e16a0143ee25d55/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:36.378490 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd2e76-cc83-49df-b8ab-c8e7cddfd785 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:36.378490 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd2e76-cc83-49df-b8ab-c8e7cddfd785 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:36.378490 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd2e76-cc83-49df-b8ab-c8e7cddfd785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:36.413133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-5fcd2e76-cc83-49df-b8ab-c8e7cddfd785 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:36.415565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-5fcd2e76-cc83-49df-b8ab-c8e7cddfd785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:36.474156 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 855/1703] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:36 2022] POST /identity/v3/projects => generated 371 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:36.475121 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d0851-6fc6-49d3-82e5-2c8071fdacad admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:36.481855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d46d0851-6fc6-49d3-82e5-2c8071fdacad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:36.506681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 849/1704] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:36.510691 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd2e76-cc83-49df-b8ab-c8e7cddfd785 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:36.522310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd2e76-cc83-49df-b8ab-c8e7cddfd785 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:36.596780 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334b081-25a8-46e4-bdee-184402831320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:36.597713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334b081-25a8-46e4-bdee-184402831320 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:36.597980 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334b081-25a8-46e4-bdee-184402831320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:36.598330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334b081-25a8-46e4-bdee-184402831320 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:36.599311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334b081-25a8-46e4-bdee-184402831320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:36.601355 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334b081-25a8-46e4-bdee-184402831320 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:36.617046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 850/1705] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:36.618187 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334b081-25a8-46e4-bdee-184402831320 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:36.631244 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334b081-25a8-46e4-bdee-184402831320 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:36.641819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494903ec-9436-4941-9d70-f6e93256d3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:36.642706 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494903ec-9436-4941-9d70-f6e93256d3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:36.643156 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494903ec-9436-4941-9d70-f6e93256d3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:36.643607 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494903ec-9436-4941-9d70-f6e93256d3c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:36.644679 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494903ec-9436-4941-9d70-f6e93256d3c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:36.647722 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494903ec-9436-4941-9d70-f6e93256d3c3 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:36.685855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d0851-6fc6-49d3-82e5-2c8071fdacad admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:36.700421 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393bad7-ff9c-47f9-9c0b-5e4224627b6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:36.706448 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393bad7-ff9c-47f9-9c0b-5e4224627b6c service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:36.706878 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393bad7-ff9c-47f9-9c0b-5e4224627b6c service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:36.707488 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393bad7-ff9c-47f9-9c0b-5e4224627b6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:36.755744 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 851/1706] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:36 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:36.756800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494903ec-9436-4941-9d70-f6e93256d3c3 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:36.802787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494903ec-9436-4941-9d70-f6e93256d3c3 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:36.828395 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066bdc6-5d14-4800-8616-1c85deb70cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:36.831054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066bdc6-5d14-4800-8616-1c85deb70cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:36.831438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066bdc6-5d14-4800-8616-1c85deb70cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:36.831869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066bdc6-5d14-4800-8616-1c85deb70cc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:36.836149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066bdc6-5d14-4800-8616-1c85deb70cc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:59:36.844630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393bad7-ff9c-47f9-9c0b-5e4224627b6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:36.846053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066bdc6-5d14-4800-8616-1c85deb70cc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:36.849348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066bdc6-5d14-4800-8616-1c85deb70cc7 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:36.849845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393bad7-ff9c-47f9-9c0b-5e4224627b6c service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:36.875647 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 856/1707] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:36.876622 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393bad7-ff9c-47f9-9c0b-5e4224627b6c service nova] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:36.901474 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 852/1708] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 12:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:59:36.903398 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393bad7-ff9c-47f9-9c0b-5e4224627b6c service nova] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:36.907363 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066bdc6-5d14-4800-8616-1c85deb70cc7 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:36.915669 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19839a78-3ed4-4513-ab2b-677b95a2a2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:36.917101 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19839a78-3ed4-4513-ab2b-677b95a2a2a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:36.917356 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19839a78-3ed4-4513-ab2b-677b95a2a2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:36.917713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19839a78-3ed4-4513-ab2b-677b95a2a2a2 admin admin] PATH_INFO: `/v3/projects/b78894db96f54681b14db6f566957996/users/ea0f9e138fd64fa48e16a0143ee25d55/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:36.923453 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19839a78-3ed4-4513-ab2b-677b95a2a2a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78894db96f54681b14db6f566957996, user_id=ea0f9e138fd64fa48e16a0143ee25d55, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:36.927143 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19839a78-3ed4-4513-ab2b-677b95a2a2a2 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:36.936975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066bdc6-5d14-4800-8616-1c85deb70cc7 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:36.952188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54c15b-8ac4-4cd5-9f25-52f72ccd8925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:36.955152 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54c15b-8ac4-4cd5-9f25-52f72ccd8925 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:36.955449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54c15b-8ac4-4cd5-9f25-52f72ccd8925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:36.955731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54c15b-8ac4-4cd5-9f25-52f72ccd8925 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:36.964999 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 857/1709] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:36 2022] PUT /identity/v3/projects/b78894db96f54681b14db6f566957996/users/ea0f9e138fd64fa48e16a0143ee25d55/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:36.964999 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19839a78-3ed4-4513-ab2b-677b95a2a2a2 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:36.965235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54c15b-8ac4-4cd5-9f25-52f72ccd8925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:36.965235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54c15b-8ac4-4cd5-9f25-52f72ccd8925 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:37.001272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 853/1710] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:37.002763 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3836ba4-80ad-462d-aabe-690719741973 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:37.004475 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3836ba4-80ad-462d-aabe-690719741973 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:37.004475 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3836ba4-80ad-462d-aabe-690719741973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:37.080380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-f3836ba4-80ad-462d-aabe-690719741973 None None] MFA Rules not processed for user `ea0f9e138fd64fa48e16a0143ee25d55`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:37.084720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-f3836ba4-80ad-462d-aabe-690719741973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:37.144835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19839a78-3ed4-4513-ab2b-677b95a2a2a2 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:37.146455 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61013ced-cf14-45ab-bfe2-5bd5508bfbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:37.149323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61013ced-cf14-45ab-bfe2-5bd5508bfbed admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:37.149517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61013ced-cf14-45ab-bfe2-5bd5508bfbed admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:37.149925 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61013ced-cf14-45ab-bfe2-5bd5508bfbed admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:37.151383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61013ced-cf14-45ab-bfe2-5bd5508bfbed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:37.155529 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61013ced-cf14-45ab-bfe2-5bd5508bfbed admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:37.288652 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 858/1711] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:36 2022] POST /identity/v3/projects => generated 381 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:37.289975 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61013ced-cf14-45ab-bfe2-5bd5508bfbed admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:37.299374 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 854/1712] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:37.300218 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3836ba4-80ad-462d-aabe-690719741973 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:37.325023 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3836ba4-80ad-462d-aabe-690719741973 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:37.495282 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5e5eb-26f9-4ddd-a9ca-ca18904dba12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:37.495914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5e5eb-26f9-4ddd-a9ca-ca18904dba12 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:37.496207 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5e5eb-26f9-4ddd-a9ca-ca18904dba12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:37.496492 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5e5eb-26f9-4ddd-a9ca-ca18904dba12 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:37.497223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5e5eb-26f9-4ddd-a9ca-ca18904dba12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:37.497410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61013ced-cf14-45ab-bfe2-5bd5508bfbed admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:37.499382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5e5eb-26f9-4ddd-a9ca-ca18904dba12 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:37.523465 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e63ef-92de-40c8-b1dd-24d15ac88dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:37.524117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e63ef-92de-40c8-b1dd-24d15ac88dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:37.524401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e63ef-92de-40c8-b1dd-24d15ac88dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:37.524680 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e63ef-92de-40c8-b1dd-24d15ac88dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:37.526720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e63ef-92de-40c8-b1dd-24d15ac88dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:37.528543 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e63ef-92de-40c8-b1dd-24d15ac88dd3 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:37.585810 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 859/1713] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:37.586487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e63ef-92de-40c8-b1dd-24d15ac88dd3 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:37.589614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-694e63ef-92de-40c8-b1dd-24d15ac88dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:37.628721 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 855/1714] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:37 2022] POST /identity/v3/users => generated 291 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:37.634548 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5e5eb-26f9-4ddd-a9ca-ca18904dba12 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:37.656618 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:37.664152 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5e5eb-26f9-4ddd-a9ca-ca18904dba12 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:37.709446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c72a15-2279-4b54-a6a9-9731d3c3a3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:37.711272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c72a15-2279-4b54-a6a9-9731d3c3a3e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:37.713164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c72a15-2279-4b54-a6a9-9731d3c3a3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:37.713474 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c72a15-2279-4b54-a6a9-9731d3c3a3e4 admin admin] PATH_INFO: `/v3/projects/8c983ff2375f4c268f5fbe5f475ab203/users/8f420ba9dd364405b7d1611d86e322ca/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:37.751000 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c72a15-2279-4b54-a6a9-9731d3c3a3e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c983ff2375f4c268f5fbe5f475ab203, user_id=8f420ba9dd364405b7d1611d86e322ca, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:37.760965 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c72a15-2279-4b54-a6a9-9731d3c3a3e4 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:37.765835 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:37.776576 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e63ef-92de-40c8-b1dd-24d15ac88dd3 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:37.788608 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79440d-489b-4699-beb9-26311f68b2b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:37.789270 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79440d-489b-4699-beb9-26311f68b2b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:37.789562 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79440d-489b-4699-beb9-26311f68b2b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:37.789853 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79440d-489b-4699-beb9-26311f68b2b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:37.878026 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 856/1715] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:37 2022] PUT /identity/v3/projects/8c983ff2375f4c268f5fbe5f475ab203/users/8f420ba9dd364405b7d1611d86e322ca/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:37.878949 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c72a15-2279-4b54-a6a9-9731d3c3a3e4 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:37.888362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a9c72a15-2279-4b54-a6a9-9731d3c3a3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:37.969354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79440d-489b-4699-beb9-26311f68b2b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:37.970890 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79440d-489b-4699-beb9-26311f68b2b2 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:38.001490 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 860/1716] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:38.002392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79440d-489b-4699-beb9-26311f68b2b2 service cinder] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:38.019441 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79440d-489b-4699-beb9-26311f68b2b2 service cinder] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:38.045429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c72a15-2279-4b54-a6a9-9731d3c3a3e4 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:38.059393 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555f45e-b648-43c3-87b5-b688b3cf63eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:38.060069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555f45e-b648-43c3-87b5-b688b3cf63eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:38.060355 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555f45e-b648-43c3-87b5-b688b3cf63eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:38.060634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555f45e-b648-43c3-87b5-b688b3cf63eb admin admin] PATH_INFO: `/v3/users/dfb810a14ad547be8fdb21acb13cd23b` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:38.063500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555f45e-b648-43c3-87b5-b688b3cf63eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb810a14ad547be8fdb21acb13cd23b)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:38.070499 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555f45e-b648-43c3-87b5-b688b3cf63eb admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:38.142267 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc4488-c757-4e63-9fb3-2146863b7849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:38.143179 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc4488-c757-4e63-9fb3-2146863b7849 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:38.143662 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc4488-c757-4e63-9fb3-2146863b7849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:38.144091 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc4488-c757-4e63-9fb3-2146863b7849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:38.144943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc4488-c757-4e63-9fb3-2146863b7849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:38.146835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc4488-c757-4e63-9fb3-2146863b7849 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:38.159484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 861/1717] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:38.162546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f526d1-9cf4-4095-8784-f86835601dcb None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:38.163034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f526d1-9cf4-4095-8784-f86835601dcb None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:38.163473 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f526d1-9cf4-4095-8784-f86835601dcb None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:38.164968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 862/1718] 10.222.0.64 () {54 vars in 961 bytes} [Wed Aug 3 12:59:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:59:38.166207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ae6cd-f598-4a21-9f69-3ec71877a9f1 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:38.166695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ae6cd-f598-4a21-9f69-3ec71877a9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:38.167136 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ae6cd-f598-4a21-9f69-3ec71877a9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:38.189943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-b62ae6cd-f598-4a21-9f69-3ec71877a9f1 None None] MFA Rules not processed for user `bb5f78a0ee0642c7bbde2ecf34e090d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:38.191572 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b62ae6cd-f598-4a21-9f69-3ec71877a9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:38.267733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 863/1719] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:38.269527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b457a-50db-474f-94f0-7aaaa33fb387 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:38.269964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b457a-50db-474f-94f0-7aaaa33fb387 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:38.270403 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b457a-50db-474f-94f0-7aaaa33fb387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:38.306445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-6d4b457a-50db-474f-94f0-7aaaa33fb387 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:38.311652 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-6d4b457a-50db-474f-94f0-7aaaa33fb387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:38.338393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 864/1720] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:38.338393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b457a-50db-474f-94f0-7aaaa33fb387 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:38.358534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b457a-50db-474f-94f0-7aaaa33fb387 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:38.396109 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23406-feac-4d2f-8ea1-5139e5240b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:38.397795 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23406-feac-4d2f-8ea1-5139e5240b48 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:38.397795 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23406-feac-4d2f-8ea1-5139e5240b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:38.397795 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23406-feac-4d2f-8ea1-5139e5240b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:38.398043 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc23406-feac-4d2f-8ea1-5139e5240b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:38.402897 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e555f45e-b648-43c3-87b5-b688b3cf63eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb810a14ad547be8fdb21acb13cd23b'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:38.410091 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc23406-feac-4d2f-8ea1-5139e5240b48 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:38.429309 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e555f45e-b648-43c3-87b5-b688b3cf63eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb810a14ad547be8fdb21acb13cd23b'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:38.445295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 865/1721] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:38.447707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5eb839-487f-4e8c-9085-1989c0b22772 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:38.447835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5eb839-487f-4e8c-9085-1989c0b22772 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:38.448034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5eb839-487f-4e8c-9085-1989c0b22772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:38.493775 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-2c5eb839-487f-4e8c-9085-1989c0b22772 None None] MFA Rules not processed for user `de27d25fad634658a1abcb776d9a7b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:38.499431 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-2c5eb839-487f-4e8c-9085-1989c0b22772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:38.545306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e555f45e-b648-43c3-87b5-b688b3cf63eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb810a14ad547be8fdb21acb13cd23b'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:38.550338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e555f45e-b648-43c3-87b5-b688b3cf63eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb810a14ad547be8fdb21acb13cd23b'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:38.567644 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e555f45e-b648-43c3-87b5-b688b3cf63eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb810a14ad547be8fdb21acb13cd23b'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:38.579410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 857/1722] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 12:59:37 2022] DELETE /identity/v3/users/dfb810a14ad547be8fdb21acb13cd23b => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:38.582418 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2499391-db91-4189-ad4c-f449f881fac4 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:38.582572 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2499391-db91-4189-ad4c-f449f881fac4 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:38.582949 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2499391-db91-4189-ad4c-f449f881fac4 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:38.584878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 858/1723] 10.222.0.64 () {54 vars in 912 bytes} [Wed Aug 3 12:59:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:59:38.585690 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2499391-db91-4189-ad4c-f449f881fac4 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:38.587599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-d2499391-db91-4189-ad4c-f449f881fac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:38.653830 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 866/1724] 10.222.0.64 () {58 vars in 1058 bytes} [Wed Aug 3 12:59:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:38.654639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5eb839-487f-4e8c-9085-1989c0b22772 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:38.656055 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-2c5eb839-487f-4e8c-9085-1989c0b22772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:38.687207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5eb839-487f-4e8c-9085-1989c0b22772 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:38.787970 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2499391-db91-4189-ad4c-f449f881fac4 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:38.796177 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672b57e-1a73-4dd2-906d-c3eb99dae238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:38.798409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672b57e-1a73-4dd2-906d-c3eb99dae238 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:38.798717 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672b57e-1a73-4dd2-906d-c3eb99dae238 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:38.799074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672b57e-1a73-4dd2-906d-c3eb99dae238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:38.803897 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-1672b57e-1a73-4dd2-906d-c3eb99dae238 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:38.866457 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85813b-fae3-49f0-8667-1f1a0ad6a335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:38.869826 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85813b-fae3-49f0-8667-1f1a0ad6a335 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:38.870097 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85813b-fae3-49f0-8667-1f1a0ad6a335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:38.877235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85813b-fae3-49f0-8667-1f1a0ad6a335 admin admin] PATH_INFO: `/v3/projects/8caa8f97e1214e42b960e5456c1ef372/users/dfa906552edc4ec9b76a1e60c3507525/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:38.923506 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85813b-fae3-49f0-8667-1f1a0ad6a335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8caa8f97e1214e42b960e5456c1ef372, user_id=dfa906552edc4ec9b76a1e60c3507525, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:38.927502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85813b-fae3-49f0-8667-1f1a0ad6a335 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:39.012515 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 867/1725] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:38 2022] PUT /identity/v3/projects/8caa8f97e1214e42b960e5456c1ef372/users/dfa906552edc4ec9b76a1e60c3507525/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:39.014064 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568552f-4bc5-4300-8e41-06e1b9d04324 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:39.014363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568552f-4bc5-4300-8e41-06e1b9d04324 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:39.014646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568552f-4bc5-4300-8e41-06e1b9d04324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:39.033135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672b57e-1a73-4dd2-906d-c3eb99dae238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:39.034612 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672b57e-1a73-4dd2-906d-c3eb99dae238 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:39.063291 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-f568552f-4bc5-4300-8e41-06e1b9d04324 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:39.067462 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-f568552f-4bc5-4300-8e41-06e1b9d04324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:39.070574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 859/1726] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:39.077427 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99011c-770f-411c-9e09-dfb78f14992d None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:39.077735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99011c-770f-411c-9e09-dfb78f14992d None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:39.082775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99011c-770f-411c-9e09-dfb78f14992d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:39.140873 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-9b99011c-770f-411c-9e09-dfb78f14992d None None] MFA Rules not processed for user `05c4c07ff52c43ebb5056484eac94afa`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:39.142138 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-9b99011c-770f-411c-9e09-dfb78f14992d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:39.269427 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 868/1727] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:39.271675 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568552f-4bc5-4300-8e41-06e1b9d04324 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:39.315936 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:39.329187 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 860/1728] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 3 12:59:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:39.336086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29157060-ec14-44d2-87ba-e778530907fb None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:39.336860 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29157060-ec14-44d2-87ba-e778530907fb None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:39.336860 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29157060-ec14-44d2-87ba-e778530907fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:39.401478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-29157060-ec14-44d2-87ba-e778530907fb None None] MFA Rules not processed for user `6ec4b53cb3a64c3aa9cb6a186a61c1fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:39.402896 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-29157060-ec14-44d2-87ba-e778530907fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:39.481973 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568552f-4bc5-4300-8e41-06e1b9d04324 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:39.503118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034c82e-187c-41aa-84db-97f3544aa6c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de27d25fad634658a1abcb776d9a7b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:39.503872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034c82e-187c-41aa-84db-97f3544aa6c8 service placement] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:39.504066 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034c82e-187c-41aa-84db-97f3544aa6c8 service placement] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:39.504345 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034c82e-187c-41aa-84db-97f3544aa6c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:39.512175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-7034c82e-187c-41aa-84db-97f3544aa6c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:39.544437 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034c82e-187c-41aa-84db-97f3544aa6c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:39.549392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034c82e-187c-41aa-84db-97f3544aa6c8 service placement] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:39.593577 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 869/1729] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:39.598955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052c482-3ceb-493b-9d55-d639c17aa874 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:39.599332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052c482-3ceb-493b-9d55-d639c17aa874 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:39.600292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052c482-3ceb-493b-9d55-d639c17aa874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:39.662692 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 861/1730] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:39.665761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0773141-de9d-4e5a-b25f-a057666ae85c None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:39.667194 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0773141-de9d-4e5a-b25f-a057666ae85c None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:39.667519 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0773141-de9d-4e5a-b25f-a057666ae85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:39.700438 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-e052c482-3ceb-493b-9d55-d639c17aa874 None None] MFA Rules not processed for user `36693fa42a7b41279c8d8c59ecafb243`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:39.704880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e052c482-3ceb-493b-9d55-d639c17aa874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:39.772442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:39.791884 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-e0773141-de9d-4e5a-b25f-a057666ae85c None None] MFA Rules not processed for user `dfa906552edc4ec9b76a1e60c3507525`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:39.797410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e0773141-de9d-4e5a-b25f-a057666ae85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:39.914856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 870/1731] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:39.916157 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052c482-3ceb-493b-9d55-d639c17aa874 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:39.919995 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e052c482-3ceb-493b-9d55-d639c17aa874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:39.965389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 862/1732] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:39.967128 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0773141-de9d-4e5a-b25f-a057666ae85c None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:39.970590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052c482-3ceb-493b-9d55-d639c17aa874 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:39.981576 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0773141-de9d-4e5a-b25f-a057666ae85c None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:39.983420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fda20d-a71d-4cfa-b5c0-ff77d6a1d3d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:39.984073 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fda20d-a71d-4cfa-b5c0-ff77d6a1d3d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:39.986554 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fda20d-a71d-4cfa-b5c0-ff77d6a1d3d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:39.986554 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fda20d-a71d-4cfa-b5c0-ff77d6a1d3d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:39.988032 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec47697-5855-4f81-bcbe-57439576af83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:39.988781 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec47697-5855-4f81-bcbe-57439576af83 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:39.989309 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec47697-5855-4f81-bcbe-57439576af83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:39.989871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec47697-5855-4f81-bcbe-57439576af83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:40.006540 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec47697-5855-4f81-bcbe-57439576af83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:40.008126 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec47697-5855-4f81-bcbe-57439576af83 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:40.015214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fda20d-a71d-4cfa-b5c0-ff77d6a1d3d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:40.015214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fda20d-a71d-4cfa-b5c0-ff77d6a1d3d3 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:40.018774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 863/1733] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:40.020389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec47697-5855-4f81-bcbe-57439576af83 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:40.021881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-aec47697-5855-4f81-bcbe-57439576af83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:40.045787 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 871/1734] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:40.046879 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fda20d-a71d-4cfa-b5c0-ff77d6a1d3d3 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:40.052962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-80fda20d-a71d-4cfa-b5c0-ff77d6a1d3d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:40.099265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec47697-5855-4f81-bcbe-57439576af83 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:40.133476 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6b7d3-5cd8-4bcf-878a-3662d14c1759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:40.134180 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6b7d3-5cd8-4bcf-878a-3662d14c1759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:40.139286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6b7d3-5cd8-4bcf-878a-3662d14c1759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:40.139729 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6b7d3-5cd8-4bcf-878a-3662d14c1759 admin admin] PATH_INFO: `/v3/users/0c5d0ffd70f14cadbd134fa136ed81da` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:40.160341 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6b7d3-5cd8-4bcf-878a-3662d14c1759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5d0ffd70f14cadbd134fa136ed81da)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:40.162536 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6b7d3-5cd8-4bcf-878a-3662d14c1759 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:40.260510 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fda20d-a71d-4cfa-b5c0-ff77d6a1d3d3 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:40.282674 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e96e2-6556-449d-9e08-d002abcd4969 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:40.283354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e96e2-6556-449d-9e08-d002abcd4969 service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:40.283640 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e96e2-6556-449d-9e08-d002abcd4969 service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:40.283918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e96e2-6556-449d-9e08-d002abcd4969 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:40.317126 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e96e2-6556-449d-9e08-d002abcd4969 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:40.326930 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e96e2-6556-449d-9e08-d002abcd4969 service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:40.354717 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 872/1735] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:40.355378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e96e2-6556-449d-9e08-d002abcd4969 service nova] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:40.381472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e96e2-6556-449d-9e08-d002abcd4969 service nova] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:40.394402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683576a-0848-4142-8d29-f862f697eca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:40.395076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683576a-0848-4142-8d29-f862f697eca8 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:40.395444 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683576a-0848-4142-8d29-f862f697eca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:40.395668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683576a-0848-4142-8d29-f862f697eca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:40.396304 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683576a-0848-4142-8d29-f862f697eca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:40.398207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683576a-0848-4142-8d29-f862f697eca8 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:40.470465 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b7c6b7d3-5cd8-4bcf-878a-3662d14c1759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5d0ffd70f14cadbd134fa136ed81da'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:40.478801 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b7c6b7d3-5cd8-4bcf-878a-3662d14c1759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5d0ffd70f14cadbd134fa136ed81da'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:40.522130 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 873/1736] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:40 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:40.526320 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683576a-0848-4142-8d29-f862f697eca8 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:40.596354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b7c6b7d3-5cd8-4bcf-878a-3662d14c1759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5d0ffd70f14cadbd134fa136ed81da'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:40.598028 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b7c6b7d3-5cd8-4bcf-878a-3662d14c1759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5d0ffd70f14cadbd134fa136ed81da'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:40.624062 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b7c6b7d3-5cd8-4bcf-878a-3662d14c1759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5d0ffd70f14cadbd134fa136ed81da'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:40.640568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 864/1737] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 12:59:40 2022] DELETE /identity/v3/users/0c5d0ffd70f14cadbd134fa136ed81da => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:40.644668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70554f26-0070-45aa-be48-b9f82a82de0c None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:40.645131 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70554f26-0070-45aa-be48-b9f82a82de0c None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:40.645584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70554f26-0070-45aa-be48-b9f82a82de0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:40.677949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683576a-0848-4142-8d29-f862f697eca8 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:40.691568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-70554f26-0070-45aa-be48-b9f82a82de0c None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:40.693422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-70554f26-0070-45aa-be48-b9f82a82de0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:40.795747 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 865/1738] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:40.808376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70554f26-0070-45aa-be48-b9f82a82de0c None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:40.814043 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-70554f26-0070-45aa-be48-b9f82a82de0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:40.870989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a158f8-8de2-4a47-b488-69927ba189e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:40.871699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a158f8-8de2-4a47-b488-69927ba189e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:40.872042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a158f8-8de2-4a47-b488-69927ba189e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:40.872328 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a158f8-8de2-4a47-b488-69927ba189e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:40.873011 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a158f8-8de2-4a47-b488-69927ba189e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:40.875979 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a158f8-8de2-4a47-b488-69927ba189e9 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:40.995516 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 874/1739] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:40 2022] POST /identity/v3/users => generated 298 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:41.004069 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a158f8-8de2-4a47-b488-69927ba189e9 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:41.008702 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-15a158f8-8de2-4a47-b488-69927ba189e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:41.035978 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70554f26-0070-45aa-be48-b9f82a82de0c None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:41.039780 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9a86c-eba3-45f9-a50f-0efe53672e26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:41.040414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9a86c-eba3-45f9-a50f-0efe53672e26 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:41.041283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9a86c-eba3-45f9-a50f-0efe53672e26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:41.041674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9a86c-eba3-45f9-a50f-0efe53672e26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:41.062381 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9a86c-eba3-45f9-a50f-0efe53672e26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:41.067321 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9a86c-eba3-45f9-a50f-0efe53672e26 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:41.176361 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 866/1740] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:41.178499 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9a86c-eba3-45f9-a50f-0efe53672e26 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:41.188049 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-f5e9a86c-eba3-45f9-a50f-0efe53672e26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:41.217144 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9a86c-eba3-45f9-a50f-0efe53672e26 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:41.224804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22985aa8-4a3d-4303-960c-433a90f80aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:41.225446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22985aa8-4a3d-4303-960c-433a90f80aff admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:41.225730 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22985aa8-4a3d-4303-960c-433a90f80aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:41.226045 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22985aa8-4a3d-4303-960c-433a90f80aff admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:41.226708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22985aa8-4a3d-4303-960c-433a90f80aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:41.228359 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22985aa8-4a3d-4303-960c-433a90f80aff admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:41.236596 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:41.262413 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 867/1741] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:41.263761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22985aa8-4a3d-4303-960c-433a90f80aff admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:41.267840 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-22985aa8-4a3d-4303-960c-433a90f80aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:41.278138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a158f8-8de2-4a47-b488-69927ba189e9 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:41.299415 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80d2cc-97a0-4422-9f27-f59961005de1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:41.300119 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80d2cc-97a0-4422-9f27-f59961005de1 service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:41.300407 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80d2cc-97a0-4422-9f27-f59961005de1 service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:41.300687 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80d2cc-97a0-4422-9f27-f59961005de1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:41.304358 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22985aa8-4a3d-4303-960c-433a90f80aff admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:41.307961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-2a80d2cc-97a0-4422-9f27-f59961005de1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:41.309873 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ccd9d-91c8-419e-8c31-81e8916a53b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:41.310672 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ccd9d-91c8-419e-8c31-81e8916a53b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:41.311087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ccd9d-91c8-419e-8c31-81e8916a53b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:41.311496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ccd9d-91c8-419e-8c31-81e8916a53b8 admin admin] PATH_INFO: `/v3/projects/e45fc343453f4d16a684a034f2ce00a8` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:41.326841 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ccd9d-91c8-419e-8c31-81e8916a53b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e45fc343453f4d16a684a034f2ce00a8)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:41.329351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ccd9d-91c8-419e-8c31-81e8916a53b8 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:41.489326 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80d2cc-97a0-4422-9f27-f59961005de1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:41.491232 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80d2cc-97a0-4422-9f27-f59961005de1 service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:41.503315 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 875/1742] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:41.504268 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80d2cc-97a0-4422-9f27-f59961005de1 service nova] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:41.518574 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80d2cc-97a0-4422-9f27-f59961005de1 service nova] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:41.522229 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0e5ccd9d-91c8-419e-8c31-81e8916a53b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45fc343453f4d16a684a034f2ce00a8', 'request_id': 'req-0e5ccd9d-91c8-419e-8c31-81e8916a53b8'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:41.532893 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0e5ccd9d-91c8-419e-8c31-81e8916a53b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45fc343453f4d16a684a034f2ce00a8', 'request_id': 'req-0e5ccd9d-91c8-419e-8c31-81e8916a53b8'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:41.632277 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01559725-1e08-460a-893a-0769c40121b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:41.633007 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01559725-1e08-460a-893a-0769c40121b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:41.633688 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01559725-1e08-460a-893a-0769c40121b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:41.633972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01559725-1e08-460a-893a-0769c40121b5 admin admin] PATH_INFO: `/v3/projects/dcb0fd72c74b4dbe986ffc21e8f1425d/users/e8736391b53040cbbbd8bfeb7101d03f/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:41.645989 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0e5ccd9d-91c8-419e-8c31-81e8916a53b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45fc343453f4d16a684a034f2ce00a8', 'request_id': 'req-0e5ccd9d-91c8-419e-8c31-81e8916a53b8'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:41.660381 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01559725-1e08-460a-893a-0769c40121b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb0fd72c74b4dbe986ffc21e8f1425d, user_id=e8736391b53040cbbbd8bfeb7101d03f, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:41.664522 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01559725-1e08-460a-893a-0769c40121b5 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:41.684848 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0e5ccd9d-91c8-419e-8c31-81e8916a53b8 admin admin] The token cache is being invalidate because project e45fc343453f4d16a684a034f2ce00a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:59:41.687093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0e5ccd9d-91c8-419e-8c31-81e8916a53b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:41.688212 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0e5ccd9d-91c8-419e-8c31-81e8916a53b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:41.690648 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 868/1743] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 12:59:41 2022] DELETE /identity/v3/projects/e45fc343453f4d16a684a034f2ce00a8 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:41.695606 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cc279-89e2-4ceb-a6a5-368ec1426e95 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:41.696582 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cc279-89e2-4ceb-a6a5-368ec1426e95 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:41.697046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cc279-89e2-4ceb-a6a5-368ec1426e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:41.727428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-1d5cc279-89e2-4ceb-a6a5-368ec1426e95 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:41.729644 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-1d5cc279-89e2-4ceb-a6a5-368ec1426e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:41.746840 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 869/1744] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:41.751485 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f426-4a37-47b7-ae48-a413ed096814 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:41.751485 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f426-4a37-47b7-ae48-a413ed096814 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:41.751485 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f426-4a37-47b7-ae48-a413ed096814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:41.811896 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 876/1745] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:41 2022] PUT /identity/v3/projects/dcb0fd72c74b4dbe986ffc21e8f1425d/users/e8736391b53040cbbbd8bfeb7101d03f/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:41.814548 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-b220f426-4a37-47b7-ae48-a413ed096814 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:41.817711 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01559725-1e08-460a-893a-0769c40121b5 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:41.821205 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-01559725-1e08-460a-893a-0769c40121b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:41.824674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b220f426-4a37-47b7-ae48-a413ed096814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:41.936102 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:42.077208 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 870/1746] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:42.078257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f426-4a37-47b7-ae48-a413ed096814 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:42.090479 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01559725-1e08-460a-893a-0769c40121b5 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:42.099466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f426-4a37-47b7-ae48-a413ed096814 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:42.102445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e3ec2-a833-4323-b898-eea7e0536775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:42.103238 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e3ec2-a833-4323-b898-eea7e0536775 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:42.103525 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e3ec2-a833-4323-b898-eea7e0536775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:42.103802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e3ec2-a833-4323-b898-eea7e0536775 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:42.104508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e3ec2-a833-4323-b898-eea7e0536775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:42.106123 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e3ec2-a833-4323-b898-eea7e0536775 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:42.114503 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88eb09-356b-41d6-9277-4eb71ceaf263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:42.115169 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88eb09-356b-41d6-9277-4eb71ceaf263 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:42.115452 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88eb09-356b-41d6-9277-4eb71ceaf263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:42.115732 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88eb09-356b-41d6-9277-4eb71ceaf263 admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:42.116433 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88eb09-356b-41d6-9277-4eb71ceaf263 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:59:42.117913 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88eb09-356b-41d6-9277-4eb71ceaf263 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:42.119744 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88eb09-356b-41d6-9277-4eb71ceaf263 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:42.141933 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 877/1747] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:42.143198 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e3ec2-a833-4323-b898-eea7e0536775 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:42.162937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 871/1748] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 12:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:59:42.167494 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88eb09-356b-41d6-9277-4eb71ceaf263 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:42.168232 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e3ec2-a833-4323-b898-eea7e0536775 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:42.183442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88eb09-356b-41d6-9277-4eb71ceaf263 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:42.184482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288950b-9419-45da-ad35-a00cf8f058ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:42.186689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288950b-9419-45da-ad35-a00cf8f058ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:42.187316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288950b-9419-45da-ad35-a00cf8f058ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:42.187734 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288950b-9419-45da-ad35-a00cf8f058ea admin admin] PATH_INFO: `/v3/projects/dcb0fd72c74b4dbe986ffc21e8f1425d/users/e8736391b53040cbbbd8bfeb7101d03f/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:42.191514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288950b-9419-45da-ad35-a00cf8f058ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb0fd72c74b4dbe986ffc21e8f1425d, user_id=e8736391b53040cbbbd8bfeb7101d03f, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:42.194866 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288950b-9419-45da-ad35-a00cf8f058ea admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:42.207203 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93fbed-a53f-453b-8657-426cf21800f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:42.208103 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93fbed-a53f-453b-8657-426cf21800f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:42.208516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93fbed-a53f-453b-8657-426cf21800f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:42.209007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93fbed-a53f-453b-8657-426cf21800f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:42.209831 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93fbed-a53f-453b-8657-426cf21800f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:42.214613 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93fbed-a53f-453b-8657-426cf21800f8 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:42.231099 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 878/1749] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:42 2022] PUT /identity/v3/projects/dcb0fd72c74b4dbe986ffc21e8f1425d/users/e8736391b53040cbbbd8bfeb7101d03f/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:42.248349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b50e45-d66f-402c-905e-7abbecf269f9 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:42.248650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b50e45-d66f-402c-905e-7abbecf269f9 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:42.248935 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b50e45-d66f-402c-905e-7abbecf269f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:42.301261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-81b50e45-d66f-402c-905e-7abbecf269f9 None None] MFA Rules not processed for user `e8736391b53040cbbbd8bfeb7101d03f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:42.307196 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-81b50e45-d66f-402c-905e-7abbecf269f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:42.375192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 872/1750] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:42 2022] POST /identity/v3/projects => generated 405 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:42.377035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93fbed-a53f-453b-8657-426cf21800f8 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:42.438844 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 879/1751] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:42.446284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b50e45-d66f-402c-905e-7abbecf269f9 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:42.448630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-81b50e45-d66f-402c-905e-7abbecf269f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:42.569178 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93fbed-a53f-453b-8657-426cf21800f8 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:42.577417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864db3d-250f-45b6-b5e0-10faea3d973c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:42.579239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864db3d-250f-45b6-b5e0-10faea3d973c admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:42.579573 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864db3d-250f-45b6-b5e0-10faea3d973c admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:42.579858 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864db3d-250f-45b6-b5e0-10faea3d973c admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:42.580782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864db3d-250f-45b6-b5e0-10faea3d973c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:42.583941 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864db3d-250f-45b6-b5e0-10faea3d973c admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:42.679719 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b50e45-d66f-402c-905e-7abbecf269f9 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:42.686246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 873/1752] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:42 2022] POST /identity/v3/users => generated 303 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:42.687571 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864db3d-250f-45b6-b5e0-10faea3d973c admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:42.691646 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-d864db3d-250f-45b6-b5e0-10faea3d973c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:42.716959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864db3d-250f-45b6-b5e0-10faea3d973c admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:42.734326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20945d-bd3f-44c8-b3e6-003c5bab88e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:42.736170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20945d-bd3f-44c8-b3e6-003c5bab88e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:42.736334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20945d-bd3f-44c8-b3e6-003c5bab88e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:42.736616 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20945d-bd3f-44c8-b3e6-003c5bab88e6 admin admin] PATH_INFO: `/v3/projects/87529b9c30a64e7b99fd296d71445b3d` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:42.784360 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20945d-bd3f-44c8-b3e6-003c5bab88e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87529b9c30a64e7b99fd296d71445b3d)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:42.792951 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20945d-bd3f-44c8-b3e6-003c5bab88e6 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:42.857220 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12c090-4640-4e29-9c04-94ad13f1b238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:42.857880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12c090-4640-4e29-9c04-94ad13f1b238 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:42.858171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12c090-4640-4e29-9c04-94ad13f1b238 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:42.858550 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12c090-4640-4e29-9c04-94ad13f1b238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:43.027873 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12c090-4640-4e29-9c04-94ad13f1b238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:43.029529 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12c090-4640-4e29-9c04-94ad13f1b238 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:43.042909 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 880/1753] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:43.043835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12c090-4640-4e29-9c04-94ad13f1b238 service cinder] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:43.070642 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-fc20945d-bd3f-44c8-b3e6-003c5bab88e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87529b9c30a64e7b99fd296d71445b3d', 'request_id': 'req-fc20945d-bd3f-44c8-b3e6-003c5bab88e6'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:43.072995 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12c090-4640-4e29-9c04-94ad13f1b238 service cinder] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:43.089090 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-fc20945d-bd3f-44c8-b3e6-003c5bab88e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87529b9c30a64e7b99fd296d71445b3d', 'request_id': 'req-fc20945d-bd3f-44c8-b3e6-003c5bab88e6'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:43.202943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c4de4-6ab5-4d98-adc2-3d9c361f1c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:43.203958 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c4de4-6ab5-4d98-adc2-3d9c361f1c5d admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:43.204753 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c4de4-6ab5-4d98-adc2-3d9c361f1c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:43.205140 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-fc20945d-bd3f-44c8-b3e6-003c5bab88e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87529b9c30a64e7b99fd296d71445b3d', 'request_id': 'req-fc20945d-bd3f-44c8-b3e6-003c5bab88e6'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:43.205425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c4de4-6ab5-4d98-adc2-3d9c361f1c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:43.206406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c4de4-6ab5-4d98-adc2-3d9c361f1c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:43.211814 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c4de4-6ab5-4d98-adc2-3d9c361f1c5d admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:43.227589 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-fc20945d-bd3f-44c8-b3e6-003c5bab88e6 admin admin] The token cache is being invalidate because project 87529b9c30a64e7b99fd296d71445b3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:59:43.227589 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-fc20945d-bd3f-44c8-b3e6-003c5bab88e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:43.228329 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-fc20945d-bd3f-44c8-b3e6-003c5bab88e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:43.228501 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 881/1754] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:43.230783 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 874/1755] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 12:59:42 2022] DELETE /identity/v3/projects/87529b9c30a64e7b99fd296d71445b3d => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:43.231549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42db012-4e31-430d-a546-819df148e87a None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:43.231680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20945d-bd3f-44c8-b3e6-003c5bab88e6 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:43.232108 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42db012-4e31-430d-a546-819df148e87a None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:43.232544 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42db012-4e31-430d-a546-819df148e87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:43.235603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-fc20945d-bd3f-44c8-b3e6-003c5bab88e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:43.266398 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-b42db012-4e31-430d-a546-819df148e87a None None] MFA Rules not processed for user `8f420ba9dd364405b7d1611d86e322ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:43.268063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b42db012-4e31-430d-a546-819df148e87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:43.371850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20945d-bd3f-44c8-b3e6-003c5bab88e6 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:43.382765 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396daf1-153c-4892-99be-cdc452206ca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:43.385196 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396daf1-153c-4892-99be-cdc452206ca7 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:43.387528 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396daf1-153c-4892-99be-cdc452206ca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:43.388078 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396daf1-153c-4892-99be-cdc452206ca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:43.394659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-2396daf1-153c-4892-99be-cdc452206ca7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:43.455558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 882/1756] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:43.460115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42db012-4e31-430d-a546-819df148e87a None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:43.464143 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b42db012-4e31-430d-a546-819df148e87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:43.487551 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42db012-4e31-430d-a546-819df148e87a None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:43.514844 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:43.516582 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42dc01-db63-40a8-b21e-9932da60f69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:43.517734 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42dc01-db63-40a8-b21e-9932da60f69e admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:43.518119 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42dc01-db63-40a8-b21e-9932da60f69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:43.523168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42dc01-db63-40a8-b21e-9932da60f69e admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:43.524050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42dc01-db63-40a8-b21e-9932da60f69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:43.534100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42dc01-db63-40a8-b21e-9932da60f69e admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:43.550865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396daf1-153c-4892-99be-cdc452206ca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:43.554022 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396daf1-153c-4892-99be-cdc452206ca7 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:43.568563 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 883/1757] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:43.568563 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42dc01-db63-40a8-b21e-9932da60f69e admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:43.569228 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-0f42dc01-db63-40a8-b21e-9932da60f69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:43.584039 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 875/1758] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:43.584887 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396daf1-153c-4892-99be-cdc452206ca7 service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:43.588856 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-2396daf1-153c-4892-99be-cdc452206ca7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:43.613116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42dc01-db63-40a8-b21e-9932da60f69e admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:43.614795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396daf1-153c-4892-99be-cdc452206ca7 service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:43.626879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ec6c1-15af-4be0-8313-1abf46a6afdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:43.627591 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ec6c1-15af-4be0-8313-1abf46a6afdf admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:43.627876 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ec6c1-15af-4be0-8313-1abf46a6afdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:43.628178 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ec6c1-15af-4be0-8313-1abf46a6afdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:43.628873 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ec6c1-15af-4be0-8313-1abf46a6afdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:43.631114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ec6c1-15af-4be0-8313-1abf46a6afdf admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:43.651870 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a2137-ae2b-40b3-a005-75e35c78753f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:43.652559 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a2137-ae2b-40b3-a005-75e35c78753f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:43.655535 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a2137-ae2b-40b3-a005-75e35c78753f admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:43.656053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a2137-ae2b-40b3-a005-75e35c78753f admin admin] PATH_INFO: `/v3/users/ea0f9e138fd64fa48e16a0143ee25d55` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:43.661430 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a2137-ae2b-40b3-a005-75e35c78753f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea0f9e138fd64fa48e16a0143ee25d55)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:43.664133 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a2137-ae2b-40b3-a005-75e35c78753f admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:43.820972 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 876/1759] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:43 2022] POST /identity/v3/projects => generated 373 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:43.823155 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ec6c1-15af-4be0-8313-1abf46a6afdf admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:43.957686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-423a2137-ae2b-40b3-a005-75e35c78753f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea0f9e138fd64fa48e16a0143ee25d55'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:43.972515 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ec6c1-15af-4be0-8313-1abf46a6afdf admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:43.976416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-423a2137-ae2b-40b3-a005-75e35c78753f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea0f9e138fd64fa48e16a0143ee25d55'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:43.979133 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-423a2137-ae2b-40b3-a005-75e35c78753f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea0f9e138fd64fa48e16a0143ee25d55'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:43.981025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bc3d6-2a7a-4c16-ac80-16de137f40ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:43.981769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bc3d6-2a7a-4c16-ac80-16de137f40ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:43.982058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bc3d6-2a7a-4c16-ac80-16de137f40ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:43.982614 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bc3d6-2a7a-4c16-ac80-16de137f40ef admin admin] PATH_INFO: `/v3/projects/6a17c8782e87497bb467e35a52946c46/users/5b592d7952454d52badee83504aaf935/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:44.013481 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-423a2137-ae2b-40b3-a005-75e35c78753f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea0f9e138fd64fa48e16a0143ee25d55'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:44.015120 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-423a2137-ae2b-40b3-a005-75e35c78753f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea0f9e138fd64fa48e16a0143ee25d55'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:44.016372 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bc3d6-2a7a-4c16-ac80-16de137f40ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a17c8782e87497bb467e35a52946c46, user_id=5b592d7952454d52badee83504aaf935, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:44.021333 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bc3d6-2a7a-4c16-ac80-16de137f40ef admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:44.136969 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 884/1760] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 12:59:43 2022] DELETE /identity/v3/users/ea0f9e138fd64fa48e16a0143ee25d55 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:44.138302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a2137-ae2b-40b3-a005-75e35c78753f admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:44.162371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-423a2137-ae2b-40b3-a005-75e35c78753f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:44.176357 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 877/1761] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:43 2022] PUT /identity/v3/projects/6a17c8782e87497bb467e35a52946c46/users/5b592d7952454d52badee83504aaf935/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:44.195881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326975c-516a-4589-80da-4e64040468b4 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:44.196360 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326975c-516a-4589-80da-4e64040468b4 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:44.198176 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326975c-516a-4589-80da-4e64040468b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:44.266342 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-2326975c-516a-4589-80da-4e64040468b4 None None] MFA Rules not processed for user `5b592d7952454d52badee83504aaf935`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:44.266342 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-2326975c-516a-4589-80da-4e64040468b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:44.333466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a2137-ae2b-40b3-a005-75e35c78753f admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:44.398304 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 878/1762] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:44 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:44.399315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326975c-516a-4589-80da-4e64040468b4 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:44.401743 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-2326975c-516a-4589-80da-4e64040468b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:44.406654 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342c740-99b9-4bb9-affc-729b40998f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:44.408761 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342c740-99b9-4bb9-affc-729b40998f71 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:44.413716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342c740-99b9-4bb9-affc-729b40998f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:44.413716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342c740-99b9-4bb9-affc-729b40998f71 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:44.413716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342c740-99b9-4bb9-affc-729b40998f71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:44.413716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342c740-99b9-4bb9-affc-729b40998f71 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:44.419207 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326975c-516a-4589-80da-4e64040468b4 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:44.425780 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3460807-3b43-457c-b30c-5b9c9f690c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:44.426861 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3460807-3b43-457c-b30c-5b9c9f690c51 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:44.427340 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3460807-3b43-457c-b30c-5b9c9f690c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:44.427625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3460807-3b43-457c-b30c-5b9c9f690c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:44.428325 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3460807-3b43-457c-b30c-5b9c9f690c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:44.430276 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3460807-3b43-457c-b30c-5b9c9f690c51 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:44.543611 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 885/1763] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:44 2022] POST /identity/v3/users => generated 293 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:44.549678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342c740-99b9-4bb9-affc-729b40998f71 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:44.567524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342c740-99b9-4bb9-affc-729b40998f71 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:44.580225 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d670360-c49f-4dd7-9662-bfcd9938aa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:44.582723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d670360-c49f-4dd7-9662-bfcd9938aa3c admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:44.582723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d670360-c49f-4dd7-9662-bfcd9938aa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:44.582723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d670360-c49f-4dd7-9662-bfcd9938aa3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:44.584496 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d670360-c49f-4dd7-9662-bfcd9938aa3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:44.589049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d670360-c49f-4dd7-9662-bfcd9938aa3c admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:44.614990 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 886/1764] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:44.619556 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 879/1765] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:44 2022] POST /identity/v3/projects => generated 405 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:44.625213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d670360-c49f-4dd7-9662-bfcd9938aa3c admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:44.626319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3460807-3b43-457c-b30c-5b9c9f690c51 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:44.641741 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d670360-c49f-4dd7-9662-bfcd9938aa3c admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:44.779760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cec17d-f5fb-4c66-8893-564d7efc7f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:44.780411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cec17d-f5fb-4c66-8893-564d7efc7f14 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:44.781893 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cec17d-f5fb-4c66-8893-564d7efc7f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:44.781893 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cec17d-f5fb-4c66-8893-564d7efc7f14 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:44.783713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cec17d-f5fb-4c66-8893-564d7efc7f14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:44.788149 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cec17d-f5fb-4c66-8893-564d7efc7f14 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:44.836739 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3460807-3b43-457c-b30c-5b9c9f690c51 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:44.844530 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02b3a1-d207-4baf-9d44-607a0fc9a24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:44.845231 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02b3a1-d207-4baf-9d44-607a0fc9a24e admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:44.845569 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02b3a1-d207-4baf-9d44-607a0fc9a24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:44.845859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02b3a1-d207-4baf-9d44-607a0fc9a24e admin admin] PATH_INFO: `/v3/projects/4058cb95725747c1868a8e142fe74f78/users/04bed65114d7482ab626a13f29afddfa/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:44.882074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02b3a1-d207-4baf-9d44-607a0fc9a24e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4058cb95725747c1868a8e142fe74f78, user_id=04bed65114d7482ab626a13f29afddfa, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:44.885608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02b3a1-d207-4baf-9d44-607a0fc9a24e admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:44.940951 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 887/1766] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:44 2022] POST /identity/v3/users => generated 309 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:44.944563 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cec17d-f5fb-4c66-8893-564d7efc7f14 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:44.963136 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cec17d-f5fb-4c66-8893-564d7efc7f14 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:44.974964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4cbb7-f8a3-411a-9aac-fdbc5020472b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:44.974964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4cbb7-f8a3-411a-9aac-fdbc5020472b admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:44.974964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4cbb7-f8a3-411a-9aac-fdbc5020472b admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:44.974964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4cbb7-f8a3-411a-9aac-fdbc5020472b admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:44.975383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4cbb7-f8a3-411a-9aac-fdbc5020472b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:44.975383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4cbb7-f8a3-411a-9aac-fdbc5020472b admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:44.989704 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 888/1767] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:44.993646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4cbb7-f8a3-411a-9aac-fdbc5020472b admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:45.019744 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4cbb7-f8a3-411a-9aac-fdbc5020472b admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:45.031077 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 880/1768] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:44 2022] PUT /identity/v3/projects/4058cb95725747c1868a8e142fe74f78/users/04bed65114d7482ab626a13f29afddfa/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:45.031077 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02b3a1-d207-4baf-9d44-607a0fc9a24e admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:45.033729 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-4e02b3a1-d207-4baf-9d44-607a0fc9a24e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:45.148196 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:45.159075 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec99091-203f-42db-94e5-0df2635cf48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:45.160413 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02b3a1-d207-4baf-9d44-607a0fc9a24e admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:45.163770 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec99091-203f-42db-94e5-0df2635cf48c admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:45.164397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec99091-203f-42db-94e5-0df2635cf48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:45.164397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec99091-203f-42db-94e5-0df2635cf48c admin admin] PATH_INFO: `/v3/projects/65702f223b044444bc290b641435fa0b/users/beaf39b7f7d249fc8a78ad634fbc9e0b/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:45.171296 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5d987-47d8-4b5b-b79d-a3e824fefb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:45.173069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5d987-47d8-4b5b-b79d-a3e824fefb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:45.173790 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5d987-47d8-4b5b-b79d-a3e824fefb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:45.177140 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5d987-47d8-4b5b-b79d-a3e824fefb60 admin admin] PATH_INFO: `/v3/projects/b78894db96f54681b14db6f566957996` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:45.177868 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5d987-47d8-4b5b-b79d-a3e824fefb60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b78894db96f54681b14db6f566957996)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:45.186197 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5d987-47d8-4b5b-b79d-a3e824fefb60 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:45.213018 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec99091-203f-42db-94e5-0df2635cf48c admin admin] RBAC: Authorizing `identity:create_grant(project_id=65702f223b044444bc290b641435fa0b, user_id=beaf39b7f7d249fc8a78ad634fbc9e0b, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:45.244470 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec99091-203f-42db-94e5-0df2635cf48c admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:45.365292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:45.376861 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 889/1769] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:44 2022] PUT /identity/v3/projects/65702f223b044444bc290b641435fa0b/users/beaf39b7f7d249fc8a78ad634fbc9e0b/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:45.384201 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec99091-203f-42db-94e5-0df2635cf48c admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:45.413536 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-8fc5d987-47d8-4b5b-b79d-a3e824fefb60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b78894db96f54681b14db6f566957996', 'request_id': 'req-8fc5d987-47d8-4b5b-b79d-a3e824fefb60'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:45.444666 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-8fc5d987-47d8-4b5b-b79d-a3e824fefb60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b78894db96f54681b14db6f566957996', 'request_id': 'req-8fc5d987-47d8-4b5b-b79d-a3e824fefb60'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:45.545710 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec99091-203f-42db-94e5-0df2635cf48c admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:45.569415 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-8fc5d987-47d8-4b5b-b79d-a3e824fefb60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b78894db96f54681b14db6f566957996', 'request_id': 'req-8fc5d987-47d8-4b5b-b79d-a3e824fefb60'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:45.590717 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-8fc5d987-47d8-4b5b-b79d-a3e824fefb60 admin admin] The token cache is being invalidate because project b78894db96f54681b14db6f566957996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:59:45.591093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-8fc5d987-47d8-4b5b-b79d-a3e824fefb60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:45.609398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-8fc5d987-47d8-4b5b-b79d-a3e824fefb60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:45.614864 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 881/1770] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 12:59:45 2022] DELETE /identity/v3/projects/b78894db96f54681b14db6f566957996 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:45.617705 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5d987-47d8-4b5b-b79d-a3e824fefb60 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:45.636794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-8fc5d987-47d8-4b5b-b79d-a3e824fefb60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:45.697488 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40109e44-70ea-4641-a213-dbff1f0b9fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:45.698465 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40109e44-70ea-4641-a213-dbff1f0b9fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:45.699018 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40109e44-70ea-4641-a213-dbff1f0b9fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:45.699370 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40109e44-70ea-4641-a213-dbff1f0b9fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:45.700646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40109e44-70ea-4641-a213-dbff1f0b9fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:45.701989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40109e44-70ea-4641-a213-dbff1f0b9fb3 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:45.726095 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 890/1771] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:45.726095 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd2e4c-ec80-4700-b3e5-052f753f3114 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:45.730605 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd2e4c-ec80-4700-b3e5-052f753f3114 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:45.730924 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd2e4c-ec80-4700-b3e5-052f753f3114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:45.774525 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-28fd2e4c-ec80-4700-b3e5-052f753f3114 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:45.776452 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-28fd2e4c-ec80-4700-b3e5-052f753f3114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:45.778115 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5d987-47d8-4b5b-b79d-a3e824fefb60 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:45.783725 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364ca34-52b9-46a9-9af7-c7edd522a84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:45.784566 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364ca34-52b9-46a9-9af7-c7edd522a84b admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:45.789585 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364ca34-52b9-46a9-9af7-c7edd522a84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:45.789585 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364ca34-52b9-46a9-9af7-c7edd522a84b admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:45.789585 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364ca34-52b9-46a9-9af7-c7edd522a84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:45.789807 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 891/1772] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:45.789879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364ca34-52b9-46a9-9af7-c7edd522a84b admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:45.789960 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd2e4c-ec80-4700-b3e5-052f753f3114 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:45.792668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-28fd2e4c-ec80-4700-b3e5-052f753f3114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:45.808032 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd2e4c-ec80-4700-b3e5-052f753f3114 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:45.811000 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 882/1773] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:45.814320 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c972c-826a-4ac3-94aa-065be77a91a4 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:45.814840 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c972c-826a-4ac3-94aa-065be77a91a4 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:45.815744 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c972c-826a-4ac3-94aa-065be77a91a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:45.825142 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669f867-1e9f-4cdf-909f-8210997f9699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:45.826143 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669f867-1e9f-4cdf-909f-8210997f9699 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:45.826569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669f867-1e9f-4cdf-909f-8210997f9699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:45.827044 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669f867-1e9f-4cdf-909f-8210997f9699 admin admin] PATH_INFO: `/v3/projects/4058cb95725747c1868a8e142fe74f78/users/04bed65114d7482ab626a13f29afddfa/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:45.829613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669f867-1e9f-4cdf-909f-8210997f9699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4058cb95725747c1868a8e142fe74f78, user_id=04bed65114d7482ab626a13f29afddfa, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:45.843983 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669f867-1e9f-4cdf-909f-8210997f9699 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:45.868366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 892/1774] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:45 2022] PUT /identity/v3/projects/4058cb95725747c1868a8e142fe74f78/users/04bed65114d7482ab626a13f29afddfa/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:45.870163 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d872a79-0094-4ab2-bc53-ebca54ecdeab None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:45.871896 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d872a79-0094-4ab2-bc53-ebca54ecdeab None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:45.873171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d872a79-0094-4ab2-bc53-ebca54ecdeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:45.908065 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-1d872a79-0094-4ab2-bc53-ebca54ecdeab None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:45.911786 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-1d872a79-0094-4ab2-bc53-ebca54ecdeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:45.949549 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-512c972c-826a-4ac3-94aa-065be77a91a4 None None] MFA Rules not processed for user `b9d70abf4f754530a3cf6efa7a782736`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:45.955569 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-512c972c-826a-4ac3-94aa-065be77a91a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:46.003345 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:46.045140 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 893/1775] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:46.046419 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d872a79-0094-4ab2-bc53-ebca54ecdeab None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:46.060001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d872a79-0094-4ab2-bc53-ebca54ecdeab None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:46.066368 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675b07a-0b8b-4235-b1be-ac2b9d337227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:46.067387 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675b07a-0b8b-4235-b1be-ac2b9d337227 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:46.067776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675b07a-0b8b-4235-b1be-ac2b9d337227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:46.068222 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675b07a-0b8b-4235-b1be-ac2b9d337227 admin admin] PATH_INFO: `/v3/projects/65702f223b044444bc290b641435fa0b/users/beaf39b7f7d249fc8a78ad634fbc9e0b/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:46.070403 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675b07a-0b8b-4235-b1be-ac2b9d337227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65702f223b044444bc290b641435fa0b, user_id=beaf39b7f7d249fc8a78ad634fbc9e0b, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:46.074329 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675b07a-0b8b-4235-b1be-ac2b9d337227 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:46.088496 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 894/1776] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:46 2022] PUT /identity/v3/projects/65702f223b044444bc290b641435fa0b/users/beaf39b7f7d249fc8a78ad634fbc9e0b/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:46.089852 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675b07a-0b8b-4235-b1be-ac2b9d337227 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:46.119099 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 883/1777] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 3 12:59:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:46.120652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73084cd5-0344-4094-b212-107ba722592c None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:46.121117 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73084cd5-0344-4094-b212-107ba722592c None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:46.121660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73084cd5-0344-4094-b212-107ba722592c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:46.169682 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-73084cd5-0344-4094-b212-107ba722592c None None] MFA Rules not processed for user `beaf39b7f7d249fc8a78ad634fbc9e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:46.170986 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-73084cd5-0344-4094-b212-107ba722592c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:46.215201 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675b07a-0b8b-4235-b1be-ac2b9d337227 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:46.236036 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcc5b9-00ee-4316-8f2d-1bebedb412f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:46.236975 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcc5b9-00ee-4316-8f2d-1bebedb412f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:46.237615 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcc5b9-00ee-4316-8f2d-1bebedb412f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:46.238132 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcc5b9-00ee-4316-8f2d-1bebedb412f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:46.239075 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bcc5b9-00ee-4316-8f2d-1bebedb412f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:59:46.239635 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bcc5b9-00ee-4316-8f2d-1bebedb412f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:46.241751 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bcc5b9-00ee-4316-8f2d-1bebedb412f5 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:46.262096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 895/1778] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 12:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:59:46.269301 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcc5b9-00ee-4316-8f2d-1bebedb412f5 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:46.296760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcc5b9-00ee-4316-8f2d-1bebedb412f5 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:46.310580 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e4374-bc02-453f-b389-b031cdeb0ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:46.311358 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e4374-bc02-453f-b389-b031cdeb0ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:46.312018 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e4374-bc02-453f-b389-b031cdeb0ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:46.312407 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e4374-bc02-453f-b389-b031cdeb0ff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:46.313196 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e4374-bc02-453f-b389-b031cdeb0ff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:46.317940 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e4374-bc02-453f-b389-b031cdeb0ff3 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:46.352715 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 884/1779] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:46 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:46.364377 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73084cd5-0344-4094-b212-107ba722592c None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:46.365867 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-73084cd5-0344-4094-b212-107ba722592c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:46.403375 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:46.464217 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 896/1780] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:46 2022] POST /identity/v3/projects => generated 393 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:46.467964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e4374-bc02-453f-b389-b031cdeb0ff3 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:46.489103 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73084cd5-0344-4094-b212-107ba722592c None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:46.610775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca0b02-f7c9-48d9-81d5-4a46621eb8e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:46.611397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca0b02-f7c9-48d9-81d5-4a46621eb8e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:46.611688 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca0b02-f7c9-48d9-81d5-4a46621eb8e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:46.611969 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca0b02-f7c9-48d9-81d5-4a46621eb8e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:46.621402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e4374-bc02-453f-b389-b031cdeb0ff3 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:46.635936 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592caae6-2fb2-4be8-afdc-62d8ab4246a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:46.644247 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592caae6-2fb2-4be8-afdc-62d8ab4246a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:46.644247 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592caae6-2fb2-4be8-afdc-62d8ab4246a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:46.644247 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592caae6-2fb2-4be8-afdc-62d8ab4246a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:46.644247 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592caae6-2fb2-4be8-afdc-62d8ab4246a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:46.644247 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592caae6-2fb2-4be8-afdc-62d8ab4246a7 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:46.746040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca0b02-f7c9-48d9-81d5-4a46621eb8e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:46.750675 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca0b02-f7c9-48d9-81d5-4a46621eb8e0 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:46.777568 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 897/1781] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:46 2022] POST /identity/v3/users => generated 297 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:46.778866 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592caae6-2fb2-4be8-afdc-62d8ab4246a7 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:46.782922 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 885/1782] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:46 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:59:46.784680 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-592caae6-2fb2-4be8-afdc-62d8ab4246a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:46.785661 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca0b02-f7c9-48d9-81d5-4a46621eb8e0 service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:46.835487 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca0b02-f7c9-48d9-81d5-4a46621eb8e0 service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:46.866000 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d1f7d-7f92-4d6e-b5dd-89f1954eb2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:46.870822 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d1f7d-7f92-4d6e-b5dd-89f1954eb2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:46.871135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d1f7d-7f92-4d6e-b5dd-89f1954eb2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:46.871495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d1f7d-7f92-4d6e-b5dd-89f1954eb2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:46.880397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d1f7d-7f92-4d6e-b5dd-89f1954eb2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:46.886112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d1f7d-7f92-4d6e-b5dd-89f1954eb2e1 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:46.917037 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 886/1783] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:46.918115 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d1f7d-7f92-4d6e-b5dd-89f1954eb2e1 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:46.950069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d1f7d-7f92-4d6e-b5dd-89f1954eb2e1 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:46.957849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592caae6-2fb2-4be8-afdc-62d8ab4246a7 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:46.962071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b1218-ddb3-442d-ac2b-aa650b634c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:46.962800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b1218-ddb3-442d-ac2b-aa650b634c8b admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:46.963096 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b1218-ddb3-442d-ac2b-aa650b634c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:46.963376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b1218-ddb3-442d-ac2b-aa650b634c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:46.967602 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b1218-ddb3-442d-ac2b-aa650b634c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:46.967716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c581d1-aeea-4316-ba4a-7809a4f28abe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5209ec838a4f45d6b746edb27970c93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:46.967716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c581d1-aeea-4316-ba4a-7809a4f28abe service swift] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:46.967716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c581d1-aeea-4316-ba4a-7809a4f28abe service swift] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:46.971807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b1218-ddb3-442d-ac2b-aa650b634c8b admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:46.985488 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c581d1-aeea-4316-ba4a-7809a4f28abe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:46.996878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 887/1784] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:47.008118 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b1218-ddb3-442d-ac2b-aa650b634c8b admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:47.048524 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b1218-ddb3-442d-ac2b-aa650b634c8b admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:47.086903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cf28e-77f2-4f3f-9240-4af1864d0f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:47.095763 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cf28e-77f2-4f3f-9240-4af1864d0f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:47.095763 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cf28e-77f2-4f3f-9240-4af1864d0f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:47.095763 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cf28e-77f2-4f3f-9240-4af1864d0f2a admin admin] PATH_INFO: `/v3/projects/e12e8bfff40d48208872c4336738835b/users/fa4455ac7c5547699e56725de9670531/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:47.141480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cf28e-77f2-4f3f-9240-4af1864d0f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e12e8bfff40d48208872c4336738835b, user_id=fa4455ac7c5547699e56725de9670531, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:47.151267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cf28e-77f2-4f3f-9240-4af1864d0f2a admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:47.165216 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:47.168108 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c581d1-aeea-4316-ba4a-7809a4f28abe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:47.169721 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c581d1-aeea-4316-ba4a-7809a4f28abe service swift] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:47.188537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 898/1785] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 3 12:59:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:59:47.189237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c581d1-aeea-4316-ba4a-7809a4f28abe service swift] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:47.204663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c581d1-aeea-4316-ba4a-7809a4f28abe service swift] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:47.214154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760786fa-50e4-40f5-b84e-6877061b6faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:47.214983 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760786fa-50e4-40f5-b84e-6877061b6faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:47.215329 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760786fa-50e4-40f5-b84e-6877061b6faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:47.220832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760786fa-50e4-40f5-b84e-6877061b6faf admin admin] PATH_INFO: `/v3/users/5b592d7952454d52badee83504aaf935` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:47.220832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760786fa-50e4-40f5-b84e-6877061b6faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b592d7952454d52badee83504aaf935)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:47.220832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760786fa-50e4-40f5-b84e-6877061b6faf admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:47.254481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 888/1786] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:47 2022] PUT /identity/v3/projects/e12e8bfff40d48208872c4336738835b/users/fa4455ac7c5547699e56725de9670531/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:59:47.256117 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d8204-ee04-43bd-9c11-1c468c6667e5 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:47.256517 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d8204-ee04-43bd-9c11-1c468c6667e5 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:47.259075 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d8204-ee04-43bd-9c11-1c468c6667e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:47.321812 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-ca5d8204-ee04-43bd-9c11-1c468c6667e5 None None] MFA Rules not processed for user `6ec4b53cb3a64c3aa9cb6a186a61c1fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:47.328159 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-ca5d8204-ee04-43bd-9c11-1c468c6667e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:47.471604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-760786fa-50e4-40f5-b84e-6877061b6faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b592d7952454d52badee83504aaf935'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:47.491837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-760786fa-50e4-40f5-b84e-6877061b6faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b592d7952454d52badee83504aaf935'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:47.495185 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-760786fa-50e4-40f5-b84e-6877061b6faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b592d7952454d52badee83504aaf935'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:47.526864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-760786fa-50e4-40f5-b84e-6877061b6faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b592d7952454d52badee83504aaf935'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:47.528697 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-760786fa-50e4-40f5-b84e-6877061b6faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b592d7952454d52badee83504aaf935'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:47.596382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 889/1787] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:47.600302 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d12f3a-de32-4a0a-8a6d-b894a9661db4 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:47.600813 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d12f3a-de32-4a0a-8a6d-b894a9661db4 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:47.601397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d12f3a-de32-4a0a-8a6d-b894a9661db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:47.651338 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 899/1788] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 12:59:47 2022] DELETE /identity/v3/users/5b592d7952454d52badee83504aaf935 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:47.654662 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db982026-ee36-43c0-b351-0332b0a877c5 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:47.655035 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db982026-ee36-43c0-b351-0332b0a877c5 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:47.655292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db982026-ee36-43c0-b351-0332b0a877c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:47.666696 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-13d12f3a-de32-4a0a-8a6d-b894a9661db4 None None] MFA Rules not processed for user `fa4455ac7c5547699e56725de9670531`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:47.668185 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-13d12f3a-de32-4a0a-8a6d-b894a9661db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:47.743302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-db982026-ee36-43c0-b351-0332b0a877c5 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:47.758465 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-db982026-ee36-43c0-b351-0332b0a877c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:47.886168 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 890/1789] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:47.892823 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df13c6-5c5b-44a8-9e09-7c88dcddc862 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:47.894885 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df13c6-5c5b-44a8-9e09-7c88dcddc862 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:47.896773 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df13c6-5c5b-44a8-9e09-7c88dcddc862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:47.911852 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 900/1790] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:47.917492 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db982026-ee36-43c0-b351-0332b0a877c5 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:47.925230 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-db982026-ee36-43c0-b351-0332b0a877c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:47.979551 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-17df13c6-5c5b-44a8-9e09-7c88dcddc862 None None] MFA Rules not processed for user `05c4c07ff52c43ebb5056484eac94afa`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:47.984049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db982026-ee36-43c0-b351-0332b0a877c5 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:47.984671 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-17df13c6-5c5b-44a8-9e09-7c88dcddc862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:47.997251 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd852824-8594-4028-a5a3-a3637f278cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:48.003785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd852824-8594-4028-a5a3-a3637f278cfe admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:48.008339 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd852824-8594-4028-a5a3-a3637f278cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:48.008650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd852824-8594-4028-a5a3-a3637f278cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:48.017458 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd852824-8594-4028-a5a3-a3637f278cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:48.047378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd852824-8594-4028-a5a3-a3637f278cfe admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:48.191808 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 891/1791] 10.222.0.73 () {58 vars in 1015 bytes} [Wed Aug 3 12:59:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:48.199618 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df13c6-5c5b-44a8-9e09-7c88dcddc862 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:48.205942 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-17df13c6-5c5b-44a8-9e09-7c88dcddc862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:48.240511 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 901/1792] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:47 2022] POST /identity/v3/projects => generated 393 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:48.242338 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd852824-8594-4028-a5a3-a3637f278cfe admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:48.247637 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df13c6-5c5b-44a8-9e09-7c88dcddc862 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:48.262974 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:48.370438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e70ca5-a4a5-463d-8455-f41a59cffec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:48.370648 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e70ca5-a4a5-463d-8455-f41a59cffec3 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:48.370852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e70ca5-a4a5-463d-8455-f41a59cffec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:48.371186 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e70ca5-a4a5-463d-8455-f41a59cffec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:48.379682 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:48.400672 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd852824-8594-4028-a5a3-a3637f278cfe admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:48.409551 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593c052-4dce-4f3d-9417-9a3d36e5d76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:48.410640 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593c052-4dce-4f3d-9417-9a3d36e5d76d admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:48.411657 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593c052-4dce-4f3d-9417-9a3d36e5d76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:48.411657 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593c052-4dce-4f3d-9417-9a3d36e5d76d admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:48.413108 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593c052-4dce-4f3d-9417-9a3d36e5d76d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:48.417648 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593c052-4dce-4f3d-9417-9a3d36e5d76d admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:48.512273 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e70ca5-a4a5-463d-8455-f41a59cffec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:48.514339 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e70ca5-a4a5-463d-8455-f41a59cffec3 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:48.522887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 902/1793] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:48 2022] POST /identity/v3/users => generated 303 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:48.527361 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593c052-4dce-4f3d-9417-9a3d36e5d76d admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:48.548477 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593c052-4dce-4f3d-9417-9a3d36e5d76d admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:48.551710 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 892/1794] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:48.553455 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e70ca5-a4a5-463d-8455-f41a59cffec3 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:48.559302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559ac85-b269-483f-a874-9505e5f4c38c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:48.560118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559ac85-b269-483f-a874-9505e5f4c38c service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:48.560488 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559ac85-b269-483f-a874-9505e5f4c38c service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:48.561093 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559ac85-b269-483f-a874-9505e5f4c38c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:48.577458 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e70ca5-a4a5-463d-8455-f41a59cffec3 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:48.578641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559ac85-b269-483f-a874-9505e5f4c38c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:48.581605 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559ac85-b269-483f-a874-9505e5f4c38c service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:48.591055 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ad807-3f61-47a8-a265-298ca7069071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:48.592074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ad807-3f61-47a8-a265-298ca7069071 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:48.592802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ad807-3f61-47a8-a265-298ca7069071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:48.593180 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ad807-3f61-47a8-a265-298ca7069071 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:48.595285 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ad807-3f61-47a8-a265-298ca7069071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:48.599356 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ad807-3f61-47a8-a265-298ca7069071 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:48.602127 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 903/1795] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:48.604063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559ac85-b269-483f-a874-9505e5f4c38c service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:48.608042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e559ac85-b269-483f-a874-9505e5f4c38c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:48.627138 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 893/1796] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:48.629877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ad807-3f61-47a8-a265-298ca7069071 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:48.643302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559ac85-b269-483f-a874-9505e5f4c38c service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:48.651543 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ad807-3f61-47a8-a265-298ca7069071 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:48.654388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a72a94-8e1f-4d10-a80c-22ec17cfec30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:48.655601 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a72a94-8e1f-4d10-a80c-22ec17cfec30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:48.656332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a72a94-8e1f-4d10-a80c-22ec17cfec30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:48.657460 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a72a94-8e1f-4d10-a80c-22ec17cfec30 admin admin] PATH_INFO: `/v3/users/dfa906552edc4ec9b76a1e60c3507525` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:48.661425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a72a94-8e1f-4d10-a80c-22ec17cfec30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa906552edc4ec9b76a1e60c3507525)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:48.663653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26aae26-af81-4f63-897c-4283273b408b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:48.665074 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a72a94-8e1f-4d10-a80c-22ec17cfec30 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:48.671334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aae26-af81-4f63-897c-4283273b408b admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:48.671334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aae26-af81-4f63-897c-4283273b408b admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:48.671334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aae26-af81-4f63-897c-4283273b408b admin admin] PATH_INFO: `/v3/projects/679d8d86b83d4cbca663deb776ee255b/users/a6bb4058b37846beb0fd7499a1b04ece/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:48.722029 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26aae26-af81-4f63-897c-4283273b408b admin admin] RBAC: Authorizing `identity:create_grant(project_id=679d8d86b83d4cbca663deb776ee255b, user_id=a6bb4058b37846beb0fd7499a1b04ece, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:48.730045 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26aae26-af81-4f63-897c-4283273b408b admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:48.971346 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 894/1797] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:48 2022] PUT /identity/v3/projects/679d8d86b83d4cbca663deb776ee255b/users/a6bb4058b37846beb0fd7499a1b04ece/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:48.972950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26aae26-af81-4f63-897c-4283273b408b admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:49.162069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26aae26-af81-4f63-897c-4283273b408b admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:49.169166 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cfbee-9c89-407e-a479-e8f646e311f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:49.170505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cfbee-9c89-407e-a479-e8f646e311f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:49.170953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cfbee-9c89-407e-a479-e8f646e311f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:49.171340 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cfbee-9c89-407e-a479-e8f646e311f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:49.172224 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cfbee-9c89-407e-a479-e8f646e311f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:49.174259 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cfbee-9c89-407e-a479-e8f646e311f4 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:49.209155 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 895/1798] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:49.219722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-42a72a94-8e1f-4d10-a80c-22ec17cfec30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa906552edc4ec9b76a1e60c3507525'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:49.225343 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cfbee-9c89-407e-a479-e8f646e311f4 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:49.231019 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-42a72a94-8e1f-4d10-a80c-22ec17cfec30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa906552edc4ec9b76a1e60c3507525'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:49.231842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-42a72a94-8e1f-4d10-a80c-22ec17cfec30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa906552edc4ec9b76a1e60c3507525'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:49.252020 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cfbee-9c89-407e-a479-e8f646e311f4 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:49.282511 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fada9-4521-42bd-b10d-7ee4c7738a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:49.283458 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fada9-4521-42bd-b10d-7ee4c7738a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:49.283911 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fada9-4521-42bd-b10d-7ee4c7738a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:49.284375 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fada9-4521-42bd-b10d-7ee4c7738a88 admin admin] PATH_INFO: `/v3/projects/679d8d86b83d4cbca663deb776ee255b/users/a6bb4058b37846beb0fd7499a1b04ece/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:49.289099 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-42a72a94-8e1f-4d10-a80c-22ec17cfec30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa906552edc4ec9b76a1e60c3507525'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:49.290251 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-42a72a94-8e1f-4d10-a80c-22ec17cfec30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa906552edc4ec9b76a1e60c3507525'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:49.294670 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fada9-4521-42bd-b10d-7ee4c7738a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=679d8d86b83d4cbca663deb776ee255b, user_id=a6bb4058b37846beb0fd7499a1b04ece, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:49.298791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fada9-4521-42bd-b10d-7ee4c7738a88 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:49.336635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 896/1799] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:49 2022] PUT /identity/v3/projects/679d8d86b83d4cbca663deb776ee255b/users/a6bb4058b37846beb0fd7499a1b04ece/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:49.347269 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720a705-9154-4719-ba4d-b6f5ea5c4a30 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:49.348078 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720a705-9154-4719-ba4d-b6f5ea5c4a30 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:49.348664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720a705-9154-4719-ba4d-b6f5ea5c4a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:49.435465 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 904/1800] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 12:59:48 2022] DELETE /identity/v3/users/dfa906552edc4ec9b76a1e60c3507525 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:49.440730 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fe5a7-a30e-4fc0-b05b-17a56d61b1a4 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:49.441148 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-9720a705-9154-4719-ba4d-b6f5ea5c4a30 None None] MFA Rules not processed for user `a6bb4058b37846beb0fd7499a1b04ece`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:49.441453 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fe5a7-a30e-4fc0-b05b-17a56d61b1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:49.444777 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fe5a7-a30e-4fc0-b05b-17a56d61b1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:49.447131 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-9720a705-9154-4719-ba4d-b6f5ea5c4a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:49.492107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-ec2fe5a7-a30e-4fc0-b05b-17a56d61b1a4 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:49.493748 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ec2fe5a7-a30e-4fc0-b05b-17a56d61b1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:49.581382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 897/1801] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:49 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:49.594833 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720a705-9154-4719-ba4d-b6f5ea5c4a30 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:49.620631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-9720a705-9154-4719-ba4d-b6f5ea5c4a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:49.625414 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 905/1802] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:59:49.706886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fe5a7-a30e-4fc0-b05b-17a56d61b1a4 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:49.709447 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ec2fe5a7-a30e-4fc0-b05b-17a56d61b1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:49.755545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720a705-9154-4719-ba4d-b6f5ea5c4a30 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:49.760064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93a487-5662-43f9-a87a-8b72acdc021a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:49.773201 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93a487-5662-43f9-a87a-8b72acdc021a service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:49.773615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93a487-5662-43f9-a87a-8b72acdc021a service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:49.774219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93a487-5662-43f9-a87a-8b72acdc021a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:49.788670 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93a487-5662-43f9-a87a-8b72acdc021a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:49.790278 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93a487-5662-43f9-a87a-8b72acdc021a service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:49.825820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 898/1803] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:49 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:49.834085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:49.863292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fe5a7-a30e-4fc0-b05b-17a56d61b1a4 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:49.886863 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e2795-e5ce-4c67-b78e-4e39b9bf3844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:49.886863 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e2795-e5ce-4c67-b78e-4e39b9bf3844 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:49.886863 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e2795-e5ce-4c67-b78e-4e39b9bf3844 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:49.886863 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e2795-e5ce-4c67-b78e-4e39b9bf3844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:49.909874 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:49.913661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e2795-e5ce-4c67-b78e-4e39b9bf3844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:49.915351 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e2795-e5ce-4c67-b78e-4e39b9bf3844 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:49.923417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93a487-5662-43f9-a87a-8b72acdc021a service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:49.925222 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-6a93a487-5662-43f9-a87a-8b72acdc021a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:49.938861 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 906/1804] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:49.959061 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93a487-5662-43f9-a87a-8b72acdc021a service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:49.963276 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e858d-f5dc-4e5b-9d3c-9b8c8e7b2d98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:49.964091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e858d-f5dc-4e5b-9d3c-9b8c8e7b2d98 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:49.964524 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e858d-f5dc-4e5b-9d3c-9b8c8e7b2d98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:49.965193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e858d-f5dc-4e5b-9d3c-9b8c8e7b2d98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:49.970072 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-f40e858d-f5dc-4e5b-9d3c-9b8c8e7b2d98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:50.095663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e858d-f5dc-4e5b-9d3c-9b8c8e7b2d98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:50.097375 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e858d-f5dc-4e5b-9d3c-9b8c8e7b2d98 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:50.148562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 899/1805] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:49 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:59:50.178872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b479192-6ec1-49a2-ab7c-e1b18e4dea76 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:50.179093 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b479192-6ec1-49a2-ab7c-e1b18e4dea76 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:50.179375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b479192-6ec1-49a2-ab7c-e1b18e4dea76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:50.241023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-8b479192-6ec1-49a2-ab7c-e1b18e4dea76 None None] MFA Rules not processed for user `36693fa42a7b41279c8d8c59ecafb243`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:50.244296 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-8b479192-6ec1-49a2-ab7c-e1b18e4dea76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:50.403217 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 907/1806] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:51.193897 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:51.422198 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e858d-f5dc-4e5b-9d3c-9b8c8e7b2d98 service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:51.422198 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-f40e858d-f5dc-4e5b-9d3c-9b8c8e7b2d98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:51.459785 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e858d-f5dc-4e5b-9d3c-9b8c8e7b2d98 service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:51.487246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3cab6-3a07-4730-ba58-d16e963827c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:51.487246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3cab6-3a07-4730-ba58-d16e963827c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:51.487246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3cab6-3a07-4730-ba58-d16e963827c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:51.500371 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3cab6-3a07-4730-ba58-d16e963827c4 admin admin] PATH_INFO: `/v3/projects/6a17c8782e87497bb467e35a52946c46` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:51.506722 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3cab6-3a07-4730-ba58-d16e963827c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a17c8782e87497bb467e35a52946c46)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:51.541837 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3cab6-3a07-4730-ba58-d16e963827c4 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:51.593827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:51.815886 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-54b3cab6-3a07-4730-ba58-d16e963827c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a17c8782e87497bb467e35a52946c46', 'request_id': 'req-54b3cab6-3a07-4730-ba58-d16e963827c4'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:51.832713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-54b3cab6-3a07-4730-ba58-d16e963827c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a17c8782e87497bb467e35a52946c46', 'request_id': 'req-54b3cab6-3a07-4730-ba58-d16e963827c4'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:51.928150 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-54b3cab6-3a07-4730-ba58-d16e963827c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a17c8782e87497bb467e35a52946c46', 'request_id': 'req-54b3cab6-3a07-4730-ba58-d16e963827c4'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:51.944837 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-54b3cab6-3a07-4730-ba58-d16e963827c4 admin admin] The token cache is being invalidate because project 6a17c8782e87497bb467e35a52946c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:59:51.945194 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-54b3cab6-3a07-4730-ba58-d16e963827c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:51.947646 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-54b3cab6-3a07-4730-ba58-d16e963827c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:51.951076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 900/1807] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 12:59:51 2022] DELETE /identity/v3/projects/6a17c8782e87497bb467e35a52946c46 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:51.957944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b479192-6ec1-49a2-ab7c-e1b18e4dea76 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:51.979808 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b94c9c-4c63-4ca8-87bd-33ef5addfbd9 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:51.980402 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b94c9c-4c63-4ca8-87bd-33ef5addfbd9 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:51.980692 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b94c9c-4c63-4ca8-87bd-33ef5addfbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:51.982725 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b479192-6ec1-49a2-ab7c-e1b18e4dea76 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:52.047014 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-f2b94c9c-4c63-4ca8-87bd-33ef5addfbd9 None None] MFA Rules not processed for user `04bed65114d7482ab626a13f29afddfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:52.075067 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-f2b94c9c-4c63-4ca8-87bd-33ef5addfbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:52.104329 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ab854-89d5-41a7-b660-184835bea598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:52.105105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ab854-89d5-41a7-b660-184835bea598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:52.105391 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ab854-89d5-41a7-b660-184835bea598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:52.105900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ab854-89d5-41a7-b660-184835bea598 admin admin] PATH_INFO: `/v3/users/beaf39b7f7d249fc8a78ad634fbc9e0b` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:52.107548 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ab854-89d5-41a7-b660-184835bea598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beaf39b7f7d249fc8a78ad634fbc9e0b)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:52.110118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ab854-89d5-41a7-b660-184835bea598 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:52.165059 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:52.296454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 901/1808] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:52.316887 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b94c9c-4c63-4ca8-87bd-33ef5addfbd9 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:52.324676 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-f2b94c9c-4c63-4ca8-87bd-33ef5addfbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:52.327945 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-614ab854-89d5-41a7-b660-184835bea598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beaf39b7f7d249fc8a78ad634fbc9e0b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:52.345226 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-614ab854-89d5-41a7-b660-184835bea598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beaf39b7f7d249fc8a78ad634fbc9e0b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:52.345226 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-614ab854-89d5-41a7-b660-184835bea598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beaf39b7f7d249fc8a78ad634fbc9e0b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:52.373459 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-614ab854-89d5-41a7-b660-184835bea598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beaf39b7f7d249fc8a78ad634fbc9e0b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:52.374334 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-614ab854-89d5-41a7-b660-184835bea598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beaf39b7f7d249fc8a78ad634fbc9e0b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:52.475182 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 908/1809] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 12:59:51 2022] DELETE /identity/v3/users/beaf39b7f7d249fc8a78ad634fbc9e0b => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:52.525372 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b94c9c-4c63-4ca8-87bd-33ef5addfbd9 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:52.594072 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e57b5d-cd3e-470a-bbe4-1de2265db105 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:52.594524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e57b5d-cd3e-470a-bbe4-1de2265db105 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:52.595057 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e57b5d-cd3e-470a-bbe4-1de2265db105 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:52.597076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 909/1810] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 3 12:59:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:59:52.605306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f8360-51f9-4aee-a458-c3a506e2d063 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:52.605703 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f8360-51f9-4aee-a458-c3a506e2d063 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:52.606182 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f8360-51f9-4aee-a458-c3a506e2d063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:52.674305 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-146f8360-51f9-4aee-a458-c3a506e2d063 None None] MFA Rules not processed for user `bc939818c9224b0ebe2dbaa1eaaec5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:52.676621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-146f8360-51f9-4aee-a458-c3a506e2d063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:52.679168 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf62f8-6b6c-46e8-bfb1-dea0e050a479 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:52.683504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf62f8-6b6c-46e8-bfb1-dea0e050a479 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:52.687153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf62f8-6b6c-46e8-bfb1-dea0e050a479 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:52.687963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf62f8-6b6c-46e8-bfb1-dea0e050a479 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:52.694799 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-becf62f8-6b6c-46e8-bfb1-dea0e050a479 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:52.958480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf62f8-6b6c-46e8-bfb1-dea0e050a479 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:52.963021 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf62f8-6b6c-46e8-bfb1-dea0e050a479 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:52.980123 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 910/1811] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 3 12:59:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:59:52.981012 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f8360-51f9-4aee-a458-c3a506e2d063 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:52.987790 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-146f8360-51f9-4aee-a458-c3a506e2d063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:52.992532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 902/1812] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 676 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:59:53.119351 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f8360-51f9-4aee-a458-c3a506e2d063 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:53.128081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1b47a-4d60-4689-96df-3bc2a1c1ab28 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:53.128773 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1b47a-4d60-4689-96df-3bc2a1c1ab28 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:53.129737 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1b47a-4d60-4689-96df-3bc2a1c1ab28 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:53.132525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 903/1813] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 3 12:59:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:59:53.139852 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fbde9-1387-4edf-a136-5422c81852bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:53.140807 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fbde9-1387-4edf-a136-5422c81852bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:53.141246 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fbde9-1387-4edf-a136-5422c81852bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:53.141532 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fbde9-1387-4edf-a136-5422c81852bb admin admin] PATH_INFO: `/v3/projects/8caa8f97e1214e42b960e5456c1ef372` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:53.145006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fbde9-1387-4edf-a136-5422c81852bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8caa8f97e1214e42b960e5456c1ef372)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:53.146985 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fbde9-1387-4edf-a136-5422c81852bb admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:53.231322 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9094e-217a-4d69-8fee-d56c7a31b2b9 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:53.231785 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9094e-217a-4d69-8fee-d56c7a31b2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:53.232122 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9094e-217a-4d69-8fee-d56c7a31b2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:53.277746 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b82fbde9-1387-4edf-a136-5422c81852bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8caa8f97e1214e42b960e5456c1ef372', 'request_id': 'req-b82fbde9-1387-4edf-a136-5422c81852bb'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:53.284261 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-3ea9094e-217a-4d69-8fee-d56c7a31b2b9 None None] MFA Rules not processed for user `bc939818c9224b0ebe2dbaa1eaaec5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:53.286800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3ea9094e-217a-4d69-8fee-d56c7a31b2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:53.299894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b82fbde9-1387-4edf-a136-5422c81852bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8caa8f97e1214e42b960e5456c1ef372', 'request_id': 'req-b82fbde9-1387-4edf-a136-5422c81852bb'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:53.398676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b82fbde9-1387-4edf-a136-5422c81852bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8caa8f97e1214e42b960e5456c1ef372', 'request_id': 'req-b82fbde9-1387-4edf-a136-5422c81852bb'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:53.420458 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b82fbde9-1387-4edf-a136-5422c81852bb admin admin] The token cache is being invalidate because project 8caa8f97e1214e42b960e5456c1ef372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:59:53.420822 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b82fbde9-1387-4edf-a136-5422c81852bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:53.422825 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b82fbde9-1387-4edf-a136-5422c81852bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:53.429930 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 911/1814] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 12:59:52 2022] DELETE /identity/v3/projects/8caa8f97e1214e42b960e5456c1ef372 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:53.431479 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fbde9-1387-4edf-a136-5422c81852bb admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:53.436793 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b82fbde9-1387-4edf-a136-5422c81852bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:53.443856 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 904/1815] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 3 12:59:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:53.635624 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fbde9-1387-4edf-a136-5422c81852bb admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:53.641831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fddfb1-1549-4a2c-87ae-e0e8d1dbb2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:53.642881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fddfb1-1549-4a2c-87ae-e0e8d1dbb2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:53.643328 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fddfb1-1549-4a2c-87ae-e0e8d1dbb2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:53.643716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fddfb1-1549-4a2c-87ae-e0e8d1dbb2ef admin admin] PATH_INFO: `/v3/users/e8736391b53040cbbbd8bfeb7101d03f` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:53.645239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fddfb1-1549-4a2c-87ae-e0e8d1dbb2ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8736391b53040cbbbd8bfeb7101d03f)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:53.648859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fddfb1-1549-4a2c-87ae-e0e8d1dbb2ef admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:53.897565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c5fddfb1-1549-4a2c-87ae-e0e8d1dbb2ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8736391b53040cbbbd8bfeb7101d03f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:53.908276 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c5fddfb1-1549-4a2c-87ae-e0e8d1dbb2ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8736391b53040cbbbd8bfeb7101d03f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:53.909089 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c5fddfb1-1549-4a2c-87ae-e0e8d1dbb2ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8736391b53040cbbbd8bfeb7101d03f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:53.936323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c5fddfb1-1549-4a2c-87ae-e0e8d1dbb2ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8736391b53040cbbbd8bfeb7101d03f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:53.936323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c5fddfb1-1549-4a2c-87ae-e0e8d1dbb2ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8736391b53040cbbbd8bfeb7101d03f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:54.033609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 912/1816] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 12:59:53 2022] DELETE /identity/v3/users/e8736391b53040cbbbd8bfeb7101d03f => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:54.253348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9094e-217a-4d69-8fee-d56c7a31b2b9 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:54.256316 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3ea9094e-217a-4d69-8fee-d56c7a31b2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:54.281998 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9094e-217a-4d69-8fee-d56c7a31b2b9 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:54.367840 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:54.456615 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fddfb1-1549-4a2c-87ae-e0e8d1dbb2ef admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:54.459348 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-c5fddfb1-1549-4a2c-87ae-e0e8d1dbb2ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:54.535653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fa96c-8bcf-4532-a4ee-7255e5273157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:54.537951 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fa96c-8bcf-4532-a4ee-7255e5273157 service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:54.538313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fa96c-8bcf-4532-a4ee-7255e5273157 service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:54.538675 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fa96c-8bcf-4532-a4ee-7255e5273157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:54.545020 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e19fa96c-8bcf-4532-a4ee-7255e5273157 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:54.564525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fa96c-8bcf-4532-a4ee-7255e5273157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:54.566893 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fa96c-8bcf-4532-a4ee-7255e5273157 service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:54.580538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 905/1817] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:54.738002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fddfb1-1549-4a2c-87ae-e0e8d1dbb2ef admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:54.760315 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61753a0d-b07c-45b5-8aaa-728e649654e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:54.760315 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61753a0d-b07c-45b5-8aaa-728e649654e8 service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:54.760315 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61753a0d-b07c-45b5-8aaa-728e649654e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:54.760315 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61753a0d-b07c-45b5-8aaa-728e649654e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:54.763661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-61753a0d-b07c-45b5-8aaa-728e649654e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:54.806652 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61753a0d-b07c-45b5-8aaa-728e649654e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:54.810939 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61753a0d-b07c-45b5-8aaa-728e649654e8 service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:54.868911 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 913/1818] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:59:55.221676 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fa96c-8bcf-4532-a4ee-7255e5273157 service nova] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:55.225320 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e19fa96c-8bcf-4532-a4ee-7255e5273157 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:55.250497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:55.447634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fa96c-8bcf-4532-a4ee-7255e5273157 service nova] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:55.455985 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25c040-0d0a-48b4-9a98-91c4ff61581a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:55.456909 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25c040-0d0a-48b4-9a98-91c4ff61581a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:55.458345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25c040-0d0a-48b4-9a98-91c4ff61581a admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:55.459105 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25c040-0d0a-48b4-9a98-91c4ff61581a admin admin] PATH_INFO: `/v3/projects/65702f223b044444bc290b641435fa0b` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:55.460645 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25c040-0d0a-48b4-9a98-91c4ff61581a admin admin] RBAC: Authorizing `identity:delete_project(project_id=65702f223b044444bc290b641435fa0b)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:55.463183 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25c040-0d0a-48b4-9a98-91c4ff61581a admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:55.620187 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ea25c040-0d0a-48b4-9a98-91c4ff61581a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65702f223b044444bc290b641435fa0b', 'request_id': 'req-ea25c040-0d0a-48b4-9a98-91c4ff61581a'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:55.635040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ea25c040-0d0a-48b4-9a98-91c4ff61581a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65702f223b044444bc290b641435fa0b', 'request_id': 'req-ea25c040-0d0a-48b4-9a98-91c4ff61581a'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:55.764481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ea25c040-0d0a-48b4-9a98-91c4ff61581a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65702f223b044444bc290b641435fa0b', 'request_id': 'req-ea25c040-0d0a-48b4-9a98-91c4ff61581a'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:55.778254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ea25c040-0d0a-48b4-9a98-91c4ff61581a admin admin] The token cache is being invalidate because project 65702f223b044444bc290b641435fa0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:59:55.778549 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ea25c040-0d0a-48b4-9a98-91c4ff61581a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:55.779252 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ea25c040-0d0a-48b4-9a98-91c4ff61581a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:55.781193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 906/1819] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 12:59:55 2022] DELETE /identity/v3/projects/65702f223b044444bc290b641435fa0b => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:55.786350 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b5160-9a0a-4ee5-8bbc-79f53ddddd18 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:55.786647 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b5160-9a0a-4ee5-8bbc-79f53ddddd18 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:55.786972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b5160-9a0a-4ee5-8bbc-79f53ddddd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:55.807479 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-2f9b5160-9a0a-4ee5-8bbc-79f53ddddd18 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:55.808714 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-2f9b5160-9a0a-4ee5-8bbc-79f53ddddd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:55.875534 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25c040-0d0a-48b4-9a98-91c4ff61581a admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:55.877470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-ea25c040-0d0a-48b4-9a98-91c4ff61581a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:55.906774 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 914/1820] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:55.915862 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29693789-48ff-4ce8-b8cd-e71829f3bc88 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:55.916402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29693789-48ff-4ce8-b8cd-e71829f3bc88 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:55.916700 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29693789-48ff-4ce8-b8cd-e71829f3bc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:55.940564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-29693789-48ff-4ce8-b8cd-e71829f3bc88 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:55.942094 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-29693789-48ff-4ce8-b8cd-e71829f3bc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:55.954440 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 915/1821] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:59:55.955579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29693789-48ff-4ce8-b8cd-e71829f3bc88 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:55.966245 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29693789-48ff-4ce8-b8cd-e71829f3bc88 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:55.972183 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0b088-b381-41eb-9a29-539e79c5a440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:55.972825 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0b088-b381-41eb-9a29-539e79c5a440 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:55.973112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0b088-b381-41eb-9a29-539e79c5a440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:55.973395 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0b088-b381-41eb-9a29-539e79c5a440 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:55.974106 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0b088-b381-41eb-9a29-539e79c5a440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:59:55.974416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0b088-b381-41eb-9a29-539e79c5a440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:55.975926 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25c040-0d0a-48b4-9a98-91c4ff61581a admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:55.976094 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0b088-b381-41eb-9a29-539e79c5a440 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:55.985614 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac21131-f053-4ab7-accf-0bc3394e8da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:55.988814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac21131-f053-4ab7-accf-0bc3394e8da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:55.988814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac21131-f053-4ab7-accf-0bc3394e8da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:55.988814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac21131-f053-4ab7-accf-0bc3394e8da5 admin admin] PATH_INFO: `/v3/projects/dcb0fd72c74b4dbe986ffc21e8f1425d` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:55.989756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac21131-f053-4ab7-accf-0bc3394e8da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb0fd72c74b4dbe986ffc21e8f1425d)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:55.991743 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac21131-f053-4ab7-accf-0bc3394e8da5 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:55.994169 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 916/1822] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 12:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:59:55.998177 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0b088-b381-41eb-9a29-539e79c5a440 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:56.012899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0b088-b381-41eb-9a29-539e79c5a440 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:56.018095 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782b65a-dac9-418b-be50-bb7c58c5a750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:56.018842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782b65a-dac9-418b-be50-bb7c58c5a750 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:56.019059 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782b65a-dac9-418b-be50-bb7c58c5a750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:56.019296 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782b65a-dac9-418b-be50-bb7c58c5a750 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:56.019975 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782b65a-dac9-418b-be50-bb7c58c5a750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:56.022205 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782b65a-dac9-418b-be50-bb7c58c5a750 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:56.157697 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-fac21131-f053-4ab7-accf-0bc3394e8da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb0fd72c74b4dbe986ffc21e8f1425d', 'request_id': 'req-fac21131-f053-4ab7-accf-0bc3394e8da5'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:56.165435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-fac21131-f053-4ab7-accf-0bc3394e8da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb0fd72c74b4dbe986ffc21e8f1425d', 'request_id': 'req-fac21131-f053-4ab7-accf-0bc3394e8da5'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:56.209687 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 917/1823] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:55 2022] POST /identity/v3/projects => generated 379 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:59:56.210818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782b65a-dac9-418b-be50-bb7c58c5a750 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:56.257577 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-fac21131-f053-4ab7-accf-0bc3394e8da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb0fd72c74b4dbe986ffc21e8f1425d', 'request_id': 'req-fac21131-f053-4ab7-accf-0bc3394e8da5'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:56.272340 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-fac21131-f053-4ab7-accf-0bc3394e8da5 admin admin] The token cache is being invalidate because project dcb0fd72c74b4dbe986ffc21e8f1425d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:59:56.273046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-fac21131-f053-4ab7-accf-0bc3394e8da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:56.274649 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-fac21131-f053-4ab7-accf-0bc3394e8da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:56.277203 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 907/1824] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 12:59:55 2022] DELETE /identity/v3/projects/dcb0fd72c74b4dbe986ffc21e8f1425d => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:59:56.278441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac21131-f053-4ab7-accf-0bc3394e8da5 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:56.280735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-fac21131-f053-4ab7-accf-0bc3394e8da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:56.314080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782b65a-dac9-418b-be50-bb7c58c5a750 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:56.321505 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7035e0-4c97-4ffe-a695-4bb0cac32c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:56.322349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7035e0-4c97-4ffe-a695-4bb0cac32c16 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:56.327153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7035e0-4c97-4ffe-a695-4bb0cac32c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:56.327447 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7035e0-4c97-4ffe-a695-4bb0cac32c16 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:56.328168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7035e0-4c97-4ffe-a695-4bb0cac32c16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:56.330249 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7035e0-4c97-4ffe-a695-4bb0cac32c16 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:56.388507 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac21131-f053-4ab7-accf-0bc3394e8da5 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:56.438618 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 918/1825] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:56 2022] POST /identity/v3/users => generated 290 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:59:56.440110 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62540a3-7983-4331-994c-7ebc77f9cd27 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:56.440405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62540a3-7983-4331-994c-7ebc77f9cd27 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:56.440688 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62540a3-7983-4331-994c-7ebc77f9cd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:56.451677 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a86974-dd69-4f4e-ae8a-844a58bd21f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:56.454041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a86974-dd69-4f4e-ae8a-844a58bd21f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:56.454041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a86974-dd69-4f4e-ae8a-844a58bd21f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:56.454041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a86974-dd69-4f4e-ae8a-844a58bd21f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:56.465378 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-69a86974-dd69-4f4e-ae8a-844a58bd21f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:56.474835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-f62540a3-7983-4331-994c-7ebc77f9cd27 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:56.476157 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-f62540a3-7983-4331-994c-7ebc77f9cd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:56.498984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 919/1826] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:56.500017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62540a3-7983-4331-994c-7ebc77f9cd27 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:56.504590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-f62540a3-7983-4331-994c-7ebc77f9cd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:56.522726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62540a3-7983-4331-994c-7ebc77f9cd27 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:56.529060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e6437-d0c8-4146-a502-83650026b755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:56.529705 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e6437-d0c8-4146-a502-83650026b755 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:56.530105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e6437-d0c8-4146-a502-83650026b755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:56.530781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e6437-d0c8-4146-a502-83650026b755 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:56.532083 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e6437-d0c8-4146-a502-83650026b755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:56.534588 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e6437-d0c8-4146-a502-83650026b755 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:56.549001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 920/1827] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:56.550097 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de440a4c-1442-40c3-ac38-63182006646e None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:56.550394 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de440a4c-1442-40c3-ac38-63182006646e None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:56.550666 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de440a4c-1442-40c3-ac38-63182006646e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:56.572122 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a86974-dd69-4f4e-ae8a-844a58bd21f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:56.572815 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-de440a4c-1442-40c3-ac38-63182006646e None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:56.572957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a86974-dd69-4f4e-ae8a-844a58bd21f9 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:56.574045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-de440a4c-1442-40c3-ac38-63182006646e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:56.584776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 921/1828] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:56.584776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de440a4c-1442-40c3-ac38-63182006646e None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:56.594054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 908/1829] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:56.595402 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a86974-dd69-4f4e-ae8a-844a58bd21f9 service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:56.600947 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de440a4c-1442-40c3-ac38-63182006646e None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:56.604842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94151972-2e1d-4493-866c-a400e7a05744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:56.605512 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94151972-2e1d-4493-866c-a400e7a05744 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:56.605761 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94151972-2e1d-4493-866c-a400e7a05744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:56.606131 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94151972-2e1d-4493-866c-a400e7a05744 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:56.606865 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94151972-2e1d-4493-866c-a400e7a05744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:56.608477 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94151972-2e1d-4493-866c-a400e7a05744 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:56.610099 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a86974-dd69-4f4e-ae8a-844a58bd21f9 service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:56.617631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a6879-a1a6-46c8-be1a-2a5cdf610dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:56.619143 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a6879-a1a6-46c8-be1a-2a5cdf610dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:56.619735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a6879-a1a6-46c8-be1a-2a5cdf610dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:56.620217 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a6879-a1a6-46c8-be1a-2a5cdf610dd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:56.621220 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a6879-a1a6-46c8-be1a-2a5cdf610dd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:59:56.622275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a6879-a1a6-46c8-be1a-2a5cdf610dd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:56.624433 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a6879-a1a6-46c8-be1a-2a5cdf610dd1 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:56.627390 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 922/1830] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:56.631484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94151972-2e1d-4493-866c-a400e7a05744 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:56.647791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 909/1831] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 12:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:59:56.649077 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a6879-a1a6-46c8-be1a-2a5cdf610dd1 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:56.660458 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94151972-2e1d-4493-866c-a400e7a05744 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:56.667425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00438b33-0752-49a5-a971-d0975c58ca70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:56.668210 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00438b33-0752-49a5-a971-d0975c58ca70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:56.668618 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00438b33-0752-49a5-a971-d0975c58ca70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:56.668947 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00438b33-0752-49a5-a971-d0975c58ca70 admin admin] PATH_INFO: `/v3/projects/ae6d869c306d40afb41fabb0e1d7c1bc/users/1f1b37ac88024c368f14631817c5a144/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:56.675701 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a6879-a1a6-46c8-be1a-2a5cdf610dd1 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:56.689621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f4c17-fcab-4634-b6c2-2d257167d38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:56.692271 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f4c17-fcab-4634-b6c2-2d257167d38e admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:56.693465 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f4c17-fcab-4634-b6c2-2d257167d38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:56.694608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f4c17-fcab-4634-b6c2-2d257167d38e admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:56.695512 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f4c17-fcab-4634-b6c2-2d257167d38e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:56.699884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00438b33-0752-49a5-a971-d0975c58ca70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6d869c306d40afb41fabb0e1d7c1bc, user_id=1f1b37ac88024c368f14631817c5a144, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:56.702357 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00438b33-0752-49a5-a971-d0975c58ca70 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:56.705188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f4c17-fcab-4634-b6c2-2d257167d38e admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:56.795461 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 923/1832] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:56 2022] PUT /identity/v3/projects/ae6d869c306d40afb41fabb0e1d7c1bc/users/1f1b37ac88024c368f14631817c5a144/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:59:56.811277 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5a96f-097b-4ce6-9bc2-3564a7044934 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:56.813184 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5a96f-097b-4ce6-9bc2-3564a7044934 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:56.815503 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5a96f-097b-4ce6-9bc2-3564a7044934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:56.844405 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 910/1833] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:56 2022] POST /identity/v3/projects => generated 367 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:56.846592 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f4c17-fcab-4634-b6c2-2d257167d38e admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:56.871505 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-79e5a96f-097b-4ce6-9bc2-3564a7044934 None None] MFA Rules not processed for user `1f1b37ac88024c368f14631817c5a144`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:56.872393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-79e5a96f-097b-4ce6-9bc2-3564a7044934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:56.957069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f4c17-fcab-4634-b6c2-2d257167d38e admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:56.983885 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113bd52-5a52-47f8-8881-62f3480bbdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:56.988236 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113bd52-5a52-47f8-8881-62f3480bbdca admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:56.988236 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113bd52-5a52-47f8-8881-62f3480bbdca admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:56.988236 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113bd52-5a52-47f8-8881-62f3480bbdca admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:56.989813 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113bd52-5a52-47f8-8881-62f3480bbdca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:56.991926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 924/1834] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:56.998576 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5a96f-097b-4ce6-9bc2-3564a7044934 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:57.000395 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113bd52-5a52-47f8-8881-62f3480bbdca admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:57.014989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5a96f-097b-4ce6-9bc2-3564a7044934 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:57.020633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93bdb4-c0df-4cab-a9ce-ca5822c7ec36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:57.021376 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93bdb4-c0df-4cab-a9ce-ca5822c7ec36 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:57.021814 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93bdb4-c0df-4cab-a9ce-ca5822c7ec36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:57.022154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93bdb4-c0df-4cab-a9ce-ca5822c7ec36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:57.023076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93bdb4-c0df-4cab-a9ce-ca5822c7ec36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:57.026162 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93bdb4-c0df-4cab-a9ce-ca5822c7ec36 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:57.134369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 911/1835] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:56 2022] POST /identity/v3/users => generated 284 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:57.136481 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 925/1836] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:56 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:57.138404 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113bd52-5a52-47f8-8881-62f3480bbdca admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:57.140330 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93bdb4-c0df-4cab-a9ce-ca5822c7ec36 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:57.162375 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113bd52-5a52-47f8-8881-62f3480bbdca admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:57.246511 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93bdb4-c0df-4cab-a9ce-ca5822c7ec36 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:57.277123 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:57.280536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384792b-da00-4155-a7d9-a278ea7d2d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:57.281352 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384792b-da00-4155-a7d9-a278ea7d2d37 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:57.281758 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384792b-da00-4155-a7d9-a278ea7d2d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:57.282049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384792b-da00-4155-a7d9-a278ea7d2d37 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:57.283369 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384792b-da00-4155-a7d9-a278ea7d2d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:57.299888 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384792b-da00-4155-a7d9-a278ea7d2d37 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:57.311545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96ed5f-1671-40a5-82e5-d0996e404b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:57.312942 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96ed5f-1671-40a5-82e5-d0996e404b42 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:57.313426 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96ed5f-1671-40a5-82e5-d0996e404b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:57.314050 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96ed5f-1671-40a5-82e5-d0996e404b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:57.315121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96ed5f-1671-40a5-82e5-d0996e404b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:57.317616 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96ed5f-1671-40a5-82e5-d0996e404b42 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:57.337184 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 912/1837] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:57.337184 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96ed5f-1671-40a5-82e5-d0996e404b42 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:57.362081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96ed5f-1671-40a5-82e5-d0996e404b42 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:57.377978 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f21818-420d-4fa3-b4dd-aa0f21d5ba4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:57.378685 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f21818-420d-4fa3-b4dd-aa0f21d5ba4e admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:57.379441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f21818-420d-4fa3-b4dd-aa0f21d5ba4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:57.379441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f21818-420d-4fa3-b4dd-aa0f21d5ba4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:57.379977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f21818-420d-4fa3-b4dd-aa0f21d5ba4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:57.381623 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f21818-420d-4fa3-b4dd-aa0f21d5ba4e admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:57.403763 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 913/1838] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:59:57.408361 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f21818-420d-4fa3-b4dd-aa0f21d5ba4e admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:57.422032 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 926/1839] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:57 2022] POST /identity/v3/users => generated 297 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:57.426999 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384792b-da00-4155-a7d9-a278ea7d2d37 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:57.447502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384792b-da00-4155-a7d9-a278ea7d2d37 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:57.455168 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f21818-420d-4fa3-b4dd-aa0f21d5ba4e admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:57.460298 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61002fd-a8f6-45d1-8434-7c38bebfadfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:57.460298 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61002fd-a8f6-45d1-8434-7c38bebfadfc admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:57.460630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61002fd-a8f6-45d1-8434-7c38bebfadfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:57.460916 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61002fd-a8f6-45d1-8434-7c38bebfadfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:57.461692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61002fd-a8f6-45d1-8434-7c38bebfadfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:57.463400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61002fd-a8f6-45d1-8434-7c38bebfadfc admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:57.472217 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718938a-c9b4-49d5-8db1-ef966da65c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:57.476083 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718938a-c9b4-49d5-8db1-ef966da65c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:57.476686 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718938a-c9b4-49d5-8db1-ef966da65c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:57.477162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718938a-c9b4-49d5-8db1-ef966da65c08 admin admin] PATH_INFO: `/v3/projects/2684870728a24d958a5440b078f87afe/users/5261452366204e5cbfa09ba94a456302/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:57.488497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 927/1840] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:59:57.495850 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61002fd-a8f6-45d1-8434-7c38bebfadfc admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:57.504633 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:57.512064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718938a-c9b4-49d5-8db1-ef966da65c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2684870728a24d958a5440b078f87afe, user_id=5261452366204e5cbfa09ba94a456302, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:57.514916 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61002fd-a8f6-45d1-8434-7c38bebfadfc admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:57.515888 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718938a-c9b4-49d5-8db1-ef966da65c08 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:57.531949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f8673-43b6-46b7-8667-2437b5319829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:57.532951 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f8673-43b6-46b7-8667-2437b5319829 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:57.533238 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f8673-43b6-46b7-8667-2437b5319829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:57.533529 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f8673-43b6-46b7-8667-2437b5319829 admin admin] PATH_INFO: `/v3/projects/6e6d18656c3b432d84c634005bbf2f6d/users/2f27c99730764f76b464ca6d2a1c74e9/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:57.570155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f8673-43b6-46b7-8667-2437b5319829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e6d18656c3b432d84c634005bbf2f6d, user_id=2f27c99730764f76b464ca6d2a1c74e9, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:57.597567 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f8673-43b6-46b7-8667-2437b5319829 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:57.667813 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 914/1841] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:57 2022] PUT /identity/v3/projects/2684870728a24d958a5440b078f87afe/users/5261452366204e5cbfa09ba94a456302/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:57.681574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c481b-2384-462c-a65b-5156ac337528 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:57.681574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c481b-2384-462c-a65b-5156ac337528 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:57.681574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c481b-2384-462c-a65b-5156ac337528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:57.770833 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-5c8c481b-2384-462c-a65b-5156ac337528 None None] MFA Rules not processed for user `5261452366204e5cbfa09ba94a456302`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:57.772500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-5c8c481b-2384-462c-a65b-5156ac337528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:57.857824 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 928/1842] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:57 2022] PUT /identity/v3/projects/6e6d18656c3b432d84c634005bbf2f6d/users/2f27c99730764f76b464ca6d2a1c74e9/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:57.862511 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f8673-43b6-46b7-8667-2437b5319829 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:57.867021 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 915/1843] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:57.873056 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c481b-2384-462c-a65b-5156ac337528 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:58.004061 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c481b-2384-462c-a65b-5156ac337528 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:58.043793 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f8673-43b6-46b7-8667-2437b5319829 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:58.060172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142f4a6-116e-4d9c-9562-57b850295a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:58.060841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142f4a6-116e-4d9c-9562-57b850295a84 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:58.061260 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142f4a6-116e-4d9c-9562-57b850295a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:58.061603 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142f4a6-116e-4d9c-9562-57b850295a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:58.062380 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142f4a6-116e-4d9c-9562-57b850295a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:58.064444 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142f4a6-116e-4d9c-9562-57b850295a84 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:58.094147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 929/1844] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:58.095684 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142f4a6-116e-4d9c-9562-57b850295a84 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:58.154688 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142f4a6-116e-4d9c-9562-57b850295a84 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:58.170010 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946af92f-0dcd-4a88-bd28-a375b9f393cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:58.170723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946af92f-0dcd-4a88-bd28-a375b9f393cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:58.175470 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946af92f-0dcd-4a88-bd28-a375b9f393cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:58.175470 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946af92f-0dcd-4a88-bd28-a375b9f393cb admin admin] PATH_INFO: `/v3/projects/6e6d18656c3b432d84c634005bbf2f6d/users/2f27c99730764f76b464ca6d2a1c74e9/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:58.178492 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946af92f-0dcd-4a88-bd28-a375b9f393cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e6d18656c3b432d84c634005bbf2f6d, user_id=2f27c99730764f76b464ca6d2a1c74e9, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:58.183900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946af92f-0dcd-4a88-bd28-a375b9f393cb admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:58.189944 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c686663-f967-49c3-bb33-f768a1ae81e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:58.191810 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c686663-f967-49c3-bb33-f768a1ae81e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:58.196830 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c686663-f967-49c3-bb33-f768a1ae81e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:58.197163 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c686663-f967-49c3-bb33-f768a1ae81e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:58.197898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c686663-f967-49c3-bb33-f768a1ae81e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:58.204164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c686663-f967-49c3-bb33-f768a1ae81e1 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:58.238667 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 930/1845] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:58 2022] PUT /identity/v3/projects/6e6d18656c3b432d84c634005bbf2f6d/users/2f27c99730764f76b464ca6d2a1c74e9/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:58.240742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946af92f-0dcd-4a88-bd28-a375b9f393cb admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:58.244300 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-946af92f-0dcd-4a88-bd28-a375b9f393cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:58.355662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 916/1846] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 12:59:57 2022] POST /identity/v3/projects => generated 365 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:58.357403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735796f-6181-48ff-b2fc-9171d59da3cb None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:58.357699 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735796f-6181-48ff-b2fc-9171d59da3cb None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:58.357990 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735796f-6181-48ff-b2fc-9171d59da3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:58.419383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946af92f-0dcd-4a88-bd28-a375b9f393cb admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:58.434187 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-0735796f-6181-48ff-b2fc-9171d59da3cb None None] MFA Rules not processed for user `2f27c99730764f76b464ca6d2a1c74e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:58.435546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-0735796f-6181-48ff-b2fc-9171d59da3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:58.525444 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bed039-5eab-4106-ad9c-75d263723335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:58.526284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bed039-5eab-4106-ad9c-75d263723335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:58.526600 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bed039-5eab-4106-ad9c-75d263723335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:58.527107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bed039-5eab-4106-ad9c-75d263723335 admin admin] PATH_INFO: `/v3/users/fa4455ac7c5547699e56725de9670531` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:58.528854 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bed039-5eab-4106-ad9c-75d263723335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4455ac7c5547699e56725de9670531)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:58.531093 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bed039-5eab-4106-ad9c-75d263723335 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:58.607923 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 917/1847] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:58.607923 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735796f-6181-48ff-b2fc-9171d59da3cb None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:58.622539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735796f-6181-48ff-b2fc-9171d59da3cb None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:58.628066 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d90796-bf79-4946-b488-136594da71c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:58.628711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d90796-bf79-4946-b488-136594da71c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:58.628999 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d90796-bf79-4946-b488-136594da71c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:58.629282 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d90796-bf79-4946-b488-136594da71c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:58.629966 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d90796-bf79-4946-b488-136594da71c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:58.637185 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d90796-bf79-4946-b488-136594da71c8 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:58.738506 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-55bed039-5eab-4106-ad9c-75d263723335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4455ac7c5547699e56725de9670531'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:58.747509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-55bed039-5eab-4106-ad9c-75d263723335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4455ac7c5547699e56725de9670531'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:58.748486 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-55bed039-5eab-4106-ad9c-75d263723335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4455ac7c5547699e56725de9670531'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:58.756993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:58.768833 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 918/1848] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 12:59:58 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:59:58.773671 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d90796-bf79-4946-b488-136594da71c8 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:58.787419 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-55bed039-5eab-4106-ad9c-75d263723335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4455ac7c5547699e56725de9670531'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:58.788206 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-55bed039-5eab-4106-ad9c-75d263723335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4455ac7c5547699e56725de9670531'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:59:58.850184 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d90796-bf79-4946-b488-136594da71c8 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:58.853943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ae008-7c6b-41f4-a6cd-da61b55e2681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:58.854566 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ae008-7c6b-41f4-a6cd-da61b55e2681 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:58.854884 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ae008-7c6b-41f4-a6cd-da61b55e2681 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:58.855163 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ae008-7c6b-41f4-a6cd-da61b55e2681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:58.856920 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-249ae008-7c6b-41f4-a6cd-da61b55e2681 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:58.872634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ae008-7c6b-41f4-a6cd-da61b55e2681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:58.874090 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ae008-7c6b-41f4-a6cd-da61b55e2681 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:58.885170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 919/1849] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:58.885866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ae008-7c6b-41f4-a6cd-da61b55e2681 service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:58.887291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-249ae008-7c6b-41f4-a6cd-da61b55e2681 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:58.903240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ae008-7c6b-41f4-a6cd-da61b55e2681 service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:58.916157 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 931/1850] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 12:59:58 2022] DELETE /identity/v3/users/fa4455ac7c5547699e56725de9670531 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:59:58.921134 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6ea87-023e-45df-a226-e96a26bd8a6a None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:58.921296 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a13db-15e2-433d-885a-8e4d5f2b25ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:58.921418 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6ea87-023e-45df-a226-e96a26bd8a6a None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:58.921418 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6ea87-023e-45df-a226-e96a26bd8a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:58.921580 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a13db-15e2-433d-885a-8e4d5f2b25ad admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:58.921580 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a13db-15e2-433d-885a-8e4d5f2b25ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:58.921831 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a13db-15e2-433d-885a-8e4d5f2b25ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:58.922608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a13db-15e2-433d-885a-8e4d5f2b25ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:58.924737 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a13db-15e2-433d-885a-8e4d5f2b25ad admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:58.936709 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 920/1851] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:58.954039 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a13db-15e2-433d-885a-8e4d5f2b25ad admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:58.968728 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-aae6ea87-023e-45df-a226-e96a26bd8a6a None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:58.970385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-aae6ea87-023e-45df-a226-e96a26bd8a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:58.977325 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a13db-15e2-433d-885a-8e4d5f2b25ad admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:59.099181 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 932/1852] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:59:59.113585 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6ea87-023e-45df-a226-e96a26bd8a6a None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:59.115418 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-aae6ea87-023e-45df-a226-e96a26bd8a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:59.158318 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4c2fb-bb00-4e2b-97e8-dc27ed55df60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:59.159196 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4c2fb-bb00-4e2b-97e8-dc27ed55df60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:59.159946 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4c2fb-bb00-4e2b-97e8-dc27ed55df60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:59.159946 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4c2fb-bb00-4e2b-97e8-dc27ed55df60 admin admin] PATH_INFO: `/v3/projects/5d8cecebd4034d4a8180e9ca16c0b815/users/650649921aa64ff0b30697e0f6da60d5/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:59.202941 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4c2fb-bb00-4e2b-97e8-dc27ed55df60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8cecebd4034d4a8180e9ca16c0b815, user_id=650649921aa64ff0b30697e0f6da60d5, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:59.205762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4c2fb-bb00-4e2b-97e8-dc27ed55df60 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:59.286365 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6ea87-023e-45df-a226-e96a26bd8a6a None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:59.296539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 921/1853] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:58 2022] PUT /identity/v3/projects/5d8cecebd4034d4a8180e9ca16c0b815/users/650649921aa64ff0b30697e0f6da60d5/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:59.296539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4c2fb-bb00-4e2b-97e8-dc27ed55df60 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:59.299020 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-25b4c2fb-bb00-4e2b-97e8-dc27ed55df60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:59.349079 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:59.382012 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4c2fb-bb00-4e2b-97e8-dc27ed55df60 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:59.386524 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103142b-3eb2-481b-9d51-211da90028cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:59.387190 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103142b-3eb2-481b-9d51-211da90028cd service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:59.387550 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103142b-3eb2-481b-9d51-211da90028cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:59.387838 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103142b-3eb2-481b-9d51-211da90028cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:59.389676 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-d103142b-3eb2-481b-9d51-211da90028cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:59.405875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469afed-3eb3-4cfe-b037-e0af0b295746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:59.406813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469afed-3eb3-4cfe-b037-e0af0b295746 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:59.407437 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469afed-3eb3-4cfe-b037-e0af0b295746 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:59.407788 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469afed-3eb3-4cfe-b037-e0af0b295746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:59.462943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103142b-3eb2-481b-9d51-211da90028cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:59.464673 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103142b-3eb2-481b-9d51-211da90028cd service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:59.477395 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 922/1854] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:59.478271 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103142b-3eb2-481b-9d51-211da90028cd service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:59.515140 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469afed-3eb3-4cfe-b037-e0af0b295746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:59.517395 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469afed-3eb3-4cfe-b037-e0af0b295746 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:59.535017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 933/1855] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:59.583227 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103142b-3eb2-481b-9d51-211da90028cd service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:59.589011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7ecde-081e-4d86-aa7f-9a060b2c3e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:59.590160 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7ecde-081e-4d86-aa7f-9a060b2c3e17 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:59.590318 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7ecde-081e-4d86-aa7f-9a060b2c3e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:59.590597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7ecde-081e-4d86-aa7f-9a060b2c3e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:59.591348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7ecde-081e-4d86-aa7f-9a060b2c3e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:59.596459 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7ecde-081e-4d86-aa7f-9a060b2c3e17 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:59.623042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 923/1856] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 12:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:59:59.626431 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469afed-3eb3-4cfe-b037-e0af0b295746 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:59.640970 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469afed-3eb3-4cfe-b037-e0af0b295746 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:59.647992 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b736a7a-f582-4166-bada-1716a3e29ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:59.648700 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b736a7a-f582-4166-bada-1716a3e29ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:59.653177 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b736a7a-f582-4166-bada-1716a3e29ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:59.653398 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b736a7a-f582-4166-bada-1716a3e29ae2 admin admin] PATH_INFO: `/v3/projects/5d8cecebd4034d4a8180e9ca16c0b815/users/650649921aa64ff0b30697e0f6da60d5/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:59.655720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b736a7a-f582-4166-bada-1716a3e29ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8cecebd4034d4a8180e9ca16c0b815, user_id=650649921aa64ff0b30697e0f6da60d5, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:59.659383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b736a7a-f582-4166-bada-1716a3e29ae2 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:59.664075 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:59.676754 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 934/1857] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 12:59:59 2022] PUT /identity/v3/projects/5d8cecebd4034d4a8180e9ca16c0b815/users/650649921aa64ff0b30697e0f6da60d5/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:59:59.688093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e6171-6902-411a-8e6b-d556cc39bbb4 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:59.688388 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e6171-6902-411a-8e6b-d556cc39bbb4 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:59.688698 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e6171-6902-411a-8e6b-d556cc39bbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:59.730249 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-a71e6171-6902-411a-8e6b-d556cc39bbb4 None None] MFA Rules not processed for user `650649921aa64ff0b30697e0f6da60d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:59.731534 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a71e6171-6902-411a-8e6b-d556cc39bbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:59.855773 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 924/1858] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 12:59:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:59:59.878653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b736a7a-f582-4166-bada-1716a3e29ae2 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:59.880669 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-3b736a7a-f582-4166-bada-1716a3e29ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:59.964950 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b736a7a-f582-4166-bada-1716a3e29ae2 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:59.974977 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458e527-cdee-4712-917d-a76a1e674d47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:59.975841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458e527-cdee-4712-917d-a76a1e674d47 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:59.976132 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458e527-cdee-4712-917d-a76a1e674d47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:59.976466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458e527-cdee-4712-917d-a76a1e674d47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:59.986554 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458e527-cdee-4712-917d-a76a1e674d47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:59.988018 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458e527-cdee-4712-917d-a76a1e674d47 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:59.997700 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 935/1859] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:00.040224 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e6171-6902-411a-8e6b-d556cc39bbb4 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:00.041738 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a71e6171-6902-411a-8e6b-d556cc39bbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:00.107833 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e6171-6902-411a-8e6b-d556cc39bbb4 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:00.112458 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503aba80-82dc-4eba-9ad8-7ca46cb36ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:00.113104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503aba80-82dc-4eba-9ad8-7ca46cb36ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:00.113399 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503aba80-82dc-4eba-9ad8-7ca46cb36ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:00.113680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503aba80-82dc-4eba-9ad8-7ca46cb36ca1 admin admin] PATH_INFO: `/v3/projects/e12e8bfff40d48208872c4336738835b` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:00.114892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503aba80-82dc-4eba-9ad8-7ca46cb36ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e12e8bfff40d48208872c4336738835b)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:00.116841 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503aba80-82dc-4eba-9ad8-7ca46cb36ca1 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:00.247721 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-503aba80-82dc-4eba-9ad8-7ca46cb36ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e12e8bfff40d48208872c4336738835b', 'request_id': 'req-503aba80-82dc-4eba-9ad8-7ca46cb36ca1'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:00.253820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-503aba80-82dc-4eba-9ad8-7ca46cb36ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e12e8bfff40d48208872c4336738835b', 'request_id': 'req-503aba80-82dc-4eba-9ad8-7ca46cb36ca1'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:00.287404 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458e527-cdee-4712-917d-a76a1e674d47 service cinder] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:00.295975 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458e527-cdee-4712-917d-a76a1e674d47 service cinder] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:00.335148 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-503aba80-82dc-4eba-9ad8-7ca46cb36ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e12e8bfff40d48208872c4336738835b', 'request_id': 'req-503aba80-82dc-4eba-9ad8-7ca46cb36ca1'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:00.345468 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4ab11-d3d0-4279-88b0-0a5ad0fb9443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:00.346118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4ab11-d3d0-4279-88b0-0a5ad0fb9443 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:00.346407 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4ab11-d3d0-4279-88b0-0a5ad0fb9443 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:00.346683 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4ab11-d3d0-4279-88b0-0a5ad0fb9443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:00.348524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-99e4ab11-d3d0-4279-88b0-0a5ad0fb9443 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:00.349326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-503aba80-82dc-4eba-9ad8-7ca46cb36ca1 admin admin] The token cache is being invalidate because project e12e8bfff40d48208872c4336738835b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:00.349823 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-503aba80-82dc-4eba-9ad8-7ca46cb36ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:00.350667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-503aba80-82dc-4eba-9ad8-7ca46cb36ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:00.352628 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 925/1860] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:00 2022] DELETE /identity/v3/projects/e12e8bfff40d48208872c4336738835b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:00.356151 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503aba80-82dc-4eba-9ad8-7ca46cb36ca1 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:00.357729 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-503aba80-82dc-4eba-9ad8-7ca46cb36ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:00.416025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4ab11-d3d0-4279-88b0-0a5ad0fb9443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:00.417481 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4ab11-d3d0-4279-88b0-0a5ad0fb9443 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:00.425390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503aba80-82dc-4eba-9ad8-7ca46cb36ca1 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:00.426773 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 936/1861] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:00:00.430931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7a05f-9eab-4933-aaae-ec52da17bca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:00.431574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7a05f-9eab-4933-aaae-ec52da17bca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:00.431853 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7a05f-9eab-4933-aaae-ec52da17bca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:00.432123 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7a05f-9eab-4933-aaae-ec52da17bca9 admin admin] PATH_INFO: `/v3/users/a6bb4058b37846beb0fd7499a1b04ece` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:00.433288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7a05f-9eab-4933-aaae-ec52da17bca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6bb4058b37846beb0fd7499a1b04ece)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:00.435251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7a05f-9eab-4933-aaae-ec52da17bca9 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:00.499063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:00.626533 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-57f7a05f-9eab-4933-aaae-ec52da17bca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6bb4058b37846beb0fd7499a1b04ece'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:00.633479 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-57f7a05f-9eab-4933-aaae-ec52da17bca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6bb4058b37846beb0fd7499a1b04ece'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:00.761436 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-57f7a05f-9eab-4933-aaae-ec52da17bca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6bb4058b37846beb0fd7499a1b04ece'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:00.762087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-57f7a05f-9eab-4933-aaae-ec52da17bca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6bb4058b37846beb0fd7499a1b04ece'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:00.775171 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-57f7a05f-9eab-4933-aaae-ec52da17bca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6bb4058b37846beb0fd7499a1b04ece'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:00.781421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 926/1862] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:00 2022] DELETE /identity/v3/users/a6bb4058b37846beb0fd7499a1b04ece => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:01.353632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:01.360389 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4ab11-d3d0-4279-88b0-0a5ad0fb9443 service cinder] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:01.376893 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4ab11-d3d0-4279-88b0-0a5ad0fb9443 service cinder] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:01.434028 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e199fa-c790-4510-b772-ef0e564e5f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:01.434780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e199fa-c790-4510-b772-ef0e564e5f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:01.435075 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e199fa-c790-4510-b772-ef0e564e5f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:01.435376 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e199fa-c790-4510-b772-ef0e564e5f11 admin admin] PATH_INFO: `/v3/projects/679d8d86b83d4cbca663deb776ee255b` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:01.436647 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e199fa-c790-4510-b772-ef0e564e5f11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=679d8d86b83d4cbca663deb776ee255b)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:01.440963 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e199fa-c790-4510-b772-ef0e564e5f11 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:01.566984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-61e199fa-c790-4510-b772-ef0e564e5f11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '679d8d86b83d4cbca663deb776ee255b', 'request_id': 'req-61e199fa-c790-4510-b772-ef0e564e5f11'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:01.573790 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-61e199fa-c790-4510-b772-ef0e564e5f11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '679d8d86b83d4cbca663deb776ee255b', 'request_id': 'req-61e199fa-c790-4510-b772-ef0e564e5f11'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:01.718103 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-61e199fa-c790-4510-b772-ef0e564e5f11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '679d8d86b83d4cbca663deb776ee255b', 'request_id': 'req-61e199fa-c790-4510-b772-ef0e564e5f11'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:01.730498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-61e199fa-c790-4510-b772-ef0e564e5f11 admin admin] The token cache is being invalidate because project 679d8d86b83d4cbca663deb776ee255b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:01.730827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-61e199fa-c790-4510-b772-ef0e564e5f11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:01.731492 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-61e199fa-c790-4510-b772-ef0e564e5f11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:01.733397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 937/1863] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:01 2022] DELETE /identity/v3/projects/679d8d86b83d4cbca663deb776ee255b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:01.739369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee6f72-ddfb-499e-9d00-a140acd98220 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:01.739819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee6f72-ddfb-499e-9d00-a140acd98220 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:01.740188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee6f72-ddfb-499e-9d00-a140acd98220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:01.761359 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-9aee6f72-ddfb-499e-9d00-a140acd98220 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:01.762674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-9aee6f72-ddfb-499e-9d00-a140acd98220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:01.827346 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 927/1864] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:01.835964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf0d6a-ab0e-49bd-9766-895066139b0f None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:01.836306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf0d6a-ab0e-49bd-9766-895066139b0f None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:01.836626 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf0d6a-ab0e-49bd-9766-895066139b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:01.858233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-90bf0d6a-ab0e-49bd-9766-895066139b0f None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:01.859597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-90bf0d6a-ab0e-49bd-9766-895066139b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:01.868208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 938/1865] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:01.872652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee6f72-ddfb-499e-9d00-a140acd98220 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:01.882688 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee6f72-ddfb-499e-9d00-a140acd98220 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:01.893883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc42d31-5a84-4b9c-9bca-ee1bb0a93499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:01.893883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc42d31-5a84-4b9c-9bca-ee1bb0a93499 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:01.893883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc42d31-5a84-4b9c-9bca-ee1bb0a93499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:01.893883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc42d31-5a84-4b9c-9bca-ee1bb0a93499 admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:01.894226 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc42d31-5a84-4b9c-9bca-ee1bb0a93499 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:00:01.894226 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc42d31-5a84-4b9c-9bca-ee1bb0a93499 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:01.894226 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc42d31-5a84-4b9c-9bca-ee1bb0a93499 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:01.907832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 928/1866] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:00:01.910590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf0d6a-ab0e-49bd-9766-895066139b0f None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:01.920291 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf0d6a-ab0e-49bd-9766-895066139b0f None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:01.925068 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b41455-32eb-4190-b40d-e18a0905b275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:01.925686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b41455-32eb-4190-b40d-e18a0905b275 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:01.925973 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b41455-32eb-4190-b40d-e18a0905b275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:01.926253 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b41455-32eb-4190-b40d-e18a0905b275 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:01.926968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b41455-32eb-4190-b40d-e18a0905b275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:01.928898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b41455-32eb-4190-b40d-e18a0905b275 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:02.045164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 939/1867] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:01 2022] POST /identity/v3/projects => generated 401 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:02.049491 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc42d31-5a84-4b9c-9bca-ee1bb0a93499 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:02.059906 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc42d31-5a84-4b9c-9bca-ee1bb0a93499 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:02.118449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76f55a-0c88-4720-a78d-4aa4d604d396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:02.119134 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76f55a-0c88-4720-a78d-4aa4d604d396 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:02.119426 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76f55a-0c88-4720-a78d-4aa4d604d396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:02.119711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76f55a-0c88-4720-a78d-4aa4d604d396 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:02.120381 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76f55a-0c88-4720-a78d-4aa4d604d396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:02.122313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76f55a-0c88-4720-a78d-4aa4d604d396 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:02.214119 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 929/1868] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:02 2022] POST /identity/v3/users => generated 301 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:02.218807 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b41455-32eb-4190-b40d-e18a0905b275 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:02.235562 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b41455-32eb-4190-b40d-e18a0905b275 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:02.244797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50525c7-0496-47c6-982c-4179b947f274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:02.245553 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50525c7-0496-47c6-982c-4179b947f274 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:02.245911 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50525c7-0496-47c6-982c-4179b947f274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:02.246300 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50525c7-0496-47c6-982c-4179b947f274 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:02.247185 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50525c7-0496-47c6-982c-4179b947f274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:02.249077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50525c7-0496-47c6-982c-4179b947f274 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:02.261079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 940/1869] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:02.265108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76f55a-0c88-4720-a78d-4aa4d604d396 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:02.277543 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76f55a-0c88-4720-a78d-4aa4d604d396 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:02.282717 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e408d-8f99-4a66-ac6b-04745f002e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:02.283367 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e408d-8f99-4a66-ac6b-04745f002e3d admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:02.283654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e408d-8f99-4a66-ac6b-04745f002e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:02.283935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e408d-8f99-4a66-ac6b-04745f002e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:02.284763 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e408d-8f99-4a66-ac6b-04745f002e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:02.286382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e408d-8f99-4a66-ac6b-04745f002e3d admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:02.297634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 930/1870] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:02.301822 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50525c7-0496-47c6-982c-4179b947f274 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:02.310467 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:02.313252 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50525c7-0496-47c6-982c-4179b947f274 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:02.318689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92e272-12d0-456c-b552-aa6092bc3ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:02.319399 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92e272-12d0-456c-b552-aa6092bc3ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:02.319689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92e272-12d0-456c-b552-aa6092bc3ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:02.320023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92e272-12d0-456c-b552-aa6092bc3ff5 admin admin] PATH_INFO: `/v3/projects/2288266a1bf943a4aaa8cbe17ae272f2/users/3e930ad923104016a6ce1d3cf1fd21ec/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:02.349285 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92e272-12d0-456c-b552-aa6092bc3ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2288266a1bf943a4aaa8cbe17ae272f2, user_id=3e930ad923104016a6ce1d3cf1fd21ec, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:02.352865 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92e272-12d0-456c-b552-aa6092bc3ff5 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:02.425027 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 941/1871] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:02 2022] PUT /identity/v3/projects/2288266a1bf943a4aaa8cbe17ae272f2/users/3e930ad923104016a6ce1d3cf1fd21ec/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:02.436028 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2a432-9f03-4dec-8774-1a13f21a66df None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:02.436327 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2a432-9f03-4dec-8774-1a13f21a66df None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:02.436644 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2a432-9f03-4dec-8774-1a13f21a66df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:02.464319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-7ef2a432-9f03-4dec-8774-1a13f21a66df None None] MFA Rules not processed for user `3e930ad923104016a6ce1d3cf1fd21ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:02.465574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-7ef2a432-9f03-4dec-8774-1a13f21a66df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:02.528801 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 931/1872] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:02 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:02.533446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92e272-12d0-456c-b552-aa6092bc3ff5 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:02.597878 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92e272-12d0-456c-b552-aa6092bc3ff5 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:02.603415 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2875e-58d3-4cfb-8a1c-ffbfd63caab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:02.604040 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2875e-58d3-4cfb-8a1c-ffbfd63caab0 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:02.604327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2875e-58d3-4cfb-8a1c-ffbfd63caab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:02.604629 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2875e-58d3-4cfb-8a1c-ffbfd63caab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:02.605298 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2875e-58d3-4cfb-8a1c-ffbfd63caab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:02.607516 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2875e-58d3-4cfb-8a1c-ffbfd63caab0 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:02.693904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 942/1873] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:02 2022] POST /identity/v3/projects => generated 401 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:02.697919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2a432-9f03-4dec-8774-1a13f21a66df None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:02.708834 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2a432-9f03-4dec-8774-1a13f21a66df None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:02.765777 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b361b6-ffbb-4e1e-b805-9de3ff12e45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:02.766425 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b361b6-ffbb-4e1e-b805-9de3ff12e45b admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:02.766687 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b361b6-ffbb-4e1e-b805-9de3ff12e45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:02.766999 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b361b6-ffbb-4e1e-b805-9de3ff12e45b admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:02.767681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b361b6-ffbb-4e1e-b805-9de3ff12e45b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:02.769677 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b361b6-ffbb-4e1e-b805-9de3ff12e45b admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:02.856909 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:02.863123 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 932/1874] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:02 2022] POST /identity/v3/users => generated 307 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:02.866603 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2875e-58d3-4cfb-8a1c-ffbfd63caab0 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:02.877126 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2875e-58d3-4cfb-8a1c-ffbfd63caab0 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:02.881823 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002147b-a91a-44b1-864a-d5f188597066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:02.882442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002147b-a91a-44b1-864a-d5f188597066 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:02.882762 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002147b-a91a-44b1-864a-d5f188597066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:02.883045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002147b-a91a-44b1-864a-d5f188597066 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:02.884259 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002147b-a91a-44b1-864a-d5f188597066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:02.885961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002147b-a91a-44b1-864a-d5f188597066 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:02.896912 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 943/1875] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:02.901830 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b361b6-ffbb-4e1e-b805-9de3ff12e45b admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:02.911978 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b361b6-ffbb-4e1e-b805-9de3ff12e45b admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:02.916660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00b469-b58c-4b02-80d2-e38987029a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:02.917328 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00b469-b58c-4b02-80d2-e38987029a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:02.917611 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00b469-b58c-4b02-80d2-e38987029a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:02.917889 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00b469-b58c-4b02-80d2-e38987029a46 admin admin] PATH_INFO: `/v3/projects/62fae18c54624497b30fb95f0ab2e966/users/3c224b0eee074a3d80cf96ae6a4b15fb/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:02.934152 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00b469-b58c-4b02-80d2-e38987029a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62fae18c54624497b30fb95f0ab2e966, user_id=3c224b0eee074a3d80cf96ae6a4b15fb, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:02.936840 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00b469-b58c-4b02-80d2-e38987029a46 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:03.015999 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 933/1876] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:02 2022] PUT /identity/v3/projects/62fae18c54624497b30fb95f0ab2e966/users/3c224b0eee074a3d80cf96ae6a4b15fb/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:03.019982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002147b-a91a-44b1-864a-d5f188597066 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:03.030687 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002147b-a91a-44b1-864a-d5f188597066 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:03.085013 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78830286-6302-4026-9660-30b828a5a48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:03.085613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78830286-6302-4026-9660-30b828a5a48f admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:03.085895 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78830286-6302-4026-9660-30b828a5a48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:03.086168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78830286-6302-4026-9660-30b828a5a48f admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:03.087553 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78830286-6302-4026-9660-30b828a5a48f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:03.089179 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78830286-6302-4026-9660-30b828a5a48f admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:03.103197 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 944/1877] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:03.104620 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:03.106661 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00b469-b58c-4b02-80d2-e38987029a46 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:03.117250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00b469-b58c-4b02-80d2-e38987029a46 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:03.121995 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9a770-0f56-4e85-a36e-8d472c8c396e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:03.122664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9a770-0f56-4e85-a36e-8d472c8c396e admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:03.122981 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9a770-0f56-4e85-a36e-8d472c8c396e admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:03.123289 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9a770-0f56-4e85-a36e-8d472c8c396e admin admin] PATH_INFO: `/v3/projects/62fae18c54624497b30fb95f0ab2e966/users/3c224b0eee074a3d80cf96ae6a4b15fb/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:03.125325 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9a770-0f56-4e85-a36e-8d472c8c396e admin admin] RBAC: Authorizing `identity:create_grant(project_id=62fae18c54624497b30fb95f0ab2e966, user_id=3c224b0eee074a3d80cf96ae6a4b15fb, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:03.128031 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9a770-0f56-4e85-a36e-8d472c8c396e admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:03.138640 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 934/1878] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:03 2022] PUT /identity/v3/projects/62fae18c54624497b30fb95f0ab2e966/users/3c224b0eee074a3d80cf96ae6a4b15fb/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:03.149627 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac7eb6-8a5d-4788-a61c-72cba72a9c2e None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:03.149926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac7eb6-8a5d-4788-a61c-72cba72a9c2e None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:03.150213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac7eb6-8a5d-4788-a61c-72cba72a9c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:03.178024 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-39ac7eb6-8a5d-4788-a61c-72cba72a9c2e None None] MFA Rules not processed for user `3c224b0eee074a3d80cf96ae6a4b15fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:03.179320 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-39ac7eb6-8a5d-4788-a61c-72cba72a9c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:03.247858 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 945/1879] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:03.259679 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9a770-0f56-4e85-a36e-8d472c8c396e admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:03.261428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-99f9a770-0f56-4e85-a36e-8d472c8c396e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:03.318104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9a770-0f56-4e85-a36e-8d472c8c396e admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:03.322377 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879026ed-e2ed-433c-97b8-8318efb08d72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:03.326117 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879026ed-e2ed-433c-97b8-8318efb08d72 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:03.326117 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879026ed-e2ed-433c-97b8-8318efb08d72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:03.326117 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879026ed-e2ed-433c-97b8-8318efb08d72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:03.333550 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879026ed-e2ed-433c-97b8-8318efb08d72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:03.335122 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879026ed-e2ed-433c-97b8-8318efb08d72 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:03.345556 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 935/1880] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:03 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:03.692993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac7eb6-8a5d-4788-a61c-72cba72a9c2e None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:03.704082 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac7eb6-8a5d-4788-a61c-72cba72a9c2e None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:03.710509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e52102-f73f-426a-b26c-502188c80e56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:03.711614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e52102-f73f-426a-b26c-502188c80e56 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:03.712164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e52102-f73f-426a-b26c-502188c80e56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:03.712645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e52102-f73f-426a-b26c-502188c80e56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:03.781187 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:03.862948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e52102-f73f-426a-b26c-502188c80e56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:03.864428 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e52102-f73f-426a-b26c-502188c80e56 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:03.896841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 946/1881] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:03 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:04.467869 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:05.986580 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:07.381164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:07.495874 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:08.519708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:08.569422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:08.775888 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:08.898452 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:09.038363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:09.066958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:09.221207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:09.244535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:09.312479 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:09.329516 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:09.398289 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:09.421047 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:09.524047 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:09.580898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:09.609358 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:09.753565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:10.868137 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:14.765656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879026ed-e2ed-433c-97b8-8318efb08d72 service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:14.767162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-879026ed-e2ed-433c-97b8-8318efb08d72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:14.837924 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879026ed-e2ed-433c-97b8-8318efb08d72 service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:14.842606 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13060a07-0858-4c79-a944-54c76bee3bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:14.843288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13060a07-0858-4c79-a944-54c76bee3bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:14.843581 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13060a07-0858-4c79-a944-54c76bee3bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:14.843898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13060a07-0858-4c79-a944-54c76bee3bc9 admin admin] PATH_INFO: `/v3/users/5261452366204e5cbfa09ba94a456302` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:14.845222 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13060a07-0858-4c79-a944-54c76bee3bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5261452366204e5cbfa09ba94a456302)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:14.847177 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13060a07-0858-4c79-a944-54c76bee3bc9 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:15.065285 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-13060a07-0858-4c79-a944-54c76bee3bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5261452366204e5cbfa09ba94a456302'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:15.076934 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-13060a07-0858-4c79-a944-54c76bee3bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5261452366204e5cbfa09ba94a456302'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:15.149781 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-13060a07-0858-4c79-a944-54c76bee3bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5261452366204e5cbfa09ba94a456302'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:15.157632 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-13060a07-0858-4c79-a944-54c76bee3bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5261452366204e5cbfa09ba94a456302'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:15.175798 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-13060a07-0858-4c79-a944-54c76bee3bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5261452366204e5cbfa09ba94a456302'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:15.184825 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 936/1882] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:14 2022] DELETE /identity/v3/users/5261452366204e5cbfa09ba94a456302 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:15.192977 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86399cd9-7fac-41bb-a15b-58156409a67e None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:15.193505 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86399cd9-7fac-41bb-a15b-58156409a67e None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:15.193596 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86399cd9-7fac-41bb-a15b-58156409a67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:15.237051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-86399cd9-7fac-41bb-a15b-58156409a67e None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:15.238340 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-86399cd9-7fac-41bb-a15b-58156409a67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:15.307734 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 947/1883] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:00:15.319391 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13060a07-0858-4c79-a944-54c76bee3bc9 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:15.326559 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-13060a07-0858-4c79-a944-54c76bee3bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:15.420625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13060a07-0858-4c79-a944-54c76bee3bc9 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:15.421008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53031ed4-ecbf-478e-abc0-c6d194c84671 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:15.421372 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53031ed4-ecbf-478e-abc0-c6d194c84671 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:15.421735 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53031ed4-ecbf-478e-abc0-c6d194c84671 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:15.423360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 948/1884] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 3 13:00:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 13:00:15.427674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9356f1-0181-43ef-a7a0-fa0cb971660c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:15.428326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9356f1-0181-43ef-a7a0-fa0cb971660c service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:15.437300 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275fa88-f81b-477f-bf0b-22b51e538dbb None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:15.437791 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275fa88-f81b-477f-bf0b-22b51e538dbb None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:15.438359 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275fa88-f81b-477f-bf0b-22b51e538dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:15.444047 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9356f1-0181-43ef-a7a0-fa0cb971660c service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:15.445808 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9356f1-0181-43ef-a7a0-fa0cb971660c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:15.456942 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9356f1-0181-43ef-a7a0-fa0cb971660c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:15.459316 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9356f1-0181-43ef-a7a0-fa0cb971660c service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:15.463112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-d275fa88-f81b-477f-bf0b-22b51e538dbb None None] MFA Rules not processed for user `bc939818c9224b0ebe2dbaa1eaaec5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:15.464354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d275fa88-f81b-477f-bf0b-22b51e538dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:15.471360 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 937/1885] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:15.543448 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 949/1886] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 3 13:00:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:15.562879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9356f1-0181-43ef-a7a0-fa0cb971660c service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:15.562879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-7c9356f1-0181-43ef-a7a0-fa0cb971660c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:15.577335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9356f1-0181-43ef-a7a0-fa0cb971660c service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:15.583718 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba737f-d528-495f-941d-d6d474ee7dd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:15.584654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba737f-d528-495f-941d-d6d474ee7dd5 service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:15.584920 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba737f-d528-495f-941d-d6d474ee7dd5 service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:15.585259 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba737f-d528-495f-941d-d6d474ee7dd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:15.595945 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba737f-d528-495f-941d-d6d474ee7dd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:15.597555 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba737f-d528-495f-941d-d6d474ee7dd5 service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:15.604187 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:15.609813 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 938/1887] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:15.858238 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275fa88-f81b-477f-bf0b-22b51e538dbb None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:15.860081 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d275fa88-f81b-477f-bf0b-22b51e538dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:15.882362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275fa88-f81b-477f-bf0b-22b51e538dbb None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:15.888023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec4037-41bb-4197-aa96-a45531489ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:15.888750 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec4037-41bb-4197-aa96-a45531489ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:15.889098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec4037-41bb-4197-aa96-a45531489ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:15.889382 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec4037-41bb-4197-aa96-a45531489ed3 admin admin] PATH_INFO: `/v3/projects/2684870728a24d958a5440b078f87afe` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:15.890710 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec4037-41bb-4197-aa96-a45531489ed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2684870728a24d958a5440b078f87afe)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:15.892757 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec4037-41bb-4197-aa96-a45531489ed3 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:16.053604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d1ec4037-41bb-4197-aa96-a45531489ed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2684870728a24d958a5440b078f87afe', 'request_id': 'req-d1ec4037-41bb-4197-aa96-a45531489ed3'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:16.059951 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d1ec4037-41bb-4197-aa96-a45531489ed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2684870728a24d958a5440b078f87afe', 'request_id': 'req-d1ec4037-41bb-4197-aa96-a45531489ed3'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:16.126778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d1ec4037-41bb-4197-aa96-a45531489ed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2684870728a24d958a5440b078f87afe', 'request_id': 'req-d1ec4037-41bb-4197-aa96-a45531489ed3'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:16.136874 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:16.141022 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d1ec4037-41bb-4197-aa96-a45531489ed3 admin admin] The token cache is being invalidate because project 2684870728a24d958a5440b078f87afe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:16.141319 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d1ec4037-41bb-4197-aa96-a45531489ed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:16.141983 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d1ec4037-41bb-4197-aa96-a45531489ed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:16.143710 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 950/1888] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:15 2022] DELETE /identity/v3/projects/2684870728a24d958a5440b078f87afe => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:16.147703 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba737f-d528-495f-941d-d6d474ee7dd5 service nova] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:16.159572 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba737f-d528-495f-941d-d6d474ee7dd5 service nova] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:16.227468 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6e7f9-cb04-4305-97a4-18fa628e7923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:16.228129 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6e7f9-cb04-4305-97a4-18fa628e7923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:16.228416 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6e7f9-cb04-4305-97a4-18fa628e7923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:16.228698 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6e7f9-cb04-4305-97a4-18fa628e7923 admin admin] PATH_INFO: `/v3/users/650649921aa64ff0b30697e0f6da60d5` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:16.229900 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6e7f9-cb04-4305-97a4-18fa628e7923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=650649921aa64ff0b30697e0f6da60d5)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:16.231902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6e7f9-cb04-4305-97a4-18fa628e7923 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:16.409461 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-05e6e7f9-cb04-4305-97a4-18fa628e7923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '650649921aa64ff0b30697e0f6da60d5'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:16.417229 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-05e6e7f9-cb04-4305-97a4-18fa628e7923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '650649921aa64ff0b30697e0f6da60d5'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:16.494921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-05e6e7f9-cb04-4305-97a4-18fa628e7923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '650649921aa64ff0b30697e0f6da60d5'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:16.494921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-05e6e7f9-cb04-4305-97a4-18fa628e7923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '650649921aa64ff0b30697e0f6da60d5'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:16.516884 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-05e6e7f9-cb04-4305-97a4-18fa628e7923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '650649921aa64ff0b30697e0f6da60d5'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:16.529256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 939/1889] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:16 2022] DELETE /identity/v3/users/650649921aa64ff0b30697e0f6da60d5 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:16.970640 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec4037-41bb-4197-aa96-a45531489ed3 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:16.972177 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d1ec4037-41bb-4197-aa96-a45531489ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:16.985198 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec4037-41bb-4197-aa96-a45531489ed3 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:17.054951 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb61ce-f480-4fe2-847d-5f745083122e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:17.055640 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb61ce-f480-4fe2-847d-5f745083122e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:17.055980 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb61ce-f480-4fe2-847d-5f745083122e admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:17.056268 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb61ce-f480-4fe2-847d-5f745083122e admin admin] PATH_INFO: `/v3/projects/5d8cecebd4034d4a8180e9ca16c0b815` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:17.057516 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb61ce-f480-4fe2-847d-5f745083122e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8cecebd4034d4a8180e9ca16c0b815)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:17.059541 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb61ce-f480-4fe2-847d-5f745083122e admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:17.211496 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9dfb61ce-f480-4fe2-847d-5f745083122e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8cecebd4034d4a8180e9ca16c0b815', 'request_id': 'req-9dfb61ce-f480-4fe2-847d-5f745083122e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:17.217811 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9dfb61ce-f480-4fe2-847d-5f745083122e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8cecebd4034d4a8180e9ca16c0b815', 'request_id': 'req-9dfb61ce-f480-4fe2-847d-5f745083122e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:17.295891 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9dfb61ce-f480-4fe2-847d-5f745083122e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8cecebd4034d4a8180e9ca16c0b815', 'request_id': 'req-9dfb61ce-f480-4fe2-847d-5f745083122e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:17.310170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9dfb61ce-f480-4fe2-847d-5f745083122e admin admin] The token cache is being invalidate because project 5d8cecebd4034d4a8180e9ca16c0b815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:17.310475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9dfb61ce-f480-4fe2-847d-5f745083122e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:17.311194 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9dfb61ce-f480-4fe2-847d-5f745083122e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:17.313566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 951/1890] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:16 2022] DELETE /identity/v3/projects/5d8cecebd4034d4a8180e9ca16c0b815 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:17.318542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a19911-3572-413f-9856-dd2529ed7e4b None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:17.319425 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a19911-3572-413f-9856-dd2529ed7e4b None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:17.319812 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a19911-3572-413f-9856-dd2529ed7e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:17.344294 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-99a19911-3572-413f-9856-dd2529ed7e4b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:17.345823 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-99a19911-3572-413f-9856-dd2529ed7e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:17.416961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 940/1891] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:17.425262 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cecbc-279f-4db3-a8e3-f163380337ea None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:17.425262 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cecbc-279f-4db3-a8e3-f163380337ea None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:17.425425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cecbc-279f-4db3-a8e3-f163380337ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:17.448359 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-8f9cecbc-279f-4db3-a8e3-f163380337ea None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:17.449666 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-8f9cecbc-279f-4db3-a8e3-f163380337ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:17.471059 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 952/1892] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:17.475620 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a19911-3572-413f-9856-dd2529ed7e4b None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:17.485990 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a19911-3572-413f-9856-dd2529ed7e4b None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:17.490714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb55b4-3cde-48c1-b78f-4b0606446a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:17.491359 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb55b4-3cde-48c1-b78f-4b0606446a69 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:17.491646 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb55b4-3cde-48c1-b78f-4b0606446a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:17.492480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb55b4-3cde-48c1-b78f-4b0606446a69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:17.493184 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb55b4-3cde-48c1-b78f-4b0606446a69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:00:17.493490 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb55b4-3cde-48c1-b78f-4b0606446a69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:17.495140 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb55b4-3cde-48c1-b78f-4b0606446a69 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:17.510438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 941/1893] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:00:17.515299 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cecbc-279f-4db3-a8e3-f163380337ea None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:17.524887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cecbc-279f-4db3-a8e3-f163380337ea None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:17.529756 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05717b-d3b3-4be4-9257-d00b1ce54a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:17.530382 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05717b-d3b3-4be4-9257-d00b1ce54a86 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:17.530669 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05717b-d3b3-4be4-9257-d00b1ce54a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:17.531017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05717b-d3b3-4be4-9257-d00b1ce54a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:17.531670 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05717b-d3b3-4be4-9257-d00b1ce54a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:17.533911 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05717b-d3b3-4be4-9257-d00b1ce54a86 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:17.670661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 953/1894] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:17 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:17.674892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb55b4-3cde-48c1-b78f-4b0606446a69 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:17.685813 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb55b4-3cde-48c1-b78f-4b0606446a69 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:17.689491 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:17.748667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e365a-b1c5-4038-bb6d-34bfd2b8f8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:17.749845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e365a-b1c5-4038-bb6d-34bfd2b8f8de admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:17.750146 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e365a-b1c5-4038-bb6d-34bfd2b8f8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:17.750722 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e365a-b1c5-4038-bb6d-34bfd2b8f8de admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:17.751336 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e365a-b1c5-4038-bb6d-34bfd2b8f8de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:17.753341 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e365a-b1c5-4038-bb6d-34bfd2b8f8de admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:17.861507 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 942/1895] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:17 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:17.865573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05717b-d3b3-4be4-9257-d00b1ce54a86 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:17.880717 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05717b-d3b3-4be4-9257-d00b1ce54a86 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:17.888283 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbaaed-f18c-4342-ae63-1b7057dd3bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:17.888959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbaaed-f18c-4342-ae63-1b7057dd3bea admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:17.889210 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbaaed-f18c-4342-ae63-1b7057dd3bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:17.889494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbaaed-f18c-4342-ae63-1b7057dd3bea admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:17.890253 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbaaed-f18c-4342-ae63-1b7057dd3bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:17.892756 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbaaed-f18c-4342-ae63-1b7057dd3bea admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:17.910869 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 954/1896] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:00:17.912478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e365a-b1c5-4038-bb6d-34bfd2b8f8de admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:17.926756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e365a-b1c5-4038-bb6d-34bfd2b8f8de admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:17.947473 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b497af9-4e56-4067-9d2f-87636ed944cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:17.947473 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b497af9-4e56-4067-9d2f-87636ed944cb admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:17.947473 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b497af9-4e56-4067-9d2f-87636ed944cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:17.947473 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b497af9-4e56-4067-9d2f-87636ed944cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:17.947916 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b497af9-4e56-4067-9d2f-87636ed944cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:17.947916 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b497af9-4e56-4067-9d2f-87636ed944cb admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:17.954951 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 943/1897] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:17.959285 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbaaed-f18c-4342-ae63-1b7057dd3bea admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:17.981736 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbaaed-f18c-4342-ae63-1b7057dd3bea admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:17.987422 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e8239-11d7-43ec-963d-34c9befc9238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:17.988489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e8239-11d7-43ec-963d-34c9befc9238 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:17.989453 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e8239-11d7-43ec-963d-34c9befc9238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:17.990998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e8239-11d7-43ec-963d-34c9befc9238 admin admin] PATH_INFO: `/v3/projects/39d0ee8cff0f4a42a143331b37cb3656/users/2322af42aa374c6c938db2fabefc17cb/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:18.007694 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e8239-11d7-43ec-963d-34c9befc9238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d0ee8cff0f4a42a143331b37cb3656, user_id=2322af42aa374c6c938db2fabefc17cb, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:18.010367 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e8239-11d7-43ec-963d-34c9befc9238 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:18.132852 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 955/1898] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:17 2022] PUT /identity/v3/projects/39d0ee8cff0f4a42a143331b37cb3656/users/2322af42aa374c6c938db2fabefc17cb/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:18.147308 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfd067-afc1-42a5-b6ba-88d8162e4ba1 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:18.147669 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfd067-afc1-42a5-b6ba-88d8162e4ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:18.148094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfd067-afc1-42a5-b6ba-88d8162e4ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:18.180918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-35dfd067-afc1-42a5-b6ba-88d8162e4ba1 None None] MFA Rules not processed for user `2322af42aa374c6c938db2fabefc17cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:18.182131 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-35dfd067-afc1-42a5-b6ba-88d8162e4ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:18.246183 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 944/1899] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:18.250622 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e8239-11d7-43ec-963d-34c9befc9238 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:18.253632 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfd067-afc1-42a5-b6ba-88d8162e4ba1 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:18.254980 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-35dfd067-afc1-42a5-b6ba-88d8162e4ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:18.283015 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:18.316619 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e8239-11d7-43ec-963d-34c9befc9238 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:18.319534 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfd067-afc1-42a5-b6ba-88d8162e4ba1 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:18.322879 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9311d-70aa-4090-9dfd-2fcc83431ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:18.323717 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9311d-70aa-4090-9dfd-2fcc83431ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:18.324008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9311d-70aa-4090-9dfd-2fcc83431ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:18.324297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9311d-70aa-4090-9dfd-2fcc83431ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:18.324520 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197301f4-dd1f-4942-9f7b-beb4e5f7898b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:18.324994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9311d-70aa-4090-9dfd-2fcc83431ff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:18.325170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197301f4-dd1f-4942-9f7b-beb4e5f7898b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:18.325458 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197301f4-dd1f-4942-9f7b-beb4e5f7898b admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:18.325738 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197301f4-dd1f-4942-9f7b-beb4e5f7898b admin admin] PATH_INFO: `/v3/users/3e930ad923104016a6ce1d3cf1fd21ec` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:18.326979 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197301f4-dd1f-4942-9f7b-beb4e5f7898b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e930ad923104016a6ce1d3cf1fd21ec)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:18.327077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9311d-70aa-4090-9dfd-2fcc83431ff6 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:18.328939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197301f4-dd1f-4942-9f7b-beb4e5f7898b admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:18.366399 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:18.425086 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 956/1900] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:18 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:00:18.428773 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9311d-70aa-4090-9dfd-2fcc83431ff6 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:18.491232 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9311d-70aa-4090-9dfd-2fcc83431ff6 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:18.496122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8df72c-bd0e-4835-8dd4-c132efdf932a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:18.496740 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8df72c-bd0e-4835-8dd4-c132efdf932a admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:18.497021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8df72c-bd0e-4835-8dd4-c132efdf932a admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:18.497296 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8df72c-bd0e-4835-8dd4-c132efdf932a admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:18.497955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8df72c-bd0e-4835-8dd4-c132efdf932a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:18.499911 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8df72c-bd0e-4835-8dd4-c132efdf932a admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:18.605065 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-197301f4-dd1f-4942-9f7b-beb4e5f7898b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e930ad923104016a6ce1d3cf1fd21ec'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:18.614035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-197301f4-dd1f-4942-9f7b-beb4e5f7898b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e930ad923104016a6ce1d3cf1fd21ec'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:18.619396 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 957/1901] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:18 2022] POST /identity/v3/users => generated 296 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:00:18.623274 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8df72c-bd0e-4835-8dd4-c132efdf932a admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:18.635338 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8df72c-bd0e-4835-8dd4-c132efdf932a admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:18.641658 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e46e7-f941-49f1-a935-8bf065f3e1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:18.642020 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e46e7-f941-49f1-a935-8bf065f3e1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:18.642425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e46e7-f941-49f1-a935-8bf065f3e1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:18.642881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e46e7-f941-49f1-a935-8bf065f3e1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:18.643855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e46e7-f941-49f1-a935-8bf065f3e1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:18.646150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e46e7-f941-49f1-a935-8bf065f3e1e2 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:18.658504 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 958/1902] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:00:18.663889 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e46e7-f941-49f1-a935-8bf065f3e1e2 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:18.680112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e46e7-f941-49f1-a935-8bf065f3e1e2 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:18.689518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28425d3d-4467-4c14-9453-8f7ab5dd374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:18.691847 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28425d3d-4467-4c14-9453-8f7ab5dd374b admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:18.692153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28425d3d-4467-4c14-9453-8f7ab5dd374b admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:18.697397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28425d3d-4467-4c14-9453-8f7ab5dd374b admin admin] PATH_INFO: `/v3/projects/5ac48fea0d4442f28dd5f57f699735f5/users/943daff295274e438424a2e3a5fef273/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:18.724000 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-197301f4-dd1f-4942-9f7b-beb4e5f7898b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e930ad923104016a6ce1d3cf1fd21ec'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:18.726221 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-197301f4-dd1f-4942-9f7b-beb4e5f7898b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e930ad923104016a6ce1d3cf1fd21ec'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:18.728756 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28425d3d-4467-4c14-9453-8f7ab5dd374b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ac48fea0d4442f28dd5f57f699735f5, user_id=943daff295274e438424a2e3a5fef273, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:18.735686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28425d3d-4467-4c14-9453-8f7ab5dd374b admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:18.758838 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-197301f4-dd1f-4942-9f7b-beb4e5f7898b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e930ad923104016a6ce1d3cf1fd21ec'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:18.767678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 945/1903] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:18 2022] DELETE /identity/v3/users/3e930ad923104016a6ce1d3cf1fd21ec => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:18.777135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d8780-5afb-4097-b848-4a56e5cf5f79 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:18.777428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d8780-5afb-4097-b848-4a56e5cf5f79 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:18.777715 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d8780-5afb-4097-b848-4a56e5cf5f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:18.805902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-b71d8780-5afb-4097-b848-4a56e5cf5f79 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:18.807252 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b71d8780-5afb-4097-b848-4a56e5cf5f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:18.831739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 959/1904] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:18 2022] PUT /identity/v3/projects/5ac48fea0d4442f28dd5f57f699735f5/users/943daff295274e438424a2e3a5fef273/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:18.832966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28425d3d-4467-4c14-9453-8f7ab5dd374b admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:18.835342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-28425d3d-4467-4c14-9453-8f7ab5dd374b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:18.918624 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 946/1905] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:18.929842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d8780-5afb-4097-b848-4a56e5cf5f79 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:18.931779 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b71d8780-5afb-4097-b848-4a56e5cf5f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:19.002330 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28425d3d-4467-4c14-9453-8f7ab5dd374b admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:19.014377 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f826495-eee5-4e1f-8bbb-71ffd57826ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:19.015234 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826495-eee5-4e1f-8bbb-71ffd57826ff admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:19.015619 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826495-eee5-4e1f-8bbb-71ffd57826ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:19.015965 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826495-eee5-4e1f-8bbb-71ffd57826ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:19.016763 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f826495-eee5-4e1f-8bbb-71ffd57826ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:19.018470 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f826495-eee5-4e1f-8bbb-71ffd57826ff admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:19.024877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d8780-5afb-4097-b848-4a56e5cf5f79 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:19.067066 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 960/1906] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:19.067066 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f826495-eee5-4e1f-8bbb-71ffd57826ff admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:19.086578 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:19.099238 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f826495-eee5-4e1f-8bbb-71ffd57826ff admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:19.114597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83169c-8af5-48bd-bd06-f8847d3a9342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:19.115339 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83169c-8af5-48bd-bd06-f8847d3a9342 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:19.115626 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83169c-8af5-48bd-bd06-f8847d3a9342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:19.115908 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83169c-8af5-48bd-bd06-f8847d3a9342 admin admin] PATH_INFO: `/v3/projects/5ac48fea0d4442f28dd5f57f699735f5/users/943daff295274e438424a2e3a5fef273/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:19.122186 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83169c-8af5-48bd-bd06-f8847d3a9342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ac48fea0d4442f28dd5f57f699735f5, user_id=943daff295274e438424a2e3a5fef273, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:19.128598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83169c-8af5-48bd-bd06-f8847d3a9342 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:19.143596 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f514f-4ec9-4fe4-ad1d-6206e1658a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:19.145984 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f514f-4ec9-4fe4-ad1d-6206e1658a62 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:19.147151 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f514f-4ec9-4fe4-ad1d-6206e1658a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:19.147507 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f514f-4ec9-4fe4-ad1d-6206e1658a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:19.149153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 961/1907] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:19 2022] PUT /identity/v3/projects/5ac48fea0d4442f28dd5f57f699735f5/users/943daff295274e438424a2e3a5fef273/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:19.162404 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de4e7c-a098-42b2-8044-32ab793311bc None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:19.162775 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de4e7c-a098-42b2-8044-32ab793311bc None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:19.171561 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de4e7c-a098-42b2-8044-32ab793311bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:19.193408 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f514f-4ec9-4fe4-ad1d-6206e1658a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:19.196088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f514f-4ec9-4fe4-ad1d-6206e1658a62 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:19.213723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 947/1908] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:19.225477 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-61de4e7c-a098-42b2-8044-32ab793311bc None None] MFA Rules not processed for user `943daff295274e438424a2e3a5fef273`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:19.227055 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-61de4e7c-a098-42b2-8044-32ab793311bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:19.249488 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:19.390169 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 962/1909] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:00:19.403177 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f514f-4ec9-4fe4-ad1d-6206e1658a62 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:19.406030 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-fd4f514f-4ec9-4fe4-ad1d-6206e1658a62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:19.513921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f514f-4ec9-4fe4-ad1d-6206e1658a62 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:19.572727 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ead530-302b-4aed-b6d6-cd1e950ebe1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:19.573364 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ead530-302b-4aed-b6d6-cd1e950ebe1a service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:19.573649 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ead530-302b-4aed-b6d6-cd1e950ebe1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:19.573922 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ead530-302b-4aed-b6d6-cd1e950ebe1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:19.584149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ead530-302b-4aed-b6d6-cd1e950ebe1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:19.585622 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ead530-302b-4aed-b6d6-cd1e950ebe1a service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:19.625547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 948/1910] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:20.108588 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de4e7c-a098-42b2-8044-32ab793311bc None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:20.110648 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-61de4e7c-a098-42b2-8044-32ab793311bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:20.120128 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ead530-302b-4aed-b6d6-cd1e950ebe1a service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:20.122254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-03ead530-302b-4aed-b6d6-cd1e950ebe1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:20.238589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de4e7c-a098-42b2-8044-32ab793311bc None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:20.245711 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bac08-13c4-487d-aa15-52ce882e1d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:20.246912 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ead530-302b-4aed-b6d6-cd1e950ebe1a service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:20.247558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bac08-13c4-487d-aa15-52ce882e1d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:20.252614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bac08-13c4-487d-aa15-52ce882e1d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:20.253119 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bac08-13c4-487d-aa15-52ce882e1d0d admin admin] PATH_INFO: `/v3/projects/2288266a1bf943a4aaa8cbe17ae272f2` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:20.254574 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bac08-13c4-487d-aa15-52ce882e1d0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2288266a1bf943a4aaa8cbe17ae272f2)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:20.255986 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1eaac0-b853-4695-bd9a-57d5fefe524b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:20.256518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bac08-13c4-487d-aa15-52ce882e1d0d admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:20.257088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1eaac0-b853-4695-bd9a-57d5fefe524b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:20.258067 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1eaac0-b853-4695-bd9a-57d5fefe524b admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:20.258606 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1eaac0-b853-4695-bd9a-57d5fefe524b admin admin] PATH_INFO: `/v3/users/1f1b37ac88024c368f14631817c5a144` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:20.260304 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1eaac0-b853-4695-bd9a-57d5fefe524b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f1b37ac88024c368f14631817c5a144)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:20.263867 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1eaac0-b853-4695-bd9a-57d5fefe524b admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:20.388498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d05bac08-13c4-487d-aa15-52ce882e1d0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2288266a1bf943a4aaa8cbe17ae272f2', 'request_id': 'req-d05bac08-13c4-487d-aa15-52ce882e1d0d'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:20.395144 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d05bac08-13c4-487d-aa15-52ce882e1d0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2288266a1bf943a4aaa8cbe17ae272f2', 'request_id': 'req-d05bac08-13c4-487d-aa15-52ce882e1d0d'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:20.466413 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d05bac08-13c4-487d-aa15-52ce882e1d0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2288266a1bf943a4aaa8cbe17ae272f2', 'request_id': 'req-d05bac08-13c4-487d-aa15-52ce882e1d0d'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:20.480189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d05bac08-13c4-487d-aa15-52ce882e1d0d admin admin] The token cache is being invalidate because project 2288266a1bf943a4aaa8cbe17ae272f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:20.480566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d05bac08-13c4-487d-aa15-52ce882e1d0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:20.481467 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d05bac08-13c4-487d-aa15-52ce882e1d0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:20.482047 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-da1eaac0-b853-4695-bd9a-57d5fefe524b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f1b37ac88024c368f14631817c5a144'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:20.483165 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 963/1911] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:20 2022] DELETE /identity/v3/projects/2288266a1bf943a4aaa8cbe17ae272f2 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:20.484209 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bac08-13c4-487d-aa15-52ce882e1d0d admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:20.485761 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d05bac08-13c4-487d-aa15-52ce882e1d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:20.492672 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:20.494702 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-da1eaac0-b853-4695-bd9a-57d5fefe524b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f1b37ac88024c368f14631817c5a144'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:20.546887 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:20.569299 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bac08-13c4-487d-aa15-52ce882e1d0d admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:20.575003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91e85f-8d6e-4623-bea6-74a7acc36948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:20.575674 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91e85f-8d6e-4623-bea6-74a7acc36948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:20.575961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91e85f-8d6e-4623-bea6-74a7acc36948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:20.576242 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91e85f-8d6e-4623-bea6-74a7acc36948 admin admin] PATH_INFO: `/v3/users/2322af42aa374c6c938db2fabefc17cb` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:20.577593 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91e85f-8d6e-4623-bea6-74a7acc36948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2322af42aa374c6c938db2fabefc17cb)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:20.579722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91e85f-8d6e-4623-bea6-74a7acc36948 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:20.609686 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-da1eaac0-b853-4695-bd9a-57d5fefe524b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f1b37ac88024c368f14631817c5a144'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:20.610898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-da1eaac0-b853-4695-bd9a-57d5fefe524b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f1b37ac88024c368f14631817c5a144'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:20.627279 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-da1eaac0-b853-4695-bd9a-57d5fefe524b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f1b37ac88024c368f14631817c5a144'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:20.641781 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 949/1912] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:20 2022] DELETE /identity/v3/users/1f1b37ac88024c368f14631817c5a144 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:20.641781 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1eaac0-b853-4695-bd9a-57d5fefe524b admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:20.642062 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-da1eaac0-b853-4695-bd9a-57d5fefe524b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:20.721891 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1eaac0-b853-4695-bd9a-57d5fefe524b admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:20.726621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d839b3-e96f-4a8f-b542-729e684c6cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:20.727255 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d839b3-e96f-4a8f-b542-729e684c6cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:20.727542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d839b3-e96f-4a8f-b542-729e684c6cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:20.727820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d839b3-e96f-4a8f-b542-729e684c6cf4 admin admin] PATH_INFO: `/v3/users/3c224b0eee074a3d80cf96ae6a4b15fb` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:20.728995 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d839b3-e96f-4a8f-b542-729e684c6cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c224b0eee074a3d80cf96ae6a4b15fb)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:20.730983 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d839b3-e96f-4a8f-b542-729e684c6cf4 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:20.802317 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-bc91e85f-8d6e-4623-bea6-74a7acc36948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2322af42aa374c6c938db2fabefc17cb'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:20.809610 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-bc91e85f-8d6e-4623-bea6-74a7acc36948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2322af42aa374c6c938db2fabefc17cb'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:20.810285 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-bc91e85f-8d6e-4623-bea6-74a7acc36948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2322af42aa374c6c938db2fabefc17cb'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:20.822983 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-bc91e85f-8d6e-4623-bea6-74a7acc36948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2322af42aa374c6c938db2fabefc17cb'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:20.823711 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-bc91e85f-8d6e-4623-bea6-74a7acc36948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2322af42aa374c6c938db2fabefc17cb'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:20.928835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 964/1913] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:20 2022] DELETE /identity/v3/users/2322af42aa374c6c938db2fabefc17cb => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:20.931034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc57d1-6941-4fe4-96b9-35f3803f606b None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:20.931357 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc57d1-6941-4fe4-96b9-35f3803f606b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:20.931645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc57d1-6941-4fe4-96b9-35f3803f606b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:20.937334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-23d839b3-e96f-4a8f-b542-729e684c6cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c224b0eee074a3d80cf96ae6a4b15fb'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:20.944251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-23d839b3-e96f-4a8f-b542-729e684c6cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c224b0eee074a3d80cf96ae6a4b15fb'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:20.952057 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-90bc57d1-6941-4fe4-96b9-35f3803f606b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:20.953301 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-90bc57d1-6941-4fe4-96b9-35f3803f606b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:21.013302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 965/1914] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:21.014796 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a16585-f4ea-4a64-8ed7-5861528e49b3 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:21.015105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a16585-f4ea-4a64-8ed7-5861528e49b3 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:21.015377 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a16585-f4ea-4a64-8ed7-5861528e49b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:21.034080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-84a16585-f4ea-4a64-8ed7-5861528e49b3 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:21.035313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-84a16585-f4ea-4a64-8ed7-5861528e49b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:21.043320 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 966/1915] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:21.044241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a16585-f4ea-4a64-8ed7-5861528e49b3 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:21.045425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-84a16585-f4ea-4a64-8ed7-5861528e49b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:21.052296 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-23d839b3-e96f-4a8f-b542-729e684c6cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c224b0eee074a3d80cf96ae6a4b15fb'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:21.055334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-23d839b3-e96f-4a8f-b542-729e684c6cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c224b0eee074a3d80cf96ae6a4b15fb'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:21.067807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-23d839b3-e96f-4a8f-b542-729e684c6cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c224b0eee074a3d80cf96ae6a4b15fb'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:21.078229 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 950/1916] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:20 2022] DELETE /identity/v3/users/3c224b0eee074a3d80cf96ae6a4b15fb => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:21.079217 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d839b3-e96f-4a8f-b542-729e684c6cf4 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:21.080884 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-23d839b3-e96f-4a8f-b542-729e684c6cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:21.125756 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a16585-f4ea-4a64-8ed7-5861528e49b3 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:21.149949 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d839b3-e96f-4a8f-b542-729e684c6cf4 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:21.168032 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67429f5-cf7f-43b3-baba-aed686cebdbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:21.168954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67429f5-cf7f-43b3-baba-aed686cebdbc service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:21.169410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67429f5-cf7f-43b3-baba-aed686cebdbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:21.169959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67429f5-cf7f-43b3-baba-aed686cebdbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:21.176215 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b67429f5-cf7f-43b3-baba-aed686cebdbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:21.189352 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b89e2-0aba-4abf-8eef-cdc4d9796f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:21.190335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b89e2-0aba-4abf-8eef-cdc4d9796f5e service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:21.190702 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b89e2-0aba-4abf-8eef-cdc4d9796f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:21.191081 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b89e2-0aba-4abf-8eef-cdc4d9796f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:21.193093 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-4b1b89e2-0aba-4abf-8eef-cdc4d9796f5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:21.271632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b89e2-0aba-4abf-8eef-cdc4d9796f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:21.273746 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b89e2-0aba-4abf-8eef-cdc4d9796f5e service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:21.277779 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67429f5-cf7f-43b3-baba-aed686cebdbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:21.279792 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67429f5-cf7f-43b3-baba-aed686cebdbc service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:21.286773 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 967/1917] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:21.294780 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 951/1918] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:21.655053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:21.950037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:21.986545 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b89e2-0aba-4abf-8eef-cdc4d9796f5e service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:21.990405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-4b1b89e2-0aba-4abf-8eef-cdc4d9796f5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:21.991624 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67429f5-cf7f-43b3-baba-aed686cebdbc service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:21.993291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b67429f5-cf7f-43b3-baba-aed686cebdbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:22.005637 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67429f5-cf7f-43b3-baba-aed686cebdbc service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:22.013011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ded3ff-de00-4dbe-81f1-0c2b1ce4d3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:22.013673 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ded3ff-de00-4dbe-81f1-0c2b1ce4d3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:22.014156 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ded3ff-de00-4dbe-81f1-0c2b1ce4d3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:22.014628 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ded3ff-de00-4dbe-81f1-0c2b1ce4d3cf admin admin] PATH_INFO: `/v3/projects/ae6d869c306d40afb41fabb0e1d7c1bc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:22.016299 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ded3ff-de00-4dbe-81f1-0c2b1ce4d3cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae6d869c306d40afb41fabb0e1d7c1bc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:22.019524 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ded3ff-de00-4dbe-81f1-0c2b1ce4d3cf admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:22.034592 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b89e2-0aba-4abf-8eef-cdc4d9796f5e service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:22.046447 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704d51c-257c-446c-9c86-e8570e38c770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:22.047132 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704d51c-257c-446c-9c86-e8570e38c770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:22.047425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704d51c-257c-446c-9c86-e8570e38c770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:22.047706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704d51c-257c-446c-9c86-e8570e38c770 admin admin] PATH_INFO: `/v3/projects/39d0ee8cff0f4a42a143331b37cb3656` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:22.049688 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704d51c-257c-446c-9c86-e8570e38c770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d0ee8cff0f4a42a143331b37cb3656)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:22.055060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704d51c-257c-446c-9c86-e8570e38c770 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:22.162603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-55ded3ff-de00-4dbe-81f1-0c2b1ce4d3cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6d869c306d40afb41fabb0e1d7c1bc', 'request_id': 'req-55ded3ff-de00-4dbe-81f1-0c2b1ce4d3cf'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.170376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-55ded3ff-de00-4dbe-81f1-0c2b1ce4d3cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6d869c306d40afb41fabb0e1d7c1bc', 'request_id': 'req-55ded3ff-de00-4dbe-81f1-0c2b1ce4d3cf'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.198028 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7704d51c-257c-446c-9c86-e8570e38c770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d0ee8cff0f4a42a143331b37cb3656', 'request_id': 'req-7704d51c-257c-446c-9c86-e8570e38c770'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.204385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7704d51c-257c-446c-9c86-e8570e38c770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d0ee8cff0f4a42a143331b37cb3656', 'request_id': 'req-7704d51c-257c-446c-9c86-e8570e38c770'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.272526 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-55ded3ff-de00-4dbe-81f1-0c2b1ce4d3cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6d869c306d40afb41fabb0e1d7c1bc', 'request_id': 'req-55ded3ff-de00-4dbe-81f1-0c2b1ce4d3cf'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.287611 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-55ded3ff-de00-4dbe-81f1-0c2b1ce4d3cf admin admin] The token cache is being invalidate because project ae6d869c306d40afb41fabb0e1d7c1bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:22.287773 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-55ded3ff-de00-4dbe-81f1-0c2b1ce4d3cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.304296 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-55ded3ff-de00-4dbe-81f1-0c2b1ce4d3cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.304296 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 952/1919] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:21 2022] DELETE /identity/v3/projects/ae6d869c306d40afb41fabb0e1d7c1bc => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:22.307483 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ded3ff-de00-4dbe-81f1-0c2b1ce4d3cf admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:22.310505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-55ded3ff-de00-4dbe-81f1-0c2b1ce4d3cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:22.323580 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7704d51c-257c-446c-9c86-e8570e38c770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d0ee8cff0f4a42a143331b37cb3656', 'request_id': 'req-7704d51c-257c-446c-9c86-e8570e38c770'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.340309 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7704d51c-257c-446c-9c86-e8570e38c770 admin admin] The token cache is being invalidate because project 39d0ee8cff0f4a42a143331b37cb3656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:22.340398 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7704d51c-257c-446c-9c86-e8570e38c770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.341040 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7704d51c-257c-446c-9c86-e8570e38c770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.342575 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 968/1920] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:21 2022] DELETE /identity/v3/projects/39d0ee8cff0f4a42a143331b37cb3656 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:22.355495 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704d51c-257c-446c-9c86-e8570e38c770 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:22.357199 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-7704d51c-257c-446c-9c86-e8570e38c770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:22.390924 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ded3ff-de00-4dbe-81f1-0c2b1ce4d3cf admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:22.438353 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704d51c-257c-446c-9c86-e8570e38c770 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:22.451597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdc45d-5ebf-4029-818d-45da14022bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:22.451597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdc45d-5ebf-4029-818d-45da14022bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:22.451597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdc45d-5ebf-4029-818d-45da14022bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:22.451597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdc45d-5ebf-4029-818d-45da14022bc1 admin admin] PATH_INFO: `/v3/users/943daff295274e438424a2e3a5fef273` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:22.452178 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdc45d-5ebf-4029-818d-45da14022bc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=943daff295274e438424a2e3a5fef273)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:22.453286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdc45d-5ebf-4029-818d-45da14022bc1 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:22.455338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622abbf-293c-43ca-a939-0bf0eb2e4ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:22.456040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622abbf-293c-43ca-a939-0bf0eb2e4ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:22.456334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622abbf-293c-43ca-a939-0bf0eb2e4ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:22.456642 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622abbf-293c-43ca-a939-0bf0eb2e4ab4 admin admin] PATH_INFO: `/v3/users/2f27c99730764f76b464ca6d2a1c74e9` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:22.457844 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622abbf-293c-43ca-a939-0bf0eb2e4ab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f27c99730764f76b464ca6d2a1c74e9)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:22.459827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622abbf-293c-43ca-a939-0bf0eb2e4ab4 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:22.702239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-4622abbf-293c-43ca-a939-0bf0eb2e4ab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f27c99730764f76b464ca6d2a1c74e9'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.703399 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-23fdc45d-5ebf-4029-818d-45da14022bc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '943daff295274e438424a2e3a5fef273'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.709150 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-4622abbf-293c-43ca-a939-0bf0eb2e4ab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f27c99730764f76b464ca6d2a1c74e9'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.710184 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-23fdc45d-5ebf-4029-818d-45da14022bc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '943daff295274e438424a2e3a5fef273'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.711394 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-23fdc45d-5ebf-4029-818d-45da14022bc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '943daff295274e438424a2e3a5fef273'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.731544 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-23fdc45d-5ebf-4029-818d-45da14022bc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '943daff295274e438424a2e3a5fef273'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.732246 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-23fdc45d-5ebf-4029-818d-45da14022bc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '943daff295274e438424a2e3a5fef273'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.768807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-4622abbf-293c-43ca-a939-0bf0eb2e4ab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f27c99730764f76b464ca6d2a1c74e9'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.769444 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-4622abbf-293c-43ca-a939-0bf0eb2e4ab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f27c99730764f76b464ca6d2a1c74e9'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.782417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-4622abbf-293c-43ca-a939-0bf0eb2e4ab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f27c99730764f76b464ca6d2a1c74e9'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.788345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 953/1921] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:22 2022] DELETE /identity/v3/users/2f27c99730764f76b464ca6d2a1c74e9 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:22.789684 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622abbf-293c-43ca-a939-0bf0eb2e4ab4 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:22.792108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-4622abbf-293c-43ca-a939-0bf0eb2e4ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:22.827190 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 969/1922] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:22 2022] DELETE /identity/v3/users/943daff295274e438424a2e3a5fef273 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:22.864843 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622abbf-293c-43ca-a939-0bf0eb2e4ab4 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:22.946788 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e212c0-3ecc-4a25-9340-5f953e30c7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:22.947770 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e212c0-3ecc-4a25-9340-5f953e30c7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:22.947866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e212c0-3ecc-4a25-9340-5f953e30c7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:22.948135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e212c0-3ecc-4a25-9340-5f953e30c7bf admin admin] PATH_INFO: `/v3/projects/62fae18c54624497b30fb95f0ab2e966` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:22.949596 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e212c0-3ecc-4a25-9340-5f953e30c7bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=62fae18c54624497b30fb95f0ab2e966)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:22.951904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e212c0-3ecc-4a25-9340-5f953e30c7bf admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:23.078260 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e5e212c0-3ecc-4a25-9340-5f953e30c7bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62fae18c54624497b30fb95f0ab2e966', 'request_id': 'req-e5e212c0-3ecc-4a25-9340-5f953e30c7bf'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:23.081567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e5e212c0-3ecc-4a25-9340-5f953e30c7bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62fae18c54624497b30fb95f0ab2e966', 'request_id': 'req-e5e212c0-3ecc-4a25-9340-5f953e30c7bf'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:23.158993 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e5e212c0-3ecc-4a25-9340-5f953e30c7bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62fae18c54624497b30fb95f0ab2e966', 'request_id': 'req-e5e212c0-3ecc-4a25-9340-5f953e30c7bf'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:23.173430 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e5e212c0-3ecc-4a25-9340-5f953e30c7bf admin admin] The token cache is being invalidate because project 62fae18c54624497b30fb95f0ab2e966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:23.174584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e5e212c0-3ecc-4a25-9340-5f953e30c7bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:23.175528 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e5e212c0-3ecc-4a25-9340-5f953e30c7bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:23.178710 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 954/1923] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:22 2022] DELETE /identity/v3/projects/62fae18c54624497b30fb95f0ab2e966 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:23.183388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b247abd-0af2-4f70-a848-11ace5314f28 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.183671 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b247abd-0af2-4f70-a848-11ace5314f28 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.187063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b247abd-0af2-4f70-a848-11ace5314f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.221046 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-4b247abd-0af2-4f70-a848-11ace5314f28 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:23.224415 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-4b247abd-0af2-4f70-a848-11ace5314f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:23.317503 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 970/1924] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:23.327210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc20d5e-44cb-489d-a52b-fa82b6f1ebcc None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.327798 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc20d5e-44cb-489d-a52b-fa82b6f1ebcc None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.328317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc20d5e-44cb-489d-a52b-fa82b6f1ebcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.360483 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-cfc20d5e-44cb-489d-a52b-fa82b6f1ebcc None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:23.360843 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b247abd-0af2-4f70-a848-11ace5314f28 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:23.362585 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-cfc20d5e-44cb-489d-a52b-fa82b6f1ebcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:23.363782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-4b247abd-0af2-4f70-a848-11ace5314f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:23.386228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:23.386458 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b247abd-0af2-4f70-a848-11ace5314f28 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:23.390984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ac7ee-be45-425b-9f71-72dfc2f04796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:23.391899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ac7ee-be45-425b-9f71-72dfc2f04796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.392334 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ac7ee-be45-425b-9f71-72dfc2f04796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.392757 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ac7ee-be45-425b-9f71-72dfc2f04796 admin admin] PATH_INFO: `/v3/projects/6e6d18656c3b432d84c634005bbf2f6d` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.401257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 955/1925] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:23.409470 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ac7ee-be45-425b-9f71-72dfc2f04796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e6d18656c3b432d84c634005bbf2f6d)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:23.412285 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ac7ee-be45-425b-9f71-72dfc2f04796 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:23.413617 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc20d5e-44cb-489d-a52b-fa82b6f1ebcc None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:23.432647 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc20d5e-44cb-489d-a52b-fa82b6f1ebcc None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:23.438436 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36028e06-ef84-4246-aa90-58b1908cdfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:23.439775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36028e06-ef84-4246-aa90-58b1908cdfdb admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.440251 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36028e06-ef84-4246-aa90-58b1908cdfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.440712 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36028e06-ef84-4246-aa90-58b1908cdfdb admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.442448 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36028e06-ef84-4246-aa90-58b1908cdfdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:00:23.443519 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36028e06-ef84-4246-aa90-58b1908cdfdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:23.446241 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36028e06-ef84-4246-aa90-58b1908cdfdb admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:23.462252 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 956/1926] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:00:23.467140 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36028e06-ef84-4246-aa90-58b1908cdfdb admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:23.482546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36028e06-ef84-4246-aa90-58b1908cdfdb admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:23.488267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061092f-5bb2-491c-adbb-086f7c206d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:23.488927 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061092f-5bb2-491c-adbb-086f7c206d3e admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.489324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061092f-5bb2-491c-adbb-086f7c206d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.489620 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061092f-5bb2-491c-adbb-086f7c206d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.490393 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061092f-5bb2-491c-adbb-086f7c206d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:23.493445 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061092f-5bb2-491c-adbb-086f7c206d3e admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:23.553725 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b47ac7ee-be45-425b-9f71-72dfc2f04796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e6d18656c3b432d84c634005bbf2f6d', 'request_id': 'req-b47ac7ee-be45-425b-9f71-72dfc2f04796'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:23.560494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b47ac7ee-be45-425b-9f71-72dfc2f04796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e6d18656c3b432d84c634005bbf2f6d', 'request_id': 'req-b47ac7ee-be45-425b-9f71-72dfc2f04796'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:23.594999 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 957/1927] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:23 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:00:23.599350 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061092f-5bb2-491c-adbb-086f7c206d3e admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:23.655382 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b47ac7ee-be45-425b-9f71-72dfc2f04796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e6d18656c3b432d84c634005bbf2f6d', 'request_id': 'req-b47ac7ee-be45-425b-9f71-72dfc2f04796'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:23.681597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061092f-5bb2-491c-adbb-086f7c206d3e admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:23.683953 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:23.686761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a5e72-91fa-409a-9f29-38640a4ef4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:23.689132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a5e72-91fa-409a-9f29-38640a4ef4ff admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.689132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a5e72-91fa-409a-9f29-38640a4ef4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.689132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a5e72-91fa-409a-9f29-38640a4ef4ff admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.689132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a5e72-91fa-409a-9f29-38640a4ef4ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:23.689432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b47ac7ee-be45-425b-9f71-72dfc2f04796 admin admin] The token cache is being invalidate because project 6e6d18656c3b432d84c634005bbf2f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:23.689432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b47ac7ee-be45-425b-9f71-72dfc2f04796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:23.691179 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b47ac7ee-be45-425b-9f71-72dfc2f04796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:23.693491 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a5e72-91fa-409a-9f29-38640a4ef4ff admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:23.696674 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 971/1928] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:23 2022] DELETE /identity/v3/projects/6e6d18656c3b432d84c634005bbf2f6d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:23.703231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93854825-cd94-4ce1-81cc-5a4b257bb831 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.703522 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93854825-cd94-4ce1-81cc-5a4b257bb831 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.704829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93854825-cd94-4ce1-81cc-5a4b257bb831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.731550 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-93854825-cd94-4ce1-81cc-5a4b257bb831 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:23.732880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-93854825-cd94-4ce1-81cc-5a4b257bb831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:23.745975 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 972/1929] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:23.762391 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04891bec-c9a6-4924-8580-74e6ec29bded None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.762786 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04891bec-c9a6-4924-8580-74e6ec29bded None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.763183 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04891bec-c9a6-4924-8580-74e6ec29bded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.795405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-04891bec-c9a6-4924-8580-74e6ec29bded None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:23.796663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-04891bec-c9a6-4924-8580-74e6ec29bded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:23.814413 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 973/1930] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:00:23.818110 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04891bec-c9a6-4924-8580-74e6ec29bded None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:23.838513 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04891bec-c9a6-4924-8580-74e6ec29bded None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:23.844149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 958/1931] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:23 2022] POST /identity/v3/users => generated 290 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:23.845144 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a5e72-91fa-409a-9f29-38640a4ef4ff admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:23.847121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-6f6a5e72-91fa-409a-9f29-38640a4ef4ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:23.853868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eef939-f3da-4bcb-afae-2eff51a570c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:23.854969 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eef939-f3da-4bcb-afae-2eff51a570c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.855971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eef939-f3da-4bcb-afae-2eff51a570c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.856505 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eef939-f3da-4bcb-afae-2eff51a570c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.857425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eef939-f3da-4bcb-afae-2eff51a570c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:00:23.857990 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eef939-f3da-4bcb-afae-2eff51a570c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:23.859930 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eef939-f3da-4bcb-afae-2eff51a570c8 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:23.862392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a5e72-91fa-409a-9f29-38640a4ef4ff admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:23.875770 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119491a-a100-48d6-8173-4505f7c4fdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:23.877053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119491a-a100-48d6-8173-4505f7c4fdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.877534 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119491a-a100-48d6-8173-4505f7c4fdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.877954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119491a-a100-48d6-8173-4505f7c4fdb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.879005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119491a-a100-48d6-8173-4505f7c4fdb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:23.881383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119491a-a100-48d6-8173-4505f7c4fdb8 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:23.884526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 974/1932] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:00:23.893979 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eef939-f3da-4bcb-afae-2eff51a570c8 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:23.897302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-97eef939-f3da-4bcb-afae-2eff51a570c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:23.900432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 959/1933] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:23.901389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119491a-a100-48d6-8173-4505f7c4fdb8 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:23.912383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119491a-a100-48d6-8173-4505f7c4fdb8 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:23.913215 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eef939-f3da-4bcb-afae-2eff51a570c8 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:23.918049 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d673e-115e-4ecd-8004-b454e76261ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:23.918831 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d673e-115e-4ecd-8004-b454e76261ad admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.919128 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d673e-115e-4ecd-8004-b454e76261ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.919414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d673e-115e-4ecd-8004-b454e76261ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.919935 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3dd0e-7bc3-4f68-ada2-8c73ee1725c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:23.920082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d673e-115e-4ecd-8004-b454e76261ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:23.920681 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3dd0e-7bc3-4f68-ada2-8c73ee1725c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.921045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3dd0e-7bc3-4f68-ada2-8c73ee1725c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.921387 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3dd0e-7bc3-4f68-ada2-8c73ee1725c1 admin admin] PATH_INFO: `/v3/projects/5ac48fea0d4442f28dd5f57f699735f5` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.922238 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d673e-115e-4ecd-8004-b454e76261ad admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:23.922863 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3dd0e-7bc3-4f68-ada2-8c73ee1725c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ac48fea0d4442f28dd5f57f699735f5)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:23.925556 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3dd0e-7bc3-4f68-ada2-8c73ee1725c1 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:24.043239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 960/1934] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:23 2022] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:24.044777 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d673e-115e-4ecd-8004-b454e76261ad admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:24.076879 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-02a3dd0e-7bc3-4f68-ada2-8c73ee1725c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ac48fea0d4442f28dd5f57f699735f5', 'request_id': 'req-02a3dd0e-7bc3-4f68-ada2-8c73ee1725c1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:24.087682 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-02a3dd0e-7bc3-4f68-ada2-8c73ee1725c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ac48fea0d4442f28dd5f57f699735f5', 'request_id': 'req-02a3dd0e-7bc3-4f68-ada2-8c73ee1725c1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:24.123175 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d673e-115e-4ecd-8004-b454e76261ad admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:24.193112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da6815-ebe5-45a7-9361-6ea77b08fad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:24.193734 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da6815-ebe5-45a7-9361-6ea77b08fad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.194018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da6815-ebe5-45a7-9361-6ea77b08fad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.194401 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da6815-ebe5-45a7-9361-6ea77b08fad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.195203 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da6815-ebe5-45a7-9361-6ea77b08fad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:24.196793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da6815-ebe5-45a7-9361-6ea77b08fad8 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:24.200739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-02a3dd0e-7bc3-4f68-ada2-8c73ee1725c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ac48fea0d4442f28dd5f57f699735f5', 'request_id': 'req-02a3dd0e-7bc3-4f68-ada2-8c73ee1725c1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:24.209830 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 961/1935] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:24.211390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da6815-ebe5-45a7-9361-6ea77b08fad8 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:24.216063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-02a3dd0e-7bc3-4f68-ada2-8c73ee1725c1 admin admin] The token cache is being invalidate because project 5ac48fea0d4442f28dd5f57f699735f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:24.216833 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-02a3dd0e-7bc3-4f68-ada2-8c73ee1725c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:24.217403 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-02a3dd0e-7bc3-4f68-ada2-8c73ee1725c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:24.222326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da6815-ebe5-45a7-9361-6ea77b08fad8 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:24.222700 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 975/1936] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:23 2022] DELETE /identity/v3/projects/5ac48fea0d4442f28dd5f57f699735f5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:24.223715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3dd0e-7bc3-4f68-ada2-8c73ee1725c1 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:24.225150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-02a3dd0e-7bc3-4f68-ada2-8c73ee1725c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:24.228439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d747d5-3ead-4d19-a98b-28764411bab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:24.229229 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d747d5-3ead-4d19-a98b-28764411bab8 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.229662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d747d5-3ead-4d19-a98b-28764411bab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.230108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d747d5-3ead-4d19-a98b-28764411bab8 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.231017 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d747d5-3ead-4d19-a98b-28764411bab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:24.233112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d747d5-3ead-4d19-a98b-28764411bab8 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:24.241288 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3dd0e-7bc3-4f68-ada2-8c73ee1725c1 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:24.247908 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56207c4-5df1-4212-92d5-90e7126d87a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:24.248896 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56207c4-5df1-4212-92d5-90e7126d87a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.249335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56207c4-5df1-4212-92d5-90e7126d87a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.249765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56207c4-5df1-4212-92d5-90e7126d87a3 admin admin] PATH_INFO: `/v3/projects/4c7af95962764953944061ed194a12ca/users/a67c6e09f3234e7cac6a47193f61664b/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.269123 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56207c4-5df1-4212-92d5-90e7126d87a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c7af95962764953944061ed194a12ca, user_id=a67c6e09f3234e7cac6a47193f61664b, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:24.272367 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56207c4-5df1-4212-92d5-90e7126d87a3 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:24.321372 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 962/1937] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:24 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:24.323023 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc363d-b399-4623-9c46-d6eff1920ef0 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.323317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc363d-b399-4623-9c46-d6eff1920ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.323739 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc363d-b399-4623-9c46-d6eff1920ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.345725 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-b5cc363d-b399-4623-9c46-d6eff1920ef0 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:24.347772 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b5cc363d-b399-4623-9c46-d6eff1920ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:24.349788 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 976/1938] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:24 2022] PUT /identity/v3/projects/4c7af95962764953944061ed194a12ca/users/a67c6e09f3234e7cac6a47193f61664b/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:24.350719 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56207c4-5df1-4212-92d5-90e7126d87a3 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:24.352305 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e56207c4-5df1-4212-92d5-90e7126d87a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:24.432175 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 963/1939] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:24.433377 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d044761-99c3-401d-a374-c3b872f8558b None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.433737 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d044761-99c3-401d-a374-c3b872f8558b None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.434084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d044761-99c3-401d-a374-c3b872f8558b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.483557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-6d044761-99c3-401d-a374-c3b872f8558b None None] MFA Rules not processed for user `a67c6e09f3234e7cac6a47193f61664b`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:24.485071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-6d044761-99c3-401d-a374-c3b872f8558b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:24.496322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56207c4-5df1-4212-92d5-90e7126d87a3 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:24.501193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c0237-40ff-4f37-9676-c166bf554ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:24.501986 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c0237-40ff-4f37-9676-c166bf554ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.502249 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c0237-40ff-4f37-9676-c166bf554ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.502694 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c0237-40ff-4f37-9676-c166bf554ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.503450 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c0237-40ff-4f37-9676-c166bf554ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:24.505066 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c0237-40ff-4f37-9676-c166bf554ba2 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:24.522600 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 977/1940] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:24.524130 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc47517-7ae3-44ff-a71a-32e4fa4fbeab None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.525125 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc47517-7ae3-44ff-a71a-32e4fa4fbeab None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.525428 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc47517-7ae3-44ff-a71a-32e4fa4fbeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.552190 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-3bc47517-7ae3-44ff-a71a-32e4fa4fbeab None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:24.558820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-3bc47517-7ae3-44ff-a71a-32e4fa4fbeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:24.568868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 978/1941] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:24.570786 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc47517-7ae3-44ff-a71a-32e4fa4fbeab None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:24.583075 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc47517-7ae3-44ff-a71a-32e4fa4fbeab None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:24.583186 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 964/1942] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:24.584069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d044761-99c3-401d-a374-c3b872f8558b None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:24.589149 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f0985-ee81-426a-8330-09feae69568e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:24.590023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f0985-ee81-426a-8330-09feae69568e admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.590608 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f0985-ee81-426a-8330-09feae69568e admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.591123 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f0985-ee81-426a-8330-09feae69568e admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.592080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f0985-ee81-426a-8330-09feae69568e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:24.594216 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f0985-ee81-426a-8330-09feae69568e admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:24.597548 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d044761-99c3-401d-a374-c3b872f8558b None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:24.604087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9f6ec-ed0b-47ce-b311-d5398400f29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:24.605547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9f6ec-ed0b-47ce-b311-d5398400f29f admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.605547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9f6ec-ed0b-47ce-b311-d5398400f29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.606599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9f6ec-ed0b-47ce-b311-d5398400f29f admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.607400 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9f6ec-ed0b-47ce-b311-d5398400f29f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:00:24.607712 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9f6ec-ed0b-47ce-b311-d5398400f29f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:24.609393 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9f6ec-ed0b-47ce-b311-d5398400f29f admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:24.610254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 979/1943] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:24.611424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f0985-ee81-426a-8330-09feae69568e admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:24.622331 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f0985-ee81-426a-8330-09feae69568e admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:24.633802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 965/1944] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:00:24.634484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9f6ec-ed0b-47ce-b311-d5398400f29f admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:24.640077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a82234-d512-465f-a5c3-8badfcf97d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:24.641385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a82234-d512-465f-a5c3-8badfcf97d2e admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.641679 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a82234-d512-465f-a5c3-8badfcf97d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.641966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a82234-d512-465f-a5c3-8badfcf97d2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.642648 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a82234-d512-465f-a5c3-8badfcf97d2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:24.644704 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a82234-d512-465f-a5c3-8badfcf97d2e admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:24.650854 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9f6ec-ed0b-47ce-b311-d5398400f29f admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:24.656561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61986de4-75d2-4b47-8e95-2bc8bcf8beb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:24.657671 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61986de4-75d2-4b47-8e95-2bc8bcf8beb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.657938 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61986de4-75d2-4b47-8e95-2bc8bcf8beb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.658307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61986de4-75d2-4b47-8e95-2bc8bcf8beb0 admin admin] PATH_INFO: `/v3/projects/8629e735ceab4faa842468e6f2237b6d/users/7859795cda174a54adc8bcf6192d71a9/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.677014 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61986de4-75d2-4b47-8e95-2bc8bcf8beb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8629e735ceab4faa842468e6f2237b6d, user_id=7859795cda174a54adc8bcf6192d71a9, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:24.680262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61986de4-75d2-4b47-8e95-2bc8bcf8beb0 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:24.722946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 980/1945] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:24 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:24.723781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a82234-d512-465f-a5c3-8badfcf97d2e admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:24.771189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 966/1946] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:24 2022] PUT /identity/v3/projects/8629e735ceab4faa842468e6f2237b6d/users/7859795cda174a54adc8bcf6192d71a9/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:24.771189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61986de4-75d2-4b47-8e95-2bc8bcf8beb0 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:24.825157 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a82234-d512-465f-a5c3-8badfcf97d2e admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:24.849525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:24.853799 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61986de4-75d2-4b47-8e95-2bc8bcf8beb0 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:24.859141 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5694a-bd5c-4c01-8fd9-99c7e65788a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:24.860129 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5694a-bd5c-4c01-8fd9-99c7e65788a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.860624 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5694a-bd5c-4c01-8fd9-99c7e65788a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.861132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5694a-bd5c-4c01-8fd9-99c7e65788a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.862080 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5694a-bd5c-4c01-8fd9-99c7e65788a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:24.864242 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5694a-bd5c-4c01-8fd9-99c7e65788a5 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:24.889256 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e3be4-a129-4ec7-891f-b81da29f2a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:24.890025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e3be4-a129-4ec7-891f-b81da29f2a2e admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.890485 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e3be4-a129-4ec7-891f-b81da29f2a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.890819 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e3be4-a129-4ec7-891f-b81da29f2a2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.891574 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e3be4-a129-4ec7-891f-b81da29f2a2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:24.893561 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e3be4-a129-4ec7-891f-b81da29f2a2e admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:24.911457 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:24.952949 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 967/1947] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:24 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:24.957354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c4ddf-e7d9-4ce7-a10b-c2207dda074d None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.958013 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c4ddf-e7d9-4ce7-a10b-c2207dda074d None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.958013 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c4ddf-e7d9-4ce7-a10b-c2207dda074d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.987582 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-c72c4ddf-e7d9-4ce7-a10b-c2207dda074d None None] MFA Rules not processed for user `7859795cda174a54adc8bcf6192d71a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:24.989113 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-c72c4ddf-e7d9-4ce7-a10b-c2207dda074d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:24.994645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 981/1948] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:24 2022] POST /identity/v3/projects => generated 373 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:24.995539 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e3be4-a129-4ec7-891f-b81da29f2a2e admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:25.087358 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 968/1949] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:25.091597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c4ddf-e7d9-4ce7-a10b-c2207dda074d None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:25.092140 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e3be4-a129-4ec7-891f-b81da29f2a2e admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:25.100438 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f08353-ff0f-4978-8bc6-6c250e5200e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:25.101747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f08353-ff0f-4978-8bc6-6c250e5200e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:25.102107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f08353-ff0f-4978-8bc6-6c250e5200e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:25.102465 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f08353-ff0f-4978-8bc6-6c250e5200e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:25.103288 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f08353-ff0f-4978-8bc6-6c250e5200e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:25.105040 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f08353-ff0f-4978-8bc6-6c250e5200e5 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:25.105595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c4ddf-e7d9-4ce7-a10b-c2207dda074d None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:25.110252 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e1601-bc32-45bf-aa12-9c4b2e42e375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:25.110954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e1601-bc32-45bf-aa12-9c4b2e42e375 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:25.111275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e1601-bc32-45bf-aa12-9c4b2e42e375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:25.111556 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e1601-bc32-45bf-aa12-9c4b2e42e375 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:25.112232 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e1601-bc32-45bf-aa12-9c4b2e42e375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:25.114145 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e1601-bc32-45bf-aa12-9c4b2e42e375 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:25.118877 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 982/1950] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:25.118877 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971cb4d-95cc-46ff-b0d2-3d540c629a51 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:25.118877 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971cb4d-95cc-46ff-b0d2-3d540c629a51 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:25.118877 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971cb4d-95cc-46ff-b0d2-3d540c629a51 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:25.122587 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 983/1951] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 3 13:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:00:25.122587 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971cb4d-95cc-46ff-b0d2-3d540c629a51 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:25.134803 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971cb4d-95cc-46ff-b0d2-3d540c629a51 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:25.139557 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45386a-b3c3-4c5f-b50d-6d253d508469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:25.140197 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45386a-b3c3-4c5f-b50d-6d253d508469 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:25.140632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45386a-b3c3-4c5f-b50d-6d253d508469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:25.140915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45386a-b3c3-4c5f-b50d-6d253d508469 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:25.141604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45386a-b3c3-4c5f-b50d-6d253d508469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:25.143892 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45386a-b3c3-4c5f-b50d-6d253d508469 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:25.230951 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 969/1952] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:25 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:25.230951 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e1601-bc32-45bf-aa12-9c4b2e42e375 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:25.242048 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e1601-bc32-45bf-aa12-9c4b2e42e375 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:25.246869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bfc17-f952-4b98-a9dd-af8e833784de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:25.247539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bfc17-f952-4b98-a9dd-af8e833784de admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:25.247820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bfc17-f952-4b98-a9dd-af8e833784de admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:25.248094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bfc17-f952-4b98-a9dd-af8e833784de admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:25.248788 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bfc17-f952-4b98-a9dd-af8e833784de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:25.250369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bfc17-f952-4b98-a9dd-af8e833784de admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:25.260442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 970/1953] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:25.261751 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794fcde-b2e9-45cb-a7e1-f46ab77f7782 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:25.262039 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794fcde-b2e9-45cb-a7e1-f46ab77f7782 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:25.262315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794fcde-b2e9-45cb-a7e1-f46ab77f7782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:25.286114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 984/1954] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:25 2022] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:25.287037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45386a-b3c3-4c5f-b50d-6d253d508469 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:25.293954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-c794fcde-b2e9-45cb-a7e1-f46ab77f7782 None None] MFA Rules not processed for user `de27d25fad634658a1abcb776d9a7b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:25.295403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-c794fcde-b2e9-45cb-a7e1-f46ab77f7782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:25.362110 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45386a-b3c3-4c5f-b50d-6d253d508469 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:25.366947 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff06c4-375b-4c74-b8e5-6fe4dc02a8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:25.367578 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff06c4-375b-4c74-b8e5-6fe4dc02a8be admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:25.367866 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff06c4-375b-4c74-b8e5-6fe4dc02a8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:25.368215 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff06c4-375b-4c74-b8e5-6fe4dc02a8be admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:25.368980 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff06c4-375b-4c74-b8e5-6fe4dc02a8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:25.370431 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 971/1955] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 3 13:00:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:25.371198 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff06c4-375b-4c74-b8e5-6fe4dc02a8be admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:25.371303 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794fcde-b2e9-45cb-a7e1-f46ab77f7782 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:25.384903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 985/1956] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:25.384903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff06c4-375b-4c74-b8e5-6fe4dc02a8be admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:25.385191 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794fcde-b2e9-45cb-a7e1-f46ab77f7782 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:25.389844 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de6b21-4885-4bf8-8fda-5d9794788f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:25.390576 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de6b21-4885-4bf8-8fda-5d9794788f15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:25.391109 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de6b21-4885-4bf8-8fda-5d9794788f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:25.391638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de6b21-4885-4bf8-8fda-5d9794788f15 admin admin] PATH_INFO: `/v3/projects/d7102031770c44b9baad0d2e0189d006/users/7a4333678dee4b1f9ed9d4c575453ad4/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:25.407359 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff06c4-375b-4c74-b8e5-6fe4dc02a8be admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:25.409392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de6b21-4885-4bf8-8fda-5d9794788f15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7102031770c44b9baad0d2e0189d006, user_id=7a4333678dee4b1f9ed9d4c575453ad4, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:25.412450 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de6b21-4885-4bf8-8fda-5d9794788f15 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:25.417438 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55c5c1-1a9f-48ce-b969-ef1c177f9e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:25.418376 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55c5c1-1a9f-48ce-b969-ef1c177f9e66 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:25.419133 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55c5c1-1a9f-48ce-b969-ef1c177f9e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:25.419414 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55c5c1-1a9f-48ce-b969-ef1c177f9e66 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:25.420090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55c5c1-1a9f-48ce-b969-ef1c177f9e66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:25.422186 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55c5c1-1a9f-48ce-b969-ef1c177f9e66 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:25.529469 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 986/1957] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:25 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:25.529469 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55c5c1-1a9f-48ce-b969-ef1c177f9e66 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:25.529623 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 972/1958] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:25 2022] PUT /identity/v3/projects/d7102031770c44b9baad0d2e0189d006/users/7a4333678dee4b1f9ed9d4c575453ad4/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:25.529623 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de6b21-4885-4bf8-8fda-5d9794788f15 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:25.540788 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-09de6b21-4885-4bf8-8fda-5d9794788f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:25.543701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55c5c1-1a9f-48ce-b969-ef1c177f9e66 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:25.644142 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8730f81-6991-42ef-a0c8-e3bcd0039395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:25.646462 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8730f81-6991-42ef-a0c8-e3bcd0039395 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:25.646917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8730f81-6991-42ef-a0c8-e3bcd0039395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:25.647754 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8730f81-6991-42ef-a0c8-e3bcd0039395 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:25.648658 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8730f81-6991-42ef-a0c8-e3bcd0039395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:25.650659 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8730f81-6991-42ef-a0c8-e3bcd0039395 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:25.658899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de6b21-4885-4bf8-8fda-5d9794788f15 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:25.665500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 987/1959] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:25.666587 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8730f81-6991-42ef-a0c8-e3bcd0039395 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:25.669328 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acaccf5-df91-476e-b546-d660b110c43d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de27d25fad634658a1abcb776d9a7b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:25.670121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acaccf5-df91-476e-b546-d660b110c43d service placement] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:25.670376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acaccf5-df91-476e-b546-d660b110c43d service placement] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:25.670578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acaccf5-df91-476e-b546-d660b110c43d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:25.682409 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8730f81-6991-42ef-a0c8-e3bcd0039395 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:25.687373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acaccf5-df91-476e-b546-d660b110c43d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:25.688685 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec7a96-7cad-4c53-a646-32d3340c1de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:25.689477 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec7a96-7cad-4c53-a646-32d3340c1de8 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:25.689587 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acaccf5-df91-476e-b546-d660b110c43d service placement] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:25.689766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec7a96-7cad-4c53-a646-32d3340c1de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:25.690216 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec7a96-7cad-4c53-a646-32d3340c1de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:25.691023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec7a96-7cad-4c53-a646-32d3340c1de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:25.692626 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec7a96-7cad-4c53-a646-32d3340c1de8 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:25.703454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 973/1960] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:25.704856 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652e05-4398-40a7-ba3e-dba455930709 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:25.705182 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652e05-4398-40a7-ba3e-dba455930709 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:25.705421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3652e05-4398-40a7-ba3e-dba455930709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:25.714923 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 988/1961] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:25.728973 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec7a96-7cad-4c53-a646-32d3340c1de8 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:25.732983 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec7a96-7cad-4c53-a646-32d3340c1de8 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:25.737742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43818eb9-af91-4a03-a72f-258e334ecc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:25.738499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43818eb9-af91-4a03-a72f-258e334ecc27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:25.738822 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43818eb9-af91-4a03-a72f-258e334ecc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:25.739221 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43818eb9-af91-4a03-a72f-258e334ecc27 admin admin] PATH_INFO: `/v3/projects/0cf3bd43121a4cac8bf158655f89a66b/users/93beb63fcbad48aa9473d81f5a344b34/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:25.751093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-b3652e05-4398-40a7-ba3e-dba455930709 None None] MFA Rules not processed for user `7a4333678dee4b1f9ed9d4c575453ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:25.752919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b3652e05-4398-40a7-ba3e-dba455930709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:25.760635 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43818eb9-af91-4a03-a72f-258e334ecc27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf3bd43121a4cac8bf158655f89a66b, user_id=93beb63fcbad48aa9473d81f5a344b34, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:25.763642 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43818eb9-af91-4a03-a72f-258e334ecc27 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:25.823874 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 974/1962] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:25.825013 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3652e05-4398-40a7-ba3e-dba455930709 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:25.838680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3652e05-4398-40a7-ba3e-dba455930709 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:25.842481 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 989/1963] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:25 2022] PUT /identity/v3/projects/0cf3bd43121a4cac8bf158655f89a66b/users/93beb63fcbad48aa9473d81f5a344b34/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:25.842668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43818eb9-af91-4a03-a72f-258e334ecc27 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:25.889068 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:25.901656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb0a0a-d509-46cc-802b-a2f5024a86a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:25.902343 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb0a0a-d509-46cc-802b-a2f5024a86a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:25.902786 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb0a0a-d509-46cc-802b-a2f5024a86a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:25.903076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb0a0a-d509-46cc-802b-a2f5024a86a8 admin admin] PATH_INFO: `/v3/projects/7998c0ba39e34477b1dd395caa276866/users/e49c37718a4a41cfbb909b6aaf5816e1/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:25.916076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43818eb9-af91-4a03-a72f-258e334ecc27 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:25.920051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb0a0a-d509-46cc-802b-a2f5024a86a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7998c0ba39e34477b1dd395caa276866, user_id=e49c37718a4a41cfbb909b6aaf5816e1, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:25.922361 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f2933-d810-4de5-9db5-4cce1bd36a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:25.923034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f2933-d810-4de5-9db5-4cce1bd36a53 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:25.923142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb0a0a-d509-46cc-802b-a2f5024a86a8 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:25.927493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f2933-d810-4de5-9db5-4cce1bd36a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:25.927493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f2933-d810-4de5-9db5-4cce1bd36a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:25.927493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f2933-d810-4de5-9db5-4cce1bd36a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:25.927493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f2933-d810-4de5-9db5-4cce1bd36a53 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:26.003544 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 975/1964] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:25 2022] PUT /identity/v3/projects/7998c0ba39e34477b1dd395caa276866/users/e49c37718a4a41cfbb909b6aaf5816e1/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:26.005017 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0119c-76c5-4fcb-9133-1f138cafaf2b None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:26.005310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0119c-76c5-4fcb-9133-1f138cafaf2b None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:26.005586 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0119c-76c5-4fcb-9133-1f138cafaf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:26.026987 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:26.035773 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-3bd0119c-76c5-4fcb-9133-1f138cafaf2b None None] MFA Rules not processed for user `93beb63fcbad48aa9473d81f5a344b34`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:26.036775 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 990/1965] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:25 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:26.037595 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f2933-d810-4de5-9db5-4cce1bd36a53 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:26.038104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3bd0119c-76c5-4fcb-9133-1f138cafaf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:26.106496 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f2933-d810-4de5-9db5-4cce1bd36a53 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:26.112198 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7af9b-e56a-44c1-a048-d2a32a62000e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:26.112983 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7af9b-e56a-44c1-a048-d2a32a62000e admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:26.113276 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7af9b-e56a-44c1-a048-d2a32a62000e admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:26.113565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7af9b-e56a-44c1-a048-d2a32a62000e admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:26.114383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 976/1966] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:26.114489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7af9b-e56a-44c1-a048-d2a32a62000e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:26.116164 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7af9b-e56a-44c1-a048-d2a32a62000e admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:26.119211 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0119c-76c5-4fcb-9133-1f138cafaf2b None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:26.129446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 991/1967] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:26.130786 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b75c4-fc41-4efb-b221-b040c0ee139b None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:26.131068 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b75c4-fc41-4efb-b221-b040c0ee139b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:26.131355 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b75c4-fc41-4efb-b221-b040c0ee139b None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:26.133400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 992/1968] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 3 13:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:00:26.134123 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b75c4-fc41-4efb-b221-b040c0ee139b None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:26.135403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0119c-76c5-4fcb-9133-1f138cafaf2b None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:26.135961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b16b75c4-fc41-4efb-b221-b040c0ee139b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:26.143691 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c6b3d-aed9-4c03-bddb-a8f5e861b9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:26.144725 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c6b3d-aed9-4c03-bddb-a8f5e861b9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:26.145019 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c6b3d-aed9-4c03-bddb-a8f5e861b9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:26.145307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c6b3d-aed9-4c03-bddb-a8f5e861b9a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:26.146376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c6b3d-aed9-4c03-bddb-a8f5e861b9a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:26.150114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c6b3d-aed9-4c03-bddb-a8f5e861b9a0 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:26.197852 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b75c4-fc41-4efb-b221-b040c0ee139b None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:26.201619 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af64e69-3766-4d3f-a74a-e1a2c1e015cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:26.202684 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af64e69-3766-4d3f-a74a-e1a2c1e015cc service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:26.202684 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af64e69-3766-4d3f-a74a-e1a2c1e015cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:26.204881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af64e69-3766-4d3f-a74a-e1a2c1e015cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:26.213362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af64e69-3766-4d3f-a74a-e1a2c1e015cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:26.214832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af64e69-3766-4d3f-a74a-e1a2c1e015cc service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:26.224136 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 993/1969] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:26.224936 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af64e69-3766-4d3f-a74a-e1a2c1e015cc service cinder] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:26.242118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af64e69-3766-4d3f-a74a-e1a2c1e015cc service cinder] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:26.242118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b02bd8-9691-454d-9c2f-8dc4fa0435af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:26.242118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b02bd8-9691-454d-9c2f-8dc4fa0435af admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:26.242118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b02bd8-9691-454d-9c2f-8dc4fa0435af admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:26.242446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b02bd8-9691-454d-9c2f-8dc4fa0435af admin admin] PATH_INFO: `/v3/projects/7998c0ba39e34477b1dd395caa276866/users/e49c37718a4a41cfbb909b6aaf5816e1/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:26.243856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b02bd8-9691-454d-9c2f-8dc4fa0435af admin admin] RBAC: Authorizing `identity:create_grant(project_id=7998c0ba39e34477b1dd395caa276866, user_id=e49c37718a4a41cfbb909b6aaf5816e1, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:26.246064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 977/1970] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:26 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:26.246688 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b02bd8-9691-454d-9c2f-8dc4fa0435af admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:26.247845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a94b4c-2758-4a29-8bec-739a7c16e7f4 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:26.248392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a94b4c-2758-4a29-8bec-739a7c16e7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:26.248982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a94b4c-2758-4a29-8bec-739a7c16e7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:26.258774 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 994/1971] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:26 2022] PUT /identity/v3/projects/7998c0ba39e34477b1dd395caa276866/users/e49c37718a4a41cfbb909b6aaf5816e1/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:26.267704 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b02bd8-9691-454d-9c2f-8dc4fa0435af admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:26.267704 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-20b02bd8-9691-454d-9c2f-8dc4fa0435af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:26.270430 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-b7a94b4c-2758-4a29-8bec-739a7c16e7f4 None None] MFA Rules not processed for user `de27d25fad634658a1abcb776d9a7b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:26.283033 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b7a94b4c-2758-4a29-8bec-739a7c16e7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:26.332058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b02bd8-9691-454d-9c2f-8dc4fa0435af admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:26.337796 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1d345-acf7-4756-9941-636cefffbfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:26.338458 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1d345-acf7-4756-9941-636cefffbfb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:26.338759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1d345-acf7-4756-9941-636cefffbfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:26.339080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1d345-acf7-4756-9941-636cefffbfb2 admin admin] PATH_INFO: `/v3/users/8f420ba9dd364405b7d1611d86e322ca` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:26.340393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1d345-acf7-4756-9941-636cefffbfb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f420ba9dd364405b7d1611d86e322ca)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:26.342316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1d345-acf7-4756-9941-636cefffbfb2 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:26.343071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 978/1972] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 3 13:00:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:26.343943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a94b4c-2758-4a29-8bec-739a7c16e7f4 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:26.354728 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a94b4c-2758-4a29-8bec-739a7c16e7f4 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:26.360279 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3163d08-00de-42ac-8ac1-044c3af605db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:26.361077 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3163d08-00de-42ac-8ac1-044c3af605db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:26.361431 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3163d08-00de-42ac-8ac1-044c3af605db admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:26.361807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3163d08-00de-42ac-8ac1-044c3af605db admin admin] PATH_INFO: `/v3/users/93beb63fcbad48aa9473d81f5a344b34` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:26.363051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3163d08-00de-42ac-8ac1-044c3af605db admin admin] RBAC: Authorizing `identity:delete_user(user_id=93beb63fcbad48aa9473d81f5a344b34)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:26.365087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3163d08-00de-42ac-8ac1-044c3af605db admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:26.557176 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-05f1d345-acf7-4756-9941-636cefffbfb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f420ba9dd364405b7d1611d86e322ca'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:26.563954 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-05f1d345-acf7-4756-9941-636cefffbfb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f420ba9dd364405b7d1611d86e322ca'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:26.564779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-05f1d345-acf7-4756-9941-636cefffbfb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f420ba9dd364405b7d1611d86e322ca'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:26.577467 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-05f1d345-acf7-4756-9941-636cefffbfb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f420ba9dd364405b7d1611d86e322ca'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:26.578197 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-05f1d345-acf7-4756-9941-636cefffbfb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f420ba9dd364405b7d1611d86e322ca'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:26.581388 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-f3163d08-00de-42ac-8ac1-044c3af605db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93beb63fcbad48aa9473d81f5a344b34'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:26.589831 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-f3163d08-00de-42ac-8ac1-044c3af605db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93beb63fcbad48aa9473d81f5a344b34'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:26.660663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 995/1973] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:26 2022] DELETE /identity/v3/users/8f420ba9dd364405b7d1611d86e322ca => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:26.661594 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1d345-acf7-4756-9941-636cefffbfb2 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:26.662949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-05f1d345-acf7-4756-9941-636cefffbfb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:26.728191 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1d345-acf7-4756-9941-636cefffbfb2 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:26.733519 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99915826-2fa3-451a-8f3c-1991ce2a2525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:26.734158 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99915826-2fa3-451a-8f3c-1991ce2a2525 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:26.734450 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99915826-2fa3-451a-8f3c-1991ce2a2525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:26.734759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99915826-2fa3-451a-8f3c-1991ce2a2525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:26.735481 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99915826-2fa3-451a-8f3c-1991ce2a2525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:26.737640 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99915826-2fa3-451a-8f3c-1991ce2a2525 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:26.749009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 996/1974] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:26.750349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed4538-f572-4cc1-96c2-7b0b055f5294 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:26.750847 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed4538-f572-4cc1-96c2-7b0b055f5294 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:26.751122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed4538-f572-4cc1-96c2-7b0b055f5294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:26.777312 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-f3163d08-00de-42ac-8ac1-044c3af605db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93beb63fcbad48aa9473d81f5a344b34'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:26.778640 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-f3163d08-00de-42ac-8ac1-044c3af605db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93beb63fcbad48aa9473d81f5a344b34'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:26.782602 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-84ed4538-f572-4cc1-96c2-7b0b055f5294 None None] MFA Rules not processed for user `e49c37718a4a41cfbb909b6aaf5816e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:26.784051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-84ed4538-f572-4cc1-96c2-7b0b055f5294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:26.796300 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-f3163d08-00de-42ac-8ac1-044c3af605db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93beb63fcbad48aa9473d81f5a344b34'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:26.807985 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 979/1975] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:26 2022] DELETE /identity/v3/users/93beb63fcbad48aa9473d81f5a344b34 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:26.808871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3163d08-00de-42ac-8ac1-044c3af605db admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:26.810342 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-f3163d08-00de-42ac-8ac1-044c3af605db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:26.878335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 997/1976] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:26.884310 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed4538-f572-4cc1-96c2-7b0b055f5294 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:26.884310 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-84ed4538-f572-4cc1-96c2-7b0b055f5294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:26.892205 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:26.904439 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed4538-f572-4cc1-96c2-7b0b055f5294 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:26.906361 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3163d08-00de-42ac-8ac1-044c3af605db admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:26.912783 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79902e65-7df4-4bdb-a3aa-a179f956df01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de27d25fad634658a1abcb776d9a7b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:26.914077 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79902e65-7df4-4bdb-a3aa-a179f956df01 service placement] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:26.914375 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79902e65-7df4-4bdb-a3aa-a179f956df01 service placement] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:26.914656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79902e65-7df4-4bdb-a3aa-a179f956df01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:26.916646 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-79902e65-7df4-4bdb-a3aa-a179f956df01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:26.934306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79902e65-7df4-4bdb-a3aa-a179f956df01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:26.934306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79902e65-7df4-4bdb-a3aa-a179f956df01 service placement] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:26.971220 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 980/1977] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:26.972710 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47db4b-da67-4e8c-b293-b1436d63d313 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:26.976966 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47db4b-da67-4e8c-b293-b1436d63d313 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:26.976966 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47db4b-da67-4e8c-b293-b1436d63d313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:26.981346 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e34cea-17ea-4779-8373-0396403732b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:26.982096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e34cea-17ea-4779-8373-0396403732b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:26.982382 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e34cea-17ea-4779-8373-0396403732b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:26.982661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e34cea-17ea-4779-8373-0396403732b1 admin admin] PATH_INFO: `/v3/projects/4e486a56a28342fd87f6f6463c594d4b/users/1acea39349724e06b5372a6305f29e1c/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:26.988359 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:27.003477 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e34cea-17ea-4779-8373-0396403732b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e486a56a28342fd87f6f6463c594d4b, user_id=1acea39349724e06b5372a6305f29e1c, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:27.005144 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-2a47db4b-da67-4e8c-b293-b1436d63d313 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:27.006536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e34cea-17ea-4779-8373-0396403732b1 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:27.007219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-2a47db4b-da67-4e8c-b293-b1436d63d313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:27.017612 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 981/1978] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:27.019148 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47db4b-da67-4e8c-b293-b1436d63d313 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:27.022026 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-2a47db4b-da67-4e8c-b293-b1436d63d313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:27.101719 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47db4b-da67-4e8c-b293-b1436d63d313 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:27.108107 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361ab21-5575-4934-a14e-dfe7f60e38c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:27.109590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361ab21-5575-4934-a14e-dfe7f60e38c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:27.110181 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361ab21-5575-4934-a14e-dfe7f60e38c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:27.110497 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361ab21-5575-4934-a14e-dfe7f60e38c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:27.149762 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 998/1979] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:26 2022] PUT /identity/v3/projects/4e486a56a28342fd87f6f6463c594d4b/users/1acea39349724e06b5372a6305f29e1c/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:27.149762 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e34cea-17ea-4779-8373-0396403732b1 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:27.156235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b2e34cea-17ea-4779-8373-0396403732b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:27.237506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361ab21-5575-4934-a14e-dfe7f60e38c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:27.238999 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361ab21-5575-4934-a14e-dfe7f60e38c0 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:27.249399 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 982/1980] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:27.250571 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:27.251739 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361ab21-5575-4934-a14e-dfe7f60e38c0 service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:27.252040 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e34cea-17ea-4779-8373-0396403732b1 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:27.253325 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-6361ab21-5575-4934-a14e-dfe7f60e38c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:27.258559 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf492c-a00f-49d4-bfdd-25e3dd4deb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:27.258559 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf492c-a00f-49d4-bfdd-25e3dd4deb16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:27.258559 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf492c-a00f-49d4-bfdd-25e3dd4deb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:27.258559 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf492c-a00f-49d4-bfdd-25e3dd4deb16 admin admin] PATH_INFO: `/v3/projects/8c983ff2375f4c268f5fbe5f475ab203` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:27.259649 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf492c-a00f-49d4-bfdd-25e3dd4deb16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c983ff2375f4c268f5fbe5f475ab203)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:27.261556 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf492c-a00f-49d4-bfdd-25e3dd4deb16 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:27.280834 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:27.313143 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361ab21-5575-4934-a14e-dfe7f60e38c0 service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:27.361138 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3681841-0d06-412e-9140-66b724922050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:27.361689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3681841-0d06-412e-9140-66b724922050 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:27.361975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3681841-0d06-412e-9140-66b724922050 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:27.362257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3681841-0d06-412e-9140-66b724922050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:27.371884 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3681841-0d06-412e-9140-66b724922050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:27.373398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3681841-0d06-412e-9140-66b724922050 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:27.384871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 983/1981] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:27.385831 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3681841-0d06-412e-9140-66b724922050 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:27.396691 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3681841-0d06-412e-9140-66b724922050 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:27.404753 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7dcf492c-a00f-49d4-bfdd-25e3dd4deb16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c983ff2375f4c268f5fbe5f475ab203', 'request_id': 'req-7dcf492c-a00f-49d4-bfdd-25e3dd4deb16'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:27.412157 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7dcf492c-a00f-49d4-bfdd-25e3dd4deb16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c983ff2375f4c268f5fbe5f475ab203', 'request_id': 'req-7dcf492c-a00f-49d4-bfdd-25e3dd4deb16'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:27.472165 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd3c17-80e3-483e-a688-432b7b612ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:27.472804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd3c17-80e3-483e-a688-432b7b612ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:27.473176 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd3c17-80e3-483e-a688-432b7b612ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:27.473466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd3c17-80e3-483e-a688-432b7b612ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:27.474987 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd3c17-80e3-483e-a688-432b7b612ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:27.477174 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd3c17-80e3-483e-a688-432b7b612ec6 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:27.483738 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7dcf492c-a00f-49d4-bfdd-25e3dd4deb16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c983ff2375f4c268f5fbe5f475ab203', 'request_id': 'req-7dcf492c-a00f-49d4-bfdd-25e3dd4deb16'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:27.492263 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 984/1982] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:27.493163 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd3c17-80e3-483e-a688-432b7b612ec6 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:27.498108 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7dcf492c-a00f-49d4-bfdd-25e3dd4deb16 admin admin] The token cache is being invalidate because project 8c983ff2375f4c268f5fbe5f475ab203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:27.498410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7dcf492c-a00f-49d4-bfdd-25e3dd4deb16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:27.499142 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7dcf492c-a00f-49d4-bfdd-25e3dd4deb16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:27.500930 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 999/1983] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:27 2022] DELETE /identity/v3/projects/8c983ff2375f4c268f5fbe5f475ab203 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:27.504521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf492c-a00f-49d4-bfdd-25e3dd4deb16 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:27.505873 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-7dcf492c-a00f-49d4-bfdd-25e3dd4deb16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:27.506526 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd3c17-80e3-483e-a688-432b7b612ec6 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:27.511887 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765a637-83dd-4173-b397-59db87dc9c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:27.512754 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765a637-83dd-4173-b397-59db87dc9c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:27.513045 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765a637-83dd-4173-b397-59db87dc9c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:27.513326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765a637-83dd-4173-b397-59db87dc9c57 admin admin] PATH_INFO: `/v3/projects/4e486a56a28342fd87f6f6463c594d4b/users/1acea39349724e06b5372a6305f29e1c/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:27.515474 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765a637-83dd-4173-b397-59db87dc9c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e486a56a28342fd87f6f6463c594d4b, user_id=1acea39349724e06b5372a6305f29e1c, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:27.518416 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765a637-83dd-4173-b397-59db87dc9c57 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:27.518594 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf492c-a00f-49d4-bfdd-25e3dd4deb16 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:27.524303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def2bc9-e880-46a9-804d-9c0d2d5d6264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:27.524960 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def2bc9-e880-46a9-804d-9c0d2d5d6264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:27.525255 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def2bc9-e880-46a9-804d-9c0d2d5d6264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:27.525567 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def2bc9-e880-46a9-804d-9c0d2d5d6264 admin admin] PATH_INFO: `/v3/users/04bed65114d7482ab626a13f29afddfa` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:27.526763 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def2bc9-e880-46a9-804d-9c0d2d5d6264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04bed65114d7482ab626a13f29afddfa)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:27.528874 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def2bc9-e880-46a9-804d-9c0d2d5d6264 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:27.534950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 985/1984] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:27 2022] PUT /identity/v3/projects/4e486a56a28342fd87f6f6463c594d4b/users/1acea39349724e06b5372a6305f29e1c/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:27.546474 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4f974-0ff5-4e70-ab8c-d60a6903fe23 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:27.546875 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4f974-0ff5-4e70-ab8c-d60a6903fe23 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:27.547225 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4f974-0ff5-4e70-ab8c-d60a6903fe23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:27.576849 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-4fc4f974-0ff5-4e70-ab8c-d60a6903fe23 None None] MFA Rules not processed for user `1acea39349724e06b5372a6305f29e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:27.578564 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-4fc4f974-0ff5-4e70-ab8c-d60a6903fe23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:27.667011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 986/1985] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:00:27.704730 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4f974-0ff5-4e70-ab8c-d60a6903fe23 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:27.708860 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-4fc4f974-0ff5-4e70-ab8c-d60a6903fe23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:27.753339 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:27.780493 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4f974-0ff5-4e70-ab8c-d60a6903fe23 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:27.784934 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be700d-e472-454f-a18f-c302f204b924 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:27.786029 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be700d-e472-454f-a18f-c302f204b924 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:27.786029 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be700d-e472-454f-a18f-c302f204b924 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:27.786311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be700d-e472-454f-a18f-c302f204b924 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:27.796440 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be700d-e472-454f-a18f-c302f204b924 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:27.797935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be700d-e472-454f-a18f-c302f204b924 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:27.808488 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 987/1986] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:00:27.875133 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0def2bc9-e880-46a9-804d-9c0d2d5d6264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04bed65114d7482ab626a13f29afddfa'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:27.883921 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0def2bc9-e880-46a9-804d-9c0d2d5d6264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04bed65114d7482ab626a13f29afddfa'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:27.884529 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0def2bc9-e880-46a9-804d-9c0d2d5d6264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04bed65114d7482ab626a13f29afddfa'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:27.899490 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0def2bc9-e880-46a9-804d-9c0d2d5d6264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04bed65114d7482ab626a13f29afddfa'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:27.900318 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0def2bc9-e880-46a9-804d-9c0d2d5d6264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04bed65114d7482ab626a13f29afddfa'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:27.917416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:27.966946 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be700d-e472-454f-a18f-c302f204b924 service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:27.968399 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a7be700d-e472-454f-a18f-c302f204b924 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:27.980807 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1000/1987] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:27 2022] DELETE /identity/v3/users/04bed65114d7482ab626a13f29afddfa => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:27.985294 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be700d-e472-454f-a18f-c302f204b924 service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:27.986528 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def2bc9-e880-46a9-804d-9c0d2d5d6264 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:27.988047 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-0def2bc9-e880-46a9-804d-9c0d2d5d6264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:28.047229 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bba1a-7a69-4dce-a484-a96d09440c94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:28.048078 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bba1a-7a69-4dce-a484-a96d09440c94 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:28.048462 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bba1a-7a69-4dce-a484-a96d09440c94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:28.048842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bba1a-7a69-4dce-a484-a96d09440c94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:28.051461 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e49bba1a-7a69-4dce-a484-a96d09440c94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:28.080771 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def2bc9-e880-46a9-804d-9c0d2d5d6264 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:28.090631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580079b1-ecdd-4755-b05a-46cd85cc317b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:28.091493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580079b1-ecdd-4755-b05a-46cd85cc317b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:28.091879 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580079b1-ecdd-4755-b05a-46cd85cc317b admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:28.092278 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580079b1-ecdd-4755-b05a-46cd85cc317b admin admin] PATH_INFO: `/v3/projects/0cf3bd43121a4cac8bf158655f89a66b` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:28.094282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580079b1-ecdd-4755-b05a-46cd85cc317b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cf3bd43121a4cac8bf158655f89a66b)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:28.096769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580079b1-ecdd-4755-b05a-46cd85cc317b admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:28.150321 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bba1a-7a69-4dce-a484-a96d09440c94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:28.151900 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bba1a-7a69-4dce-a484-a96d09440c94 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:28.164462 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 988/1988] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:00:28.209858 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-580079b1-ecdd-4755-b05a-46cd85cc317b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cf3bd43121a4cac8bf158655f89a66b', 'request_id': 'req-580079b1-ecdd-4755-b05a-46cd85cc317b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.218377 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-580079b1-ecdd-4755-b05a-46cd85cc317b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cf3bd43121a4cac8bf158655f89a66b', 'request_id': 'req-580079b1-ecdd-4755-b05a-46cd85cc317b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.311917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-580079b1-ecdd-4755-b05a-46cd85cc317b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cf3bd43121a4cac8bf158655f89a66b', 'request_id': 'req-580079b1-ecdd-4755-b05a-46cd85cc317b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.324007 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-580079b1-ecdd-4755-b05a-46cd85cc317b admin admin] The token cache is being invalidate because project 0cf3bd43121a4cac8bf158655f89a66b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:28.324311 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-580079b1-ecdd-4755-b05a-46cd85cc317b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.324990 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-580079b1-ecdd-4755-b05a-46cd85cc317b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.326546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1001/1989] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:27 2022] DELETE /identity/v3/projects/0cf3bd43121a4cac8bf158655f89a66b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:28.331441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eec474-538c-4785-a3db-0d5261cd836e None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:28.331738 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eec474-538c-4785-a3db-0d5261cd836e None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:28.332048 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eec474-538c-4785-a3db-0d5261cd836e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:28.370316 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-86eec474-538c-4785-a3db-0d5261cd836e None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:28.371588 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-86eec474-538c-4785-a3db-0d5261cd836e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:28.421522 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580079b1-ecdd-4755-b05a-46cd85cc317b admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:28.424807 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-580079b1-ecdd-4755-b05a-46cd85cc317b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:28.447446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:28.460831 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 989/1990] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:00:28.462175 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eec474-538c-4785-a3db-0d5261cd836e None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:28.463417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-86eec474-538c-4785-a3db-0d5261cd836e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:28.477565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eec474-538c-4785-a3db-0d5261cd836e None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:28.483053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321a431-fbd3-4ed0-84dd-eadaf85c03e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:28.483876 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321a431-fbd3-4ed0-84dd-eadaf85c03e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:28.484262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321a431-fbd3-4ed0-84dd-eadaf85c03e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:28.484641 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321a431-fbd3-4ed0-84dd-eadaf85c03e7 admin admin] PATH_INFO: `/v3/users/7859795cda174a54adc8bcf6192d71a9` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:28.485963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321a431-fbd3-4ed0-84dd-eadaf85c03e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7859795cda174a54adc8bcf6192d71a9)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:28.488457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321a431-fbd3-4ed0-84dd-eadaf85c03e7 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:28.519702 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580079b1-ecdd-4755-b05a-46cd85cc317b admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:28.526143 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437e64a-7de7-4013-be4f-ee363dd31e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:28.526844 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437e64a-7de7-4013-be4f-ee363dd31e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:28.527301 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437e64a-7de7-4013-be4f-ee363dd31e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:28.527582 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437e64a-7de7-4013-be4f-ee363dd31e6e admin admin] PATH_INFO: `/v3/projects/4058cb95725747c1868a8e142fe74f78` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:28.528789 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437e64a-7de7-4013-be4f-ee363dd31e6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4058cb95725747c1868a8e142fe74f78)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:28.530927 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437e64a-7de7-4013-be4f-ee363dd31e6e admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:28.587029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:28.631203 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5437e64a-7de7-4013-be4f-ee363dd31e6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4058cb95725747c1868a8e142fe74f78', 'request_id': 'req-5437e64a-7de7-4013-be4f-ee363dd31e6e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.638758 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5437e64a-7de7-4013-be4f-ee363dd31e6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4058cb95725747c1868a8e142fe74f78', 'request_id': 'req-5437e64a-7de7-4013-be4f-ee363dd31e6e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.714755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5437e64a-7de7-4013-be4f-ee363dd31e6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4058cb95725747c1868a8e142fe74f78', 'request_id': 'req-5437e64a-7de7-4013-be4f-ee363dd31e6e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.729053 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5437e64a-7de7-4013-be4f-ee363dd31e6e admin admin] The token cache is being invalidate because project 4058cb95725747c1868a8e142fe74f78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:28.729594 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5437e64a-7de7-4013-be4f-ee363dd31e6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.730270 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5437e64a-7de7-4013-be4f-ee363dd31e6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.732398 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1002/1991] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:28 2022] DELETE /identity/v3/projects/4058cb95725747c1868a8e142fe74f78 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:28.733056 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0321a431-fbd3-4ed0-84dd-eadaf85c03e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7859795cda174a54adc8bcf6192d71a9'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.733457 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518da7cd-ae99-48d7-aa54-df57788df04e None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:28.733885 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518da7cd-ae99-48d7-aa54-df57788df04e None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:28.734172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518da7cd-ae99-48d7-aa54-df57788df04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:28.745740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0321a431-fbd3-4ed0-84dd-eadaf85c03e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7859795cda174a54adc8bcf6192d71a9'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.755147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-518da7cd-ae99-48d7-aa54-df57788df04e None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:28.756413 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-518da7cd-ae99-48d7-aa54-df57788df04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:28.814442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0321a431-fbd3-4ed0-84dd-eadaf85c03e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7859795cda174a54adc8bcf6192d71a9'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.815327 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0321a431-fbd3-4ed0-84dd-eadaf85c03e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7859795cda174a54adc8bcf6192d71a9'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.827218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1003/1992] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:28.828663 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4f722-c204-4fff-8cc0-ef62958ececf None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:28.828933 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4f722-c204-4fff-8cc0-ef62958ececf None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:28.829212 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4f722-c204-4fff-8cc0-ef62958ececf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:28.831947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0321a431-fbd3-4ed0-84dd-eadaf85c03e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7859795cda174a54adc8bcf6192d71a9'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.838308 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 990/1993] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:28 2022] DELETE /identity/v3/users/7859795cda174a54adc8bcf6192d71a9 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:28.839234 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321a431-fbd3-4ed0-84dd-eadaf85c03e7 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:28.840583 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-0321a431-fbd3-4ed0-84dd-eadaf85c03e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:28.849059 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-cbb4f722-c204-4fff-8cc0-ef62958ececf None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:28.851541 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-cbb4f722-c204-4fff-8cc0-ef62958ececf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:28.907466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321a431-fbd3-4ed0-84dd-eadaf85c03e7 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:28.911386 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1004/1994] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:28.912215 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13b480-94d8-4ff0-b3e8-c67300e046a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:28.912830 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13b480-94d8-4ff0-b3e8-c67300e046a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:28.912951 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a0141-357b-4ee7-8eb9-a22b9dde2edd None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:28.913147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13b480-94d8-4ff0-b3e8-c67300e046a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:28.913410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a0141-357b-4ee7-8eb9-a22b9dde2edd None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:28.913513 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13b480-94d8-4ff0-b3e8-c67300e046a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:28.913850 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a0141-357b-4ee7-8eb9-a22b9dde2edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:28.914142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13b480-94d8-4ff0-b3e8-c67300e046a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:00:28.914452 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13b480-94d8-4ff0-b3e8-c67300e046a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:28.916091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13b480-94d8-4ff0-b3e8-c67300e046a6 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:28.928468 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 991/1995] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:00:28.930093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e389b-99c1-481d-b700-cfa76253173e None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:28.930385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e389b-99c1-481d-b700-cfa76253173e None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:28.930664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e389b-99c1-481d-b700-cfa76253173e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:28.935409 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-fa1a0141-357b-4ee7-8eb9-a22b9dde2edd None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:28.935409 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-fa1a0141-357b-4ee7-8eb9-a22b9dde2edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:28.943517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1005/1996] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:28.944435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a0141-357b-4ee7-8eb9-a22b9dde2edd None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:28.951843 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-918e389b-99c1-481d-b700-cfa76253173e None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:28.953319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-918e389b-99c1-481d-b700-cfa76253173e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:28.954929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a0141-357b-4ee7-8eb9-a22b9dde2edd None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:28.959636 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66631006-d6fe-4382-a6ea-cc4dc11945cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:28.960357 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66631006-d6fe-4382-a6ea-cc4dc11945cc admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:28.962943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66631006-d6fe-4382-a6ea-cc4dc11945cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:28.962943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66631006-d6fe-4382-a6ea-cc4dc11945cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:28.963091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 992/1997] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:28.963161 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66631006-d6fe-4382-a6ea-cc4dc11945cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:28.963243 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e389b-99c1-481d-b700-cfa76253173e None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:28.963480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-918e389b-99c1-481d-b700-cfa76253173e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:28.963585 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66631006-d6fe-4382-a6ea-cc4dc11945cc admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:29.022122 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e389b-99c1-481d-b700-cfa76253173e None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:29.026337 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994487eb-2f1c-405c-9e47-30674c38b4b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:29.027372 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994487eb-2f1c-405c-9e47-30674c38b4b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.027372 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994487eb-2f1c-405c-9e47-30674c38b4b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.027530 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994487eb-2f1c-405c-9e47-30674c38b4b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.037706 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994487eb-2f1c-405c-9e47-30674c38b4b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:29.039320 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994487eb-2f1c-405c-9e47-30674c38b4b3 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:29.050623 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 993/1998] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:29.051507 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994487eb-2f1c-405c-9e47-30674c38b4b3 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:29.067111 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994487eb-2f1c-405c-9e47-30674c38b4b3 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:29.075021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1006/1999] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:28 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:29.075954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70993277-2c79-4ee6-8640-63a22d352584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:29.076851 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66631006-d6fe-4382-a6ea-cc4dc11945cc admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:29.077846 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70993277-2c79-4ee6-8640-63a22d352584 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.078137 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70993277-2c79-4ee6-8640-63a22d352584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.078449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70993277-2c79-4ee6-8640-63a22d352584 admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.080964 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70993277-2c79-4ee6-8640-63a22d352584 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:00:29.081288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70993277-2c79-4ee6-8640-63a22d352584 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:29.083221 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70993277-2c79-4ee6-8640-63a22d352584 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:29.100625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 994/2000] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:00:29.107074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70993277-2c79-4ee6-8640-63a22d352584 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:29.118713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70993277-2c79-4ee6-8640-63a22d352584 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:29.184705 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:29.191276 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66631006-d6fe-4382-a6ea-cc4dc11945cc admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:29.196613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25dd22-40ee-43ff-9faa-45ad926d34c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:29.197259 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25dd22-40ee-43ff-9faa-45ad926d34c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.197546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25dd22-40ee-43ff-9faa-45ad926d34c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.197876 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25dd22-40ee-43ff-9faa-45ad926d34c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.198629 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25dd22-40ee-43ff-9faa-45ad926d34c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:29.200546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25dd22-40ee-43ff-9faa-45ad926d34c6 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:29.215794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83821ceb-69c5-479f-9527-4933efb091c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:29.216509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83821ceb-69c5-479f-9527-4933efb091c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.216830 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83821ceb-69c5-479f-9527-4933efb091c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.217116 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83821ceb-69c5-479f-9527-4933efb091c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.219987 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83821ceb-69c5-479f-9527-4933efb091c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:29.219987 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83821ceb-69c5-479f-9527-4933efb091c5 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:29.298382 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1007/2001] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:29 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:29.302436 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25dd22-40ee-43ff-9faa-45ad926d34c6 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:29.313413 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25dd22-40ee-43ff-9faa-45ad926d34c6 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:29.332307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 995/2002] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:29 2022] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:29.332307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83821ceb-69c5-479f-9527-4933efb091c5 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:29.393996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38ac40-729e-454c-99bd-05257b909cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:29.395564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38ac40-729e-454c-99bd-05257b909cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.395860 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38ac40-729e-454c-99bd-05257b909cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.396149 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38ac40-729e-454c-99bd-05257b909cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.397045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38ac40-729e-454c-99bd-05257b909cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:29.399290 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38ac40-729e-454c-99bd-05257b909cd1 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:29.415759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1008/2003] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:29.415955 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83821ceb-69c5-479f-9527-4933efb091c5 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:29.417578 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38ac40-729e-454c-99bd-05257b909cd1 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:29.429231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38ac40-729e-454c-99bd-05257b909cd1 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:29.434027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ba218-1273-48ac-ad02-3edef008d9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:29.434191 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ef7a6-6450-42cc-bbad-7efa1e9630ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:29.434722 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ba218-1273-48ac-ad02-3edef008d9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.435439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ba218-1273-48ac-ad02-3edef008d9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.435576 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ef7a6-6450-42cc-bbad-7efa1e9630ba admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.435670 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ba218-1273-48ac-ad02-3edef008d9f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.435757 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ef7a6-6450-42cc-bbad-7efa1e9630ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.436106 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ef7a6-6450-42cc-bbad-7efa1e9630ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.436375 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ba218-1273-48ac-ad02-3edef008d9f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:29.437480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ef7a6-6450-42cc-bbad-7efa1e9630ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:29.438562 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ba218-1273-48ac-ad02-3edef008d9f7 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:29.439302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ef7a6-6450-42cc-bbad-7efa1e9630ba admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:29.454101 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1009/2004] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:00:29.458195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ef7a6-6450-42cc-bbad-7efa1e9630ba admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:29.470425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ef7a6-6450-42cc-bbad-7efa1e9630ba admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:29.475216 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ed8df-4685-4ebc-b94d-75fe30fd66a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:29.475997 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ed8df-4685-4ebc-b94d-75fe30fd66a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.476570 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ed8df-4685-4ebc-b94d-75fe30fd66a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.476570 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ed8df-4685-4ebc-b94d-75fe30fd66a8 admin admin] PATH_INFO: `/v3/projects/6346bbca68374e02b7d29248046949dc/users/7bb9fab7d9bf4305b6636df09a4ae6d2/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.494562 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ed8df-4685-4ebc-b94d-75fe30fd66a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6346bbca68374e02b7d29248046949dc, user_id=7bb9fab7d9bf4305b6636df09a4ae6d2, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:29.497460 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ed8df-4685-4ebc-b94d-75fe30fd66a8 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:29.549844 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 996/2005] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:29 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:29.553292 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ba218-1273-48ac-ad02-3edef008d9f7 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:29.563924 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ba218-1273-48ac-ad02-3edef008d9f7 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:29.568705 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8dcf1-095f-4aad-b6f0-950f542cdb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:29.569960 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8dcf1-095f-4aad-b6f0-950f542cdb84 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.570352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8dcf1-095f-4aad-b6f0-950f542cdb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.570718 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8dcf1-095f-4aad-b6f0-950f542cdb84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.571452 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8dcf1-095f-4aad-b6f0-950f542cdb84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:29.573748 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8dcf1-095f-4aad-b6f0-950f542cdb84 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:29.584764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 997/2006] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:29.587710 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1010/2007] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:29 2022] PUT /identity/v3/projects/6346bbca68374e02b7d29248046949dc/users/7bb9fab7d9bf4305b6636df09a4ae6d2/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:29.588675 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8dcf1-095f-4aad-b6f0-950f542cdb84 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:29.597600 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77474c5a-e613-4dc3-badf-93f0a0fce548 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.597913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77474c5a-e613-4dc3-badf-93f0a0fce548 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.598193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77474c5a-e613-4dc3-badf-93f0a0fce548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.602297 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8dcf1-095f-4aad-b6f0-950f542cdb84 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:29.637493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-77474c5a-e613-4dc3-badf-93f0a0fce548 None None] MFA Rules not processed for user `7bb9fab7d9bf4305b6636df09a4ae6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:29.639009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-77474c5a-e613-4dc3-badf-93f0a0fce548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:29.672012 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066376bb-002c-47e2-be37-510fb75685f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:29.672853 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066376bb-002c-47e2-be37-510fb75685f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.673428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066376bb-002c-47e2-be37-510fb75685f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.674055 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066376bb-002c-47e2-be37-510fb75685f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.674970 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066376bb-002c-47e2-be37-510fb75685f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:29.677877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066376bb-002c-47e2-be37-510fb75685f1 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:29.690916 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 998/2008] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:00:29.692075 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066376bb-002c-47e2-be37-510fb75685f1 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:29.695092 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-066376bb-002c-47e2-be37-510fb75685f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:29.708120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066376bb-002c-47e2-be37-510fb75685f1 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:29.712750 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c3e96-e4b5-4ad2-994c-cf0d99fcfebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:29.713383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c3e96-e4b5-4ad2-994c-cf0d99fcfebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.713669 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c3e96-e4b5-4ad2-994c-cf0d99fcfebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.713949 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c3e96-e4b5-4ad2-994c-cf0d99fcfebd admin admin] PATH_INFO: `/v3/projects/8629e735ceab4faa842468e6f2237b6d` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.715188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c3e96-e4b5-4ad2-994c-cf0d99fcfebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8629e735ceab4faa842468e6f2237b6d)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:29.717080 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c3e96-e4b5-4ad2-994c-cf0d99fcfebd admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:29.721880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1011/2009] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:00:29.723006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77474c5a-e613-4dc3-badf-93f0a0fce548 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:29.733661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77474c5a-e613-4dc3-badf-93f0a0fce548 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:29.742266 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e54d6f-875c-4ceb-ae83-8f823b58bfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:29.743035 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e54d6f-875c-4ceb-ae83-8f823b58bfe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.743348 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e54d6f-875c-4ceb-ae83-8f823b58bfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.743629 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e54d6f-875c-4ceb-ae83-8f823b58bfe9 admin admin] PATH_INFO: `/v3/projects/ad71702cf704412cb04964b351702d79/users/7edfb118d3b3418ebc40b0c5affd8fdf/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.760596 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e54d6f-875c-4ceb-ae83-8f823b58bfe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad71702cf704412cb04964b351702d79, user_id=7edfb118d3b3418ebc40b0c5affd8fdf, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:29.763562 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e54d6f-875c-4ceb-ae83-8f823b58bfe9 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:29.855943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1012/2010] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:29 2022] PUT /identity/v3/projects/ad71702cf704412cb04964b351702d79/users/7edfb118d3b3418ebc40b0c5affd8fdf/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:29.856994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e54d6f-875c-4ceb-ae83-8f823b58bfe9 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:29.858667 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-f3e54d6f-875c-4ceb-ae83-8f823b58bfe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:29.868320 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-223c3e96-e4b5-4ad2-994c-cf0d99fcfebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8629e735ceab4faa842468e6f2237b6d', 'request_id': 'req-223c3e96-e4b5-4ad2-994c-cf0d99fcfebd'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:29.875312 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-223c3e96-e4b5-4ad2-994c-cf0d99fcfebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8629e735ceab4faa842468e6f2237b6d', 'request_id': 'req-223c3e96-e4b5-4ad2-994c-cf0d99fcfebd'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:29.921823 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e54d6f-875c-4ceb-ae83-8f823b58bfe9 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:29.940222 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-223c3e96-e4b5-4ad2-994c-cf0d99fcfebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8629e735ceab4faa842468e6f2237b6d', 'request_id': 'req-223c3e96-e4b5-4ad2-994c-cf0d99fcfebd'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:29.941887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:29.952448 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-223c3e96-e4b5-4ad2-994c-cf0d99fcfebd admin admin] The token cache is being invalidate because project 8629e735ceab4faa842468e6f2237b6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:29.952835 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-223c3e96-e4b5-4ad2-994c-cf0d99fcfebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:29.953635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-223c3e96-e4b5-4ad2-994c-cf0d99fcfebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:29.955493 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 999/2011] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:29 2022] DELETE /identity/v3/projects/8629e735ceab4faa842468e6f2237b6d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:29.956503 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41eb316-831d-4dcd-a281-ea244c43860c None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.956791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41eb316-831d-4dcd-a281-ea244c43860c None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.957095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41eb316-831d-4dcd-a281-ea244c43860c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.980902 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb644f79-a477-426b-a712-6950859cfd04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:29.982902 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb644f79-a477-426b-a712-6950859cfd04 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.982902 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb644f79-a477-426b-a712-6950859cfd04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.982902 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb644f79-a477-426b-a712-6950859cfd04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.984494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-cb644f79-a477-426b-a712-6950859cfd04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:30.020701 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-a41eb316-831d-4dcd-a281-ea244c43860c None None] MFA Rules not processed for user `7edfb118d3b3418ebc40b0c5affd8fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:30.022608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a41eb316-831d-4dcd-a281-ea244c43860c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:30.068600 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb644f79-a477-426b-a712-6950859cfd04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:30.077693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb644f79-a477-426b-a712-6950859cfd04 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:30.098927 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1013/2012] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:30.099816 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb644f79-a477-426b-a712-6950859cfd04 service cinder] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:30.109633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-cb644f79-a477-426b-a712-6950859cfd04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:30.170955 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1000/2013] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:30.180541 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41eb316-831d-4dcd-a281-ea244c43860c None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:30.183546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a41eb316-831d-4dcd-a281-ea244c43860c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:30.269298 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb644f79-a477-426b-a712-6950859cfd04 service cinder] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:30.278309 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8de8bd-7161-421e-a6f4-7cc5e75a4e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:30.279022 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8de8bd-7161-421e-a6f4-7cc5e75a4e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:30.279306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8de8bd-7161-421e-a6f4-7cc5e75a4e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:30.279584 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8de8bd-7161-421e-a6f4-7cc5e75a4e99 admin admin] PATH_INFO: `/v3/users/e49c37718a4a41cfbb909b6aaf5816e1` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:30.281280 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8de8bd-7161-421e-a6f4-7cc5e75a4e99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e49c37718a4a41cfbb909b6aaf5816e1)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:30.284262 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8de8bd-7161-421e-a6f4-7cc5e75a4e99 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:30.310226 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:30.318448 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41eb316-831d-4dcd-a281-ea244c43860c None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:30.324715 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fc040-020e-4351-82f3-315b399f8885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:30.325354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fc040-020e-4351-82f3-315b399f8885 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:30.325642 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fc040-020e-4351-82f3-315b399f8885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:30.325920 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fc040-020e-4351-82f3-315b399f8885 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:30.326605 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fc040-020e-4351-82f3-315b399f8885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:30.328612 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fc040-020e-4351-82f3-315b399f8885 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:30.391835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:30.428541 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1001/2014] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:30 2022] POST /identity/v3/projects => generated 381 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:30.432722 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fc040-020e-4351-82f3-315b399f8885 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:30.497129 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-db8de8bd-7161-421e-a6f4-7cc5e75a4e99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e49c37718a4a41cfbb909b6aaf5816e1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:30.497688 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fc040-020e-4351-82f3-315b399f8885 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:30.503087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198047fd-4b88-4899-9b1a-fd775121ab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:30.503916 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198047fd-4b88-4899-9b1a-fd775121ab1e admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:30.504236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-db8de8bd-7161-421e-a6f4-7cc5e75a4e99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e49c37718a4a41cfbb909b6aaf5816e1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:30.504645 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198047fd-4b88-4899-9b1a-fd775121ab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:30.504853 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-db8de8bd-7161-421e-a6f4-7cc5e75a4e99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e49c37718a4a41cfbb909b6aaf5816e1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:30.505301 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198047fd-4b88-4899-9b1a-fd775121ab1e admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:30.506150 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198047fd-4b88-4899-9b1a-fd775121ab1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:30.508870 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198047fd-4b88-4899-9b1a-fd775121ab1e admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:30.524473 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-db8de8bd-7161-421e-a6f4-7cc5e75a4e99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e49c37718a4a41cfbb909b6aaf5816e1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:30.525358 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-db8de8bd-7161-421e-a6f4-7cc5e75a4e99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e49c37718a4a41cfbb909b6aaf5816e1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:30.568854 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:30.599600 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1014/2015] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:30 2022] DELETE /identity/v3/users/e49c37718a4a41cfbb909b6aaf5816e1 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:30.608305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1002/2016] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:30 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:00:30.608439 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8de8bd-7161-421e-a6f4-7cc5e75a4e99 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:30.608439 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-db8de8bd-7161-421e-a6f4-7cc5e75a4e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:30.695658 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8de8bd-7161-421e-a6f4-7cc5e75a4e99 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:30.700626 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f21e7-f13b-4695-9893-2432043541f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:30.701256 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f21e7-f13b-4695-9893-2432043541f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:30.701540 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f21e7-f13b-4695-9893-2432043541f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:30.702127 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f21e7-f13b-4695-9893-2432043541f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:30.702520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f21e7-f13b-4695-9893-2432043541f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:30.707398 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f21e7-f13b-4695-9893-2432043541f2 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:30.715223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1015/2017] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:30.719462 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198047fd-4b88-4899-9b1a-fd775121ab1e admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:30.730122 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198047fd-4b88-4899-9b1a-fd775121ab1e admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:30.734804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c04e5-bf49-4b64-b705-8f2ce32b3f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:30.735480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c04e5-bf49-4b64-b705-8f2ce32b3f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:30.735762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c04e5-bf49-4b64-b705-8f2ce32b3f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:30.736039 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c04e5-bf49-4b64-b705-8f2ce32b3f17 admin admin] PATH_INFO: `/v3/projects/bd9717753e8e4732a55d36f4a4bc3422/users/c26b6d377dc546cf95f4e4a5b8509982/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:30.752538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c04e5-bf49-4b64-b705-8f2ce32b3f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd9717753e8e4732a55d36f4a4bc3422, user_id=c26b6d377dc546cf95f4e4a5b8509982, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:30.756973 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c04e5-bf49-4b64-b705-8f2ce32b3f17 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:30.873933 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1003/2018] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:30 2022] PUT /identity/v3/projects/bd9717753e8e4732a55d36f4a4bc3422/users/c26b6d377dc546cf95f4e4a5b8509982/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:30.877428 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f21e7-f13b-4695-9893-2432043541f2 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:30.888524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f21e7-f13b-4695-9893-2432043541f2 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:30.955525 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badfae7-1e6d-4486-8148-e4ef86d90f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:30.957686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badfae7-1e6d-4486-8148-e4ef86d90f05 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:30.957686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badfae7-1e6d-4486-8148-e4ef86d90f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:30.957686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badfae7-1e6d-4486-8148-e4ef86d90f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:30.957686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badfae7-1e6d-4486-8148-e4ef86d90f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:30.959332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badfae7-1e6d-4486-8148-e4ef86d90f05 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:30.970125 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1016/2019] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:30.974307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c04e5-bf49-4b64-b705-8f2ce32b3f17 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:30.985665 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c04e5-bf49-4b64-b705-8f2ce32b3f17 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:30.990450 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8c154-a3f0-4599-ae2b-b69ef5f8eccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:30.991214 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8c154-a3f0-4599-ae2b-b69ef5f8eccf admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:30.991501 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8c154-a3f0-4599-ae2b-b69ef5f8eccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:30.991786 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8c154-a3f0-4599-ae2b-b69ef5f8eccf admin admin] PATH_INFO: `/v3/projects/bd9717753e8e4732a55d36f4a4bc3422/users/c26b6d377dc546cf95f4e4a5b8509982/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:30.993802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8c154-a3f0-4599-ae2b-b69ef5f8eccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd9717753e8e4732a55d36f4a4bc3422, user_id=c26b6d377dc546cf95f4e4a5b8509982, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:30.996495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8c154-a3f0-4599-ae2b-b69ef5f8eccf admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:31.007357 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1004/2020] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:30 2022] PUT /identity/v3/projects/bd9717753e8e4732a55d36f4a4bc3422/users/c26b6d377dc546cf95f4e4a5b8509982/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:31.025134 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea026ff-09ed-4402-8902-91b829b5e536 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:31.025429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea026ff-09ed-4402-8902-91b829b5e536 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:31.025714 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea026ff-09ed-4402-8902-91b829b5e536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:31.035610 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:31.042870 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8c154-a3f0-4599-ae2b-b69ef5f8eccf admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:31.044752 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-2de8c154-a3f0-4599-ae2b-b69ef5f8eccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:31.059103 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-fea026ff-09ed-4402-8902-91b829b5e536 None None] MFA Rules not processed for user `c26b6d377dc546cf95f4e4a5b8509982`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:31.060387 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-fea026ff-09ed-4402-8902-91b829b5e536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:31.124809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8c154-a3f0-4599-ae2b-b69ef5f8eccf admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:31.129576 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36a62f-a287-4aa6-a6a7-c5b39f1a8960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:31.130453 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36a62f-a287-4aa6-a6a7-c5b39f1a8960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:31.130656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36a62f-a287-4aa6-a6a7-c5b39f1a8960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:31.131024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36a62f-a287-4aa6-a6a7-c5b39f1a8960 admin admin] PATH_INFO: `/v3/projects/7998c0ba39e34477b1dd395caa276866` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:31.132336 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36a62f-a287-4aa6-a6a7-c5b39f1a8960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7998c0ba39e34477b1dd395caa276866)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:31.136869 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1017/2021] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:31.137475 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36a62f-a287-4aa6-a6a7-c5b39f1a8960 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:31.145240 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea026ff-09ed-4402-8902-91b829b5e536 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:31.146682 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-fea026ff-09ed-4402-8902-91b829b5e536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:31.171735 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:31.214180 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea026ff-09ed-4402-8902-91b829b5e536 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:31.218404 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b995b7a-c166-4afc-a4aa-cb9deadb02fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:31.219075 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b995b7a-c166-4afc-a4aa-cb9deadb02fe service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:31.219362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b995b7a-c166-4afc-a4aa-cb9deadb02fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:31.219644 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b995b7a-c166-4afc-a4aa-cb9deadb02fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:31.221704 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-5b995b7a-c166-4afc-a4aa-cb9deadb02fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:31.270230 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0a36a62f-a287-4aa6-a6a7-c5b39f1a8960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7998c0ba39e34477b1dd395caa276866', 'request_id': 'req-0a36a62f-a287-4aa6-a6a7-c5b39f1a8960'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:31.277080 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0a36a62f-a287-4aa6-a6a7-c5b39f1a8960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7998c0ba39e34477b1dd395caa276866', 'request_id': 'req-0a36a62f-a287-4aa6-a6a7-c5b39f1a8960'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:31.283576 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b995b7a-c166-4afc-a4aa-cb9deadb02fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:31.285151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b995b7a-c166-4afc-a4aa-cb9deadb02fe service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:31.295322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1018/2022] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:00:31.364274 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0a36a62f-a287-4aa6-a6a7-c5b39f1a8960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7998c0ba39e34477b1dd395caa276866', 'request_id': 'req-0a36a62f-a287-4aa6-a6a7-c5b39f1a8960'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:31.382624 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0a36a62f-a287-4aa6-a6a7-c5b39f1a8960 admin admin] The token cache is being invalidate because project 7998c0ba39e34477b1dd395caa276866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:31.382957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0a36a62f-a287-4aa6-a6a7-c5b39f1a8960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:31.384529 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0a36a62f-a287-4aa6-a6a7-c5b39f1a8960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:31.386821 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1005/2023] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:31 2022] DELETE /identity/v3/projects/7998c0ba39e34477b1dd395caa276866 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:31.392726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ac6a8-a6f4-48ef-86b5-b0810ed72efd None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:31.392726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ac6a8-a6f4-48ef-86b5-b0810ed72efd None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:31.393960 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ac6a8-a6f4-48ef-86b5-b0810ed72efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:31.420083 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-048ac6a8-a6f4-48ef-86b5-b0810ed72efd None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:31.421520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-048ac6a8-a6f4-48ef-86b5-b0810ed72efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:31.489483 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1019/2024] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:31.498132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dd990-b67e-49e0-b03d-4d45e44ea618 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:31.498490 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dd990-b67e-49e0-b03d-4d45e44ea618 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:31.500010 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dd990-b67e-49e0-b03d-4d45e44ea618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:31.573916 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-eb8dd990-b67e-49e0-b03d-4d45e44ea618 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:31.581156 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-eb8dd990-b67e-49e0-b03d-4d45e44ea618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:31.596908 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1006/2025] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:31.601780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ac6a8-a6f4-48ef-86b5-b0810ed72efd None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:31.612813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ac6a8-a6f4-48ef-86b5-b0810ed72efd None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:31.618508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ff8fe-e1e2-491b-8c31-1a54e6c22021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:31.619217 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ff8fe-e1e2-491b-8c31-1a54e6c22021 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:31.620090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ff8fe-e1e2-491b-8c31-1a54e6c22021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:31.620090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ff8fe-e1e2-491b-8c31-1a54e6c22021 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:31.620558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ff8fe-e1e2-491b-8c31-1a54e6c22021 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:00:31.621077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ff8fe-e1e2-491b-8c31-1a54e6c22021 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:31.623267 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ff8fe-e1e2-491b-8c31-1a54e6c22021 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:31.637320 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1020/2026] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:00:31.642513 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8dd990-b67e-49e0-b03d-4d45e44ea618 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:31.654148 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8dd990-b67e-49e0-b03d-4d45e44ea618 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:31.657613 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:31.663012 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7777f5d-42a0-4e27-bad5-1932a798ced6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:31.663767 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7777f5d-42a0-4e27-bad5-1932a798ced6 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:31.664114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7777f5d-42a0-4e27-bad5-1932a798ced6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:31.664449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7777f5d-42a0-4e27-bad5-1932a798ced6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:31.665257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7777f5d-42a0-4e27-bad5-1932a798ced6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:31.667836 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7777f5d-42a0-4e27-bad5-1932a798ced6 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:31.790871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1007/2027] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:31 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:00:31.792018 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ff8fe-e1e2-491b-8c31-1a54e6c22021 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:31.802433 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ff8fe-e1e2-491b-8c31-1a54e6c22021 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:31.877131 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecd731-7100-4925-9c2f-c23c22b4712e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:31.877788 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecd731-7100-4925-9c2f-c23c22b4712e admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:31.878078 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecd731-7100-4925-9c2f-c23c22b4712e admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:31.878365 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecd731-7100-4925-9c2f-c23c22b4712e admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:31.879321 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecd731-7100-4925-9c2f-c23c22b4712e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:31.881567 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecd731-7100-4925-9c2f-c23c22b4712e admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:31.895508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:31.977971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1021/2028] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:31 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:31.981384 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7777f5d-42a0-4e27-bad5-1932a798ced6 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:31.997635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7777f5d-42a0-4e27-bad5-1932a798ced6 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:32.005582 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d89a3f-23a8-41a8-84f3-e06da83c477c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:32.008844 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d89a3f-23a8-41a8-84f3-e06da83c477c admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:32.008844 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d89a3f-23a8-41a8-84f3-e06da83c477c admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:32.008844 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d89a3f-23a8-41a8-84f3-e06da83c477c admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:32.008844 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d89a3f-23a8-41a8-84f3-e06da83c477c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:32.009773 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d89a3f-23a8-41a8-84f3-e06da83c477c admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:32.020148 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1008/2029] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:32.024239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecd731-7100-4925-9c2f-c23c22b4712e admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:32.034943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecd731-7100-4925-9c2f-c23c22b4712e admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:32.039950 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ed114-bafd-4d68-80f9-ed415858f752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:32.040604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ed114-bafd-4d68-80f9-ed415858f752 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:32.040948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ed114-bafd-4d68-80f9-ed415858f752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:32.041178 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ed114-bafd-4d68-80f9-ed415858f752 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:32.041884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ed114-bafd-4d68-80f9-ed415858f752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:32.043516 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ed114-bafd-4d68-80f9-ed415858f752 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:32.055236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1022/2030] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:32.059407 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d89a3f-23a8-41a8-84f3-e06da83c477c admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:32.070874 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d89a3f-23a8-41a8-84f3-e06da83c477c admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:32.076280 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc781644-e970-4a17-90ea-cf562b5d476f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:32.077683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc781644-e970-4a17-90ea-cf562b5d476f admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:32.077683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc781644-e970-4a17-90ea-cf562b5d476f admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:32.077683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc781644-e970-4a17-90ea-cf562b5d476f admin admin] PATH_INFO: `/v3/projects/c936fadbd4a44878bf2b65aa790f86f2/users/b400dbf009c948ed937f4f55f3ce5c8c/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:32.094259 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc781644-e970-4a17-90ea-cf562b5d476f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c936fadbd4a44878bf2b65aa790f86f2, user_id=b400dbf009c948ed937f4f55f3ce5c8c, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:32.106550 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc781644-e970-4a17-90ea-cf562b5d476f admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:32.190483 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1009/2031] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:32 2022] PUT /identity/v3/projects/c936fadbd4a44878bf2b65aa790f86f2/users/b400dbf009c948ed937f4f55f3ce5c8c/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:32.202128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9d28c-b455-41ec-b899-228616531130 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:32.202527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9d28c-b455-41ec-b899-228616531130 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:32.202908 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9d28c-b455-41ec-b899-228616531130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:32.253629 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-beb9d28c-b455-41ec-b899-228616531130 None None] MFA Rules not processed for user `b400dbf009c948ed937f4f55f3ce5c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:32.255163 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-beb9d28c-b455-41ec-b899-228616531130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:32.347012 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1023/2032] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:32.348812 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc781644-e970-4a17-90ea-cf562b5d476f admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:32.365756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:32.436995 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc781644-e970-4a17-90ea-cf562b5d476f admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:32.441915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a61991-58cf-4912-9631-7d18582db14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:32.442751 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a61991-58cf-4912-9631-7d18582db14e admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:32.443089 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a61991-58cf-4912-9631-7d18582db14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:32.443371 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a61991-58cf-4912-9631-7d18582db14e admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:32.444083 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a61991-58cf-4912-9631-7d18582db14e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:32.446028 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a61991-58cf-4912-9631-7d18582db14e admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:32.581072 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1010/2033] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:32 2022] POST /identity/v3/projects => generated 383 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:32.587681 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9d28c-b455-41ec-b899-228616531130 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:32.607530 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9d28c-b455-41ec-b899-228616531130 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:32.700363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a30d8c-4cf9-4088-98d6-43a9c5177a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:32.701148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a30d8c-4cf9-4088-98d6-43a9c5177a24 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:32.701493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a30d8c-4cf9-4088-98d6-43a9c5177a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:32.701885 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a30d8c-4cf9-4088-98d6-43a9c5177a24 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:32.702675 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a30d8c-4cf9-4088-98d6-43a9c5177a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:32.704831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a30d8c-4cf9-4088-98d6-43a9c5177a24 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:32.729093 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:32.814405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1024/2034] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:32 2022] POST /identity/v3/users => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:00:32.818235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a61991-58cf-4912-9631-7d18582db14e admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:32.828219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a61991-58cf-4912-9631-7d18582db14e admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:32.832805 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7823c68-b145-4cd8-baa4-e2a7b53d45fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:32.833350 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7823c68-b145-4cd8-baa4-e2a7b53d45fe admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:32.833631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7823c68-b145-4cd8-baa4-e2a7b53d45fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:32.833905 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7823c68-b145-4cd8-baa4-e2a7b53d45fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:32.834591 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7823c68-b145-4cd8-baa4-e2a7b53d45fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:32.836868 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7823c68-b145-4cd8-baa4-e2a7b53d45fe admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:32.847242 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1011/2035] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:00:32.852009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a30d8c-4cf9-4088-98d6-43a9c5177a24 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:32.861916 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a30d8c-4cf9-4088-98d6-43a9c5177a24 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:32.866780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ee614-6fda-4132-8e9b-6392cbceb7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:32.867468 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ee614-6fda-4132-8e9b-6392cbceb7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:32.871619 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ee614-6fda-4132-8e9b-6392cbceb7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:32.871619 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ee614-6fda-4132-8e9b-6392cbceb7ce admin admin] PATH_INFO: `/v3/projects/efbeea27ce01444eae46bca07eab163d/users/73722988535f45f5a4c101539f2a974b/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:32.883642 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ee614-6fda-4132-8e9b-6392cbceb7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=efbeea27ce01444eae46bca07eab163d, user_id=73722988535f45f5a4c101539f2a974b, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:32.886315 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ee614-6fda-4132-8e9b-6392cbceb7ce admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:33.018319 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1025/2036] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:32 2022] PUT /identity/v3/projects/efbeea27ce01444eae46bca07eab163d/users/73722988535f45f5a4c101539f2a974b/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:33.023013 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7823c68-b145-4cd8-baa4-e2a7b53d45fe admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:33.033352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7823c68-b145-4cd8-baa4-e2a7b53d45fe admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:33.097847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e98e86-c21a-401c-a39a-a142f2b23fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:33.098519 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e98e86-c21a-401c-a39a-a142f2b23fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:33.098700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e98e86-c21a-401c-a39a-a142f2b23fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:33.099034 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e98e86-c21a-401c-a39a-a142f2b23fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:33.099737 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e98e86-c21a-401c-a39a-a142f2b23fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:33.101527 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e98e86-c21a-401c-a39a-a142f2b23fa2 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:33.113826 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1012/2037] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:33.118229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ee614-6fda-4132-8e9b-6392cbceb7ce admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:33.128855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ee614-6fda-4132-8e9b-6392cbceb7ce admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:33.134228 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff979b-63bd-47ab-971b-4c40073f56d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:33.134931 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff979b-63bd-47ab-971b-4c40073f56d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:33.135216 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff979b-63bd-47ab-971b-4c40073f56d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:33.135501 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff979b-63bd-47ab-971b-4c40073f56d2 admin admin] PATH_INFO: `/v3/projects/efbeea27ce01444eae46bca07eab163d/users/73722988535f45f5a4c101539f2a974b/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:33.138069 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff979b-63bd-47ab-971b-4c40073f56d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efbeea27ce01444eae46bca07eab163d, user_id=73722988535f45f5a4c101539f2a974b, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:33.145976 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff979b-63bd-47ab-971b-4c40073f56d2 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:33.155280 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1026/2038] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:33 2022] PUT /identity/v3/projects/efbeea27ce01444eae46bca07eab163d/users/73722988535f45f5a4c101539f2a974b/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:33.166783 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47545aaa-1185-4327-931d-39455e17dd03 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:33.167103 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47545aaa-1185-4327-931d-39455e17dd03 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:33.167435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47545aaa-1185-4327-931d-39455e17dd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:33.201825 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-47545aaa-1185-4327-931d-39455e17dd03 None None] MFA Rules not processed for user `73722988535f45f5a4c101539f2a974b`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:33.203100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-47545aaa-1185-4327-931d-39455e17dd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:33.281199 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1013/2039] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:33.293866 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff979b-63bd-47ab-971b-4c40073f56d2 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:33.295809 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-58ff979b-63bd-47ab-971b-4c40073f56d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:33.354645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff979b-63bd-47ab-971b-4c40073f56d2 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:33.358238 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131eda0-4914-4a12-9936-ee19e25df4d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:33.358982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131eda0-4914-4a12-9936-ee19e25df4d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:33.359264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131eda0-4914-4a12-9936-ee19e25df4d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:33.359551 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131eda0-4914-4a12-9936-ee19e25df4d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:33.369397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131eda0-4914-4a12-9936-ee19e25df4d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:33.370929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131eda0-4914-4a12-9936-ee19e25df4d4 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:33.380497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1027/2040] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:33.443529 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:33.525832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47545aaa-1185-4327-931d-39455e17dd03 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:33.535754 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47545aaa-1185-4327-931d-39455e17dd03 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:33.539415 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2bc189-c79d-4eb4-b4a8-2889fdd6b356 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:33.540033 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bc189-c79d-4eb4-b4a8-2889fdd6b356 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:33.540320 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bc189-c79d-4eb4-b4a8-2889fdd6b356 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:33.540601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bc189-c79d-4eb4-b4a8-2889fdd6b356 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:33.599715 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2bc189-c79d-4eb4-b4a8-2889fdd6b356 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:33.601820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2bc189-c79d-4eb4-b4a8-2889fdd6b356 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:33.606901 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:33.612561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1014/2041] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:00:34.088720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:34.137587 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131eda0-4914-4a12-9936-ee19e25df4d4 service cinder] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:34.159819 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:34.206232 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131eda0-4914-4a12-9936-ee19e25df4d4 service cinder] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:34.211594 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea954bd-e2a1-4a0e-afb9-6aa140abdf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:34.212242 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea954bd-e2a1-4a0e-afb9-6aa140abdf95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:34.212531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea954bd-e2a1-4a0e-afb9-6aa140abdf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:34.213017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea954bd-e2a1-4a0e-afb9-6aa140abdf95 admin admin] PATH_INFO: `/v3/users/b400dbf009c948ed937f4f55f3ce5c8c` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:34.214264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea954bd-e2a1-4a0e-afb9-6aa140abdf95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b400dbf009c948ed937f4f55f3ce5c8c)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:34.216223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea954bd-e2a1-4a0e-afb9-6aa140abdf95 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:34.248897 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:34.437766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-4ea954bd-e2a1-4a0e-afb9-6aa140abdf95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b400dbf009c948ed937f4f55f3ce5c8c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:34.445609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-4ea954bd-e2a1-4a0e-afb9-6aa140abdf95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b400dbf009c948ed937f4f55f3ce5c8c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:34.446347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-4ea954bd-e2a1-4a0e-afb9-6aa140abdf95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b400dbf009c948ed937f4f55f3ce5c8c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:34.458516 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-4ea954bd-e2a1-4a0e-afb9-6aa140abdf95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b400dbf009c948ed937f4f55f3ce5c8c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:34.459353 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-4ea954bd-e2a1-4a0e-afb9-6aa140abdf95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b400dbf009c948ed937f4f55f3ce5c8c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:34.506116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:34.549063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1028/2042] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:34 2022] DELETE /identity/v3/users/b400dbf009c948ed937f4f55f3ce5c8c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:34.555995 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf18ac-47c2-42b3-8f20-c78de324538d None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:34.556497 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf18ac-47c2-42b3-8f20-c78de324538d None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:34.556599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf18ac-47c2-42b3-8f20-c78de324538d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:34.574514 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:34.576568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-a8cf18ac-47c2-42b3-8f20-c78de324538d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:34.579055 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a8cf18ac-47c2-42b3-8f20-c78de324538d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:34.639310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1015/2043] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:34.650196 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea954bd-e2a1-4a0e-afb9-6aa140abdf95 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:34.651681 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-4ea954bd-e2a1-4a0e-afb9-6aa140abdf95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:34.709651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea954bd-e2a1-4a0e-afb9-6aa140abdf95 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:34.714017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3fbc1-a416-46d4-9049-7b9b9dae64c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:34.714634 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3fbc1-a416-46d4-9049-7b9b9dae64c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:34.714951 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3fbc1-a416-46d4-9049-7b9b9dae64c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:34.715230 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3fbc1-a416-46d4-9049-7b9b9dae64c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:34.724268 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3fbc1-a416-46d4-9049-7b9b9dae64c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:34.725789 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3fbc1-a416-46d4-9049-7b9b9dae64c3 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:34.735191 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1029/2044] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:34.848543 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:35.253422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf18ac-47c2-42b3-8f20-c78de324538d None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:35.254898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a8cf18ac-47c2-42b3-8f20-c78de324538d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:35.267617 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf18ac-47c2-42b3-8f20-c78de324538d None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:35.273253 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c74862-3e0a-48f5-9a1a-b106701e504a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:35.273915 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c74862-3e0a-48f5-9a1a-b106701e504a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:35.274464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c74862-3e0a-48f5-9a1a-b106701e504a admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:35.274464 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c74862-3e0a-48f5-9a1a-b106701e504a admin admin] PATH_INFO: `/v3/projects/c936fadbd4a44878bf2b65aa790f86f2` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:35.279660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c74862-3e0a-48f5-9a1a-b106701e504a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c936fadbd4a44878bf2b65aa790f86f2)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:35.279660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c74862-3e0a-48f5-9a1a-b106701e504a admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:35.404359 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-10c74862-3e0a-48f5-9a1a-b106701e504a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c936fadbd4a44878bf2b65aa790f86f2', 'request_id': 'req-10c74862-3e0a-48f5-9a1a-b106701e504a'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:35.410996 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-10c74862-3e0a-48f5-9a1a-b106701e504a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c936fadbd4a44878bf2b65aa790f86f2', 'request_id': 'req-10c74862-3e0a-48f5-9a1a-b106701e504a'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:35.520166 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-10c74862-3e0a-48f5-9a1a-b106701e504a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c936fadbd4a44878bf2b65aa790f86f2', 'request_id': 'req-10c74862-3e0a-48f5-9a1a-b106701e504a'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:35.532302 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-10c74862-3e0a-48f5-9a1a-b106701e504a admin admin] The token cache is being invalidate because project c936fadbd4a44878bf2b65aa790f86f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:35.532685 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-10c74862-3e0a-48f5-9a1a-b106701e504a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:35.533409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-10c74862-3e0a-48f5-9a1a-b106701e504a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:35.535058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1016/2045] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:35 2022] DELETE /identity/v3/projects/c936fadbd4a44878bf2b65aa790f86f2 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:35.539002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3fbc1-a416-46d4-9049-7b9b9dae64c3 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:35.549177 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3fbc1-a416-46d4-9049-7b9b9dae64c3 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:35.610539 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844e25a-0188-4f3a-87d1-bd64871b396b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:35.611236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844e25a-0188-4f3a-87d1-bd64871b396b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:35.611563 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844e25a-0188-4f3a-87d1-bd64871b396b admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:35.611805 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844e25a-0188-4f3a-87d1-bd64871b396b admin admin] PATH_INFO: `/v3/users/73722988535f45f5a4c101539f2a974b` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:35.613031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844e25a-0188-4f3a-87d1-bd64871b396b admin admin] RBAC: Authorizing `identity:delete_user(user_id=73722988535f45f5a4c101539f2a974b)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:35.614994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844e25a-0188-4f3a-87d1-bd64871b396b admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:35.828471 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d844e25a-0188-4f3a-87d1-bd64871b396b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73722988535f45f5a4c101539f2a974b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:35.835773 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d844e25a-0188-4f3a-87d1-bd64871b396b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73722988535f45f5a4c101539f2a974b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:35.836445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d844e25a-0188-4f3a-87d1-bd64871b396b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73722988535f45f5a4c101539f2a974b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:35.849524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d844e25a-0188-4f3a-87d1-bd64871b396b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73722988535f45f5a4c101539f2a974b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:35.850677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d844e25a-0188-4f3a-87d1-bd64871b396b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73722988535f45f5a4c101539f2a974b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:35.910623 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1030/2046] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:35 2022] DELETE /identity/v3/users/73722988535f45f5a4c101539f2a974b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:36.576669 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c74862-3e0a-48f5-9a1a-b106701e504a admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:36.578370 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-10c74862-3e0a-48f5-9a1a-b106701e504a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:36.595980 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c74862-3e0a-48f5-9a1a-b106701e504a admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:36.597133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:36.662662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71812b-722a-4d38-8fba-6f075ecb8d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:36.663371 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71812b-722a-4d38-8fba-6f075ecb8d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:36.663657 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71812b-722a-4d38-8fba-6f075ecb8d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:36.663938 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71812b-722a-4d38-8fba-6f075ecb8d9a admin admin] PATH_INFO: `/v3/projects/efbeea27ce01444eae46bca07eab163d` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:36.665112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71812b-722a-4d38-8fba-6f075ecb8d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=efbeea27ce01444eae46bca07eab163d)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:36.667070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71812b-722a-4d38-8fba-6f075ecb8d9a admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:36.787731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-bd71812b-722a-4d38-8fba-6f075ecb8d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efbeea27ce01444eae46bca07eab163d', 'request_id': 'req-bd71812b-722a-4d38-8fba-6f075ecb8d9a'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:36.794191 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-bd71812b-722a-4d38-8fba-6f075ecb8d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efbeea27ce01444eae46bca07eab163d', 'request_id': 'req-bd71812b-722a-4d38-8fba-6f075ecb8d9a'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:36.905410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-bd71812b-722a-4d38-8fba-6f075ecb8d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efbeea27ce01444eae46bca07eab163d', 'request_id': 'req-bd71812b-722a-4d38-8fba-6f075ecb8d9a'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:36.918161 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-bd71812b-722a-4d38-8fba-6f075ecb8d9a admin admin] The token cache is being invalidate because project efbeea27ce01444eae46bca07eab163d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:36.918161 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-bd71812b-722a-4d38-8fba-6f075ecb8d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:36.918692 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-bd71812b-722a-4d38-8fba-6f075ecb8d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:36.920262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1017/2047] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:36 2022] DELETE /identity/v3/projects/efbeea27ce01444eae46bca07eab163d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:36.927244 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f1f73-4073-470e-b632-7d26c92ddea6 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:36.927750 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f1f73-4073-470e-b632-7d26c92ddea6 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:36.927846 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f1f73-4073-470e-b632-7d26c92ddea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:36.950419 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-685f1f73-4073-470e-b632-7d26c92ddea6 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:36.951734 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-685f1f73-4073-470e-b632-7d26c92ddea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:37.009947 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1031/2048] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:37.018035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e19a8-0a86-4b6a-95ef-0efa7a0d5a1e None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:37.018528 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e19a8-0a86-4b6a-95ef-0efa7a0d5a1e None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:37.018851 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e19a8-0a86-4b6a-95ef-0efa7a0d5a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:37.039820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-436e19a8-0a86-4b6a-95ef-0efa7a0d5a1e None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:37.041015 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-436e19a8-0a86-4b6a-95ef-0efa7a0d5a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:37.049080 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1018/2049] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:37.058150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f1f73-4073-470e-b632-7d26c92ddea6 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:37.064279 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:37.068139 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f1f73-4073-470e-b632-7d26c92ddea6 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:37.073959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea141a24-04d7-4c3b-8cec-b8230cbeef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:37.074595 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea141a24-04d7-4c3b-8cec-b8230cbeef71 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:37.074924 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea141a24-04d7-4c3b-8cec-b8230cbeef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:37.075239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea141a24-04d7-4c3b-8cec-b8230cbeef71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:37.075971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea141a24-04d7-4c3b-8cec-b8230cbeef71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:00:37.076286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea141a24-04d7-4c3b-8cec-b8230cbeef71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:37.077923 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea141a24-04d7-4c3b-8cec-b8230cbeef71 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:37.092968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1032/2050] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:00:37.094375 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e19a8-0a86-4b6a-95ef-0efa7a0d5a1e None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:37.103799 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e19a8-0a86-4b6a-95ef-0efa7a0d5a1e None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:37.108772 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97593e3c-8c1c-4f97-9e70-ae19fa297cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:37.110305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97593e3c-8c1c-4f97-9e70-ae19fa297cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:37.110305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97593e3c-8c1c-4f97-9e70-ae19fa297cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:37.110305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97593e3c-8c1c-4f97-9e70-ae19fa297cc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:37.110670 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97593e3c-8c1c-4f97-9e70-ae19fa297cc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:37.112615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97593e3c-8c1c-4f97-9e70-ae19fa297cc2 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:37.178336 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1019/2051] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:37 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:37.182601 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea141a24-04d7-4c3b-8cec-b8230cbeef71 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:37.192918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea141a24-04d7-4c3b-8cec-b8230cbeef71 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:37.253313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9e038-93a6-4342-969d-bbb463b9ec50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:37.254020 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9e038-93a6-4342-969d-bbb463b9ec50 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:37.254374 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9e038-93a6-4342-969d-bbb463b9ec50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:37.254905 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9e038-93a6-4342-969d-bbb463b9ec50 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:37.255784 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9e038-93a6-4342-969d-bbb463b9ec50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:37.258178 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9e038-93a6-4342-969d-bbb463b9ec50 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:37.360613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1033/2052] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:37 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:37.364677 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97593e3c-8c1c-4f97-9e70-ae19fa297cc2 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:37.376417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97593e3c-8c1c-4f97-9e70-ae19fa297cc2 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:37.388194 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2dc38-3333-45b6-bc6d-245f3fb3170a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:37.388837 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2dc38-3333-45b6-bc6d-245f3fb3170a admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:37.389124 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2dc38-3333-45b6-bc6d-245f3fb3170a admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:37.389447 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2dc38-3333-45b6-bc6d-245f3fb3170a admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:37.390190 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2dc38-3333-45b6-bc6d-245f3fb3170a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:37.392017 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2dc38-3333-45b6-bc6d-245f3fb3170a admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:37.407857 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1020/2053] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:37.409211 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9e038-93a6-4342-969d-bbb463b9ec50 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:37.421426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9e038-93a6-4342-969d-bbb463b9ec50 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:37.426187 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d12a-55ac-4f23-bc85-5c54db5f7f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:37.426865 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d12a-55ac-4f23-bc85-5c54db5f7f83 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:37.427273 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d12a-55ac-4f23-bc85-5c54db5f7f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:37.427519 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d12a-55ac-4f23-bc85-5c54db5f7f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:37.428244 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911d12a-55ac-4f23-bc85-5c54db5f7f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:37.430041 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911d12a-55ac-4f23-bc85-5c54db5f7f83 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:37.442533 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1034/2054] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:37.447196 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2dc38-3333-45b6-bc6d-245f3fb3170a admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:37.459035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2dc38-3333-45b6-bc6d-245f3fb3170a admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:37.464436 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8ff8f-6452-431e-b041-334c74f05253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:37.465115 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8ff8f-6452-431e-b041-334c74f05253 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:37.465402 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8ff8f-6452-431e-b041-334c74f05253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:37.465703 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8ff8f-6452-431e-b041-334c74f05253 admin admin] PATH_INFO: `/v3/projects/e62db2c6c7d846ff807ac67c8d8d715e/users/8ab708da71f04d2ab83f3f438a8d49d0/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:37.481413 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8ff8f-6452-431e-b041-334c74f05253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e62db2c6c7d846ff807ac67c8d8d715e, user_id=8ab708da71f04d2ab83f3f438a8d49d0, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:37.484132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8ff8f-6452-431e-b041-334c74f05253 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:37.603306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1021/2055] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:37 2022] PUT /identity/v3/projects/e62db2c6c7d846ff807ac67c8d8d715e/users/8ab708da71f04d2ab83f3f438a8d49d0/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:37.608462 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80957ebb-d9e9-4b24-b930-6fd972cc67ac None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:37.608750 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80957ebb-d9e9-4b24-b930-6fd972cc67ac None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:37.609034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80957ebb-d9e9-4b24-b930-6fd972cc67ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:37.628333 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-80957ebb-d9e9-4b24-b930-6fd972cc67ac None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:37.629462 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-80957ebb-d9e9-4b24-b930-6fd972cc67ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:37.691808 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1035/2056] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:37.701812 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8ff8f-6452-431e-b041-334c74f05253 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:37.703552 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b5e8ff8f-6452-431e-b041-334c74f05253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:37.738769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:37.762975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8ff8f-6452-431e-b041-334c74f05253 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:37.766829 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c729a-c398-40ad-8482-5d68587780d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:37.767481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c729a-c398-40ad-8482-5d68587780d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:37.767767 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c729a-c398-40ad-8482-5d68587780d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:37.768047 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c729a-c398-40ad-8482-5d68587780d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:37.777856 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c729a-c398-40ad-8482-5d68587780d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:37.779334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c729a-c398-40ad-8482-5d68587780d1 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:37.789518 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1022/2057] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:39.903823 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80957ebb-d9e9-4b24-b930-6fd972cc67ac None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:39.907264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-80957ebb-d9e9-4b24-b930-6fd972cc67ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:39.929534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80957ebb-d9e9-4b24-b930-6fd972cc67ac None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:39.941926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce7720-ab5a-4b05-9112-081246c344ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:39.942835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce7720-ab5a-4b05-9112-081246c344ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:39.943301 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce7720-ab5a-4b05-9112-081246c344ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:39.944261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce7720-ab5a-4b05-9112-081246c344ea admin admin] PATH_INFO: `/v3/users/a67c6e09f3234e7cac6a47193f61664b` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:39.949595 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce7720-ab5a-4b05-9112-081246c344ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a67c6e09f3234e7cac6a47193f61664b)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:39.955516 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce7720-ab5a-4b05-9112-081246c344ea admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:40.213167 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-88ce7720-ab5a-4b05-9112-081246c344ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a67c6e09f3234e7cac6a47193f61664b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:40.243358 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-88ce7720-ab5a-4b05-9112-081246c344ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a67c6e09f3234e7cac6a47193f61664b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:40.246253 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-88ce7720-ab5a-4b05-9112-081246c344ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a67c6e09f3234e7cac6a47193f61664b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:40.272278 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:40.284819 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-88ce7720-ab5a-4b05-9112-081246c344ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a67c6e09f3234e7cac6a47193f61664b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:40.286607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-88ce7720-ab5a-4b05-9112-081246c344ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a67c6e09f3234e7cac6a47193f61664b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:40.425152 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1036/2058] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:39 2022] DELETE /identity/v3/users/a67c6e09f3234e7cac6a47193f61664b => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:40.434312 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5dbfc-cabc-431f-ab66-51eac2858ee1 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:40.434834 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5dbfc-cabc-431f-ab66-51eac2858ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:40.435764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5dbfc-cabc-431f-ab66-51eac2858ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:40.475666 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-b5c5dbfc-cabc-431f-ab66-51eac2858ee1 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:40.477511 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b5c5dbfc-cabc-431f-ab66-51eac2858ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:40.550091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1023/2059] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:40.584871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce7720-ab5a-4b05-9112-081246c344ea admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:40.602795 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-88ce7720-ab5a-4b05-9112-081246c344ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:40.727156 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce7720-ab5a-4b05-9112-081246c344ea admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:40.734426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174df937-11e7-417f-8b55-e1352706e949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:40.734426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174df937-11e7-417f-8b55-e1352706e949 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:40.734426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174df937-11e7-417f-8b55-e1352706e949 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:40.734426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174df937-11e7-417f-8b55-e1352706e949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:40.746333 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174df937-11e7-417f-8b55-e1352706e949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:40.747858 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174df937-11e7-417f-8b55-e1352706e949 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:40.760557 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1037/2060] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:42.297245 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5dbfc-cabc-431f-ab66-51eac2858ee1 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:42.298851 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b5c5dbfc-cabc-431f-ab66-51eac2858ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:42.315881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5dbfc-cabc-431f-ab66-51eac2858ee1 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:42.322604 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca2aa8-47d3-4026-89a2-17492742dfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:42.323513 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca2aa8-47d3-4026-89a2-17492742dfc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:42.323953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca2aa8-47d3-4026-89a2-17492742dfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:42.324382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca2aa8-47d3-4026-89a2-17492742dfc3 admin admin] PATH_INFO: `/v3/projects/4c7af95962764953944061ed194a12ca` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:42.325943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca2aa8-47d3-4026-89a2-17492742dfc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c7af95962764953944061ed194a12ca)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:42.328006 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca2aa8-47d3-4026-89a2-17492742dfc3 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:42.459723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e9ca2aa8-47d3-4026-89a2-17492742dfc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c7af95962764953944061ed194a12ca', 'request_id': 'req-e9ca2aa8-47d3-4026-89a2-17492742dfc3'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:42.475162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e9ca2aa8-47d3-4026-89a2-17492742dfc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c7af95962764953944061ed194a12ca', 'request_id': 'req-e9ca2aa8-47d3-4026-89a2-17492742dfc3'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:42.501737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174df937-11e7-417f-8b55-e1352706e949 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:42.507527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-174df937-11e7-417f-8b55-e1352706e949 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:42.533360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174df937-11e7-417f-8b55-e1352706e949 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:42.613317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e9ca2aa8-47d3-4026-89a2-17492742dfc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c7af95962764953944061ed194a12ca', 'request_id': 'req-e9ca2aa8-47d3-4026-89a2-17492742dfc3'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:42.652844 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e9ca2aa8-47d3-4026-89a2-17492742dfc3 admin admin] The token cache is being invalidate because project 4c7af95962764953944061ed194a12ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:42.653948 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e9ca2aa8-47d3-4026-89a2-17492742dfc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:42.658600 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e9ca2aa8-47d3-4026-89a2-17492742dfc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:42.666937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1024/2061] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:42 2022] DELETE /identity/v3/projects/4c7af95962764953944061ed194a12ca => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:42.669204 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca2aa8-47d3-4026-89a2-17492742dfc3 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:42.673273 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e9ca2aa8-47d3-4026-89a2-17492742dfc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:42.677652 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb51e9-d2ff-484e-ad58-029d61712952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:42.678415 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb51e9-d2ff-484e-ad58-029d61712952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:42.678722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb51e9-d2ff-484e-ad58-029d61712952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:42.680901 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb51e9-d2ff-484e-ad58-029d61712952 admin admin] PATH_INFO: `/v3/users/7bb9fab7d9bf4305b6636df09a4ae6d2` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:42.687597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb51e9-d2ff-484e-ad58-029d61712952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb9fab7d9bf4305b6636df09a4ae6d2)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:42.706484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb51e9-d2ff-484e-ad58-029d61712952 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:42.708964 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca2aa8-47d3-4026-89a2-17492742dfc3 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:42.730626 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cbe42-6c96-4a13-8cf3-183a430c8f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:42.731469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cbe42-6c96-4a13-8cf3-183a430c8f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:42.731989 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cbe42-6c96-4a13-8cf3-183a430c8f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:42.732371 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cbe42-6c96-4a13-8cf3-183a430c8f7d admin admin] PATH_INFO: `/v3/users/7a4333678dee4b1f9ed9d4c575453ad4` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:42.734228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cbe42-6c96-4a13-8cf3-183a430c8f7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a4333678dee4b1f9ed9d4c575453ad4)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:42.736967 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cbe42-6c96-4a13-8cf3-183a430c8f7d admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:42.981099 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7ceb51e9-d2ff-484e-ad58-029d61712952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb9fab7d9bf4305b6636df09a4ae6d2'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:42.983415 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-475cbe42-6c96-4a13-8cf3-183a430c8f7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a4333678dee4b1f9ed9d4c575453ad4'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:42.994093 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7ceb51e9-d2ff-484e-ad58-029d61712952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb9fab7d9bf4305b6636df09a4ae6d2'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:42.995628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7ceb51e9-d2ff-484e-ad58-029d61712952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb9fab7d9bf4305b6636df09a4ae6d2'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:42.997557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:43.003765 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-475cbe42-6c96-4a13-8cf3-183a430c8f7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a4333678dee4b1f9ed9d4c575453ad4'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:43.024677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7ceb51e9-d2ff-484e-ad58-029d61712952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb9fab7d9bf4305b6636df09a4ae6d2'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:43.025443 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7ceb51e9-d2ff-484e-ad58-029d61712952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb9fab7d9bf4305b6636df09a4ae6d2'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:43.091363 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-475cbe42-6c96-4a13-8cf3-183a430c8f7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a4333678dee4b1f9ed9d4c575453ad4'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:43.092035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-475cbe42-6c96-4a13-8cf3-183a430c8f7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a4333678dee4b1f9ed9d4c575453ad4'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:43.113484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-475cbe42-6c96-4a13-8cf3-183a430c8f7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a4333678dee4b1f9ed9d4c575453ad4'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:43.130504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1025/2062] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:42 2022] DELETE /identity/v3/users/7a4333678dee4b1f9ed9d4c575453ad4 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:43.133906 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cbe42-6c96-4a13-8cf3-183a430c8f7d admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:43.137503 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-475cbe42-6c96-4a13-8cf3-183a430c8f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:43.183254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1038/2063] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:42 2022] DELETE /identity/v3/users/7bb9fab7d9bf4305b6636df09a4ae6d2 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:43.185208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8785a-b9b2-4cee-94de-e83ea41fbae8 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:43.185498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8785a-b9b2-4cee-94de-e83ea41fbae8 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:43.185779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8785a-b9b2-4cee-94de-e83ea41fbae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:43.211251 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:43.233054 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-c9a8785a-b9b2-4cee-94de-e83ea41fbae8 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:43.234932 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-c9a8785a-b9b2-4cee-94de-e83ea41fbae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:43.285192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cbe42-6c96-4a13-8cf3-183a430c8f7d admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:43.382841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1039/2064] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:00:43.392222 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8785a-b9b2-4cee-94de-e83ea41fbae8 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:43.395926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-c9a8785a-b9b2-4cee-94de-e83ea41fbae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:43.401080 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c09c67-6ead-45b7-9db9-0ac0cb454d1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:43.401720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c09c67-6ead-45b7-9db9-0ac0cb454d1d service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:43.402003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c09c67-6ead-45b7-9db9-0ac0cb454d1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:43.402278 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c09c67-6ead-45b7-9db9-0ac0cb454d1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:43.404460 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-64c09c67-6ead-45b7-9db9-0ac0cb454d1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:43.500625 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8785a-b9b2-4cee-94de-e83ea41fbae8 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:43.505204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcda137-5f22-45a0-a0d1-dddc71130e69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:43.507717 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcda137-5f22-45a0-a0d1-dddc71130e69 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:43.510026 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcda137-5f22-45a0-a0d1-dddc71130e69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:43.511140 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcda137-5f22-45a0-a0d1-dddc71130e69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:43.526036 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcda137-5f22-45a0-a0d1-dddc71130e69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:43.528946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcda137-5f22-45a0-a0d1-dddc71130e69 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:43.559747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1040/2065] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:43.566592 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c09c67-6ead-45b7-9db9-0ac0cb454d1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:43.568376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c09c67-6ead-45b7-9db9-0ac0cb454d1d service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:43.594527 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1026/2066] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:44.504486 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcda137-5f22-45a0-a0d1-dddc71130e69 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:44.506100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-5fcda137-5f22-45a0-a0d1-dddc71130e69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:44.529236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcda137-5f22-45a0-a0d1-dddc71130e69 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:44.550141 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be57a4b-e73a-4006-904a-81242abba8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:44.550842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be57a4b-e73a-4006-904a-81242abba8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:44.551134 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be57a4b-e73a-4006-904a-81242abba8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:44.551477 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be57a4b-e73a-4006-904a-81242abba8ba admin admin] PATH_INFO: `/v3/projects/6346bbca68374e02b7d29248046949dc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:44.556912 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be57a4b-e73a-4006-904a-81242abba8ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=6346bbca68374e02b7d29248046949dc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:44.559591 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be57a4b-e73a-4006-904a-81242abba8ba admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:44.593654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c09c67-6ead-45b7-9db9-0ac0cb454d1d service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:44.597418 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-64c09c67-6ead-45b7-9db9-0ac0cb454d1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:44.629443 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c09c67-6ead-45b7-9db9-0ac0cb454d1d service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:44.644577 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd7530-ae99-43d6-a642-d7bd4e52a15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:44.645544 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd7530-ae99-43d6-a642-d7bd4e52a15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:44.647907 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd7530-ae99-43d6-a642-d7bd4e52a15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:44.648690 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd7530-ae99-43d6-a642-d7bd4e52a15c admin admin] PATH_INFO: `/v3/projects/d7102031770c44b9baad0d2e0189d006` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:44.652270 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd7530-ae99-43d6-a642-d7bd4e52a15c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7102031770c44b9baad0d2e0189d006)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:44.656663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd7530-ae99-43d6-a642-d7bd4e52a15c admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:44.816920 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:44.828823 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5be57a4b-e73a-4006-904a-81242abba8ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6346bbca68374e02b7d29248046949dc', 'request_id': 'req-5be57a4b-e73a-4006-904a-81242abba8ba'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:44.858373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c7cd7530-ae99-43d6-a642-d7bd4e52a15c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7102031770c44b9baad0d2e0189d006', 'request_id': 'req-c7cd7530-ae99-43d6-a642-d7bd4e52a15c'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:44.860353 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5be57a4b-e73a-4006-904a-81242abba8ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6346bbca68374e02b7d29248046949dc', 'request_id': 'req-5be57a4b-e73a-4006-904a-81242abba8ba'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:44.870039 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c7cd7530-ae99-43d6-a642-d7bd4e52a15c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7102031770c44b9baad0d2e0189d006', 'request_id': 'req-c7cd7530-ae99-43d6-a642-d7bd4e52a15c'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:44.935874 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5be57a4b-e73a-4006-904a-81242abba8ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6346bbca68374e02b7d29248046949dc', 'request_id': 'req-5be57a4b-e73a-4006-904a-81242abba8ba'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:44.961335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5be57a4b-e73a-4006-904a-81242abba8ba admin admin] The token cache is being invalidate because project 6346bbca68374e02b7d29248046949dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:44.961641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5be57a4b-e73a-4006-904a-81242abba8ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:44.964418 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5be57a4b-e73a-4006-904a-81242abba8ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:44.970545 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1041/2067] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:44 2022] DELETE /identity/v3/projects/6346bbca68374e02b7d29248046949dc => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:44.972306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f890026-fd8a-41e1-b59c-4d4b4319f307 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:44.972755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f890026-fd8a-41e1-b59c-4d4b4319f307 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:44.974040 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f890026-fd8a-41e1-b59c-4d4b4319f307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:44.991883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c7cd7530-ae99-43d6-a642-d7bd4e52a15c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7102031770c44b9baad0d2e0189d006', 'request_id': 'req-c7cd7530-ae99-43d6-a642-d7bd4e52a15c'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:45.017010 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c7cd7530-ae99-43d6-a642-d7bd4e52a15c admin admin] The token cache is being invalidate because project d7102031770c44b9baad0d2e0189d006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:45.017322 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c7cd7530-ae99-43d6-a642-d7bd4e52a15c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:45.018045 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c7cd7530-ae99-43d6-a642-d7bd4e52a15c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:45.035519 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1027/2068] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:44 2022] DELETE /identity/v3/projects/d7102031770c44b9baad0d2e0189d006 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:45.036537 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd7530-ae99-43d6-a642-d7bd4e52a15c admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:45.040611 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-c7cd7530-ae99-43d6-a642-d7bd4e52a15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:45.053734 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-3f890026-fd8a-41e1-b59c-4d4b4319f307 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:45.058656 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-3f890026-fd8a-41e1-b59c-4d4b4319f307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:45.131276 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:45.203343 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd7530-ae99-43d6-a642-d7bd4e52a15c admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:45.207837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1042/2069] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:45.216332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac295d07-dcda-4556-9250-87aa527ddf3a None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:45.216696 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac295d07-dcda-4556-9250-87aa527ddf3a None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:45.217135 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac295d07-dcda-4556-9250-87aa527ddf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:45.220265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44773a9-7a2c-44fd-8640-03f4575c7283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:45.222270 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44773a9-7a2c-44fd-8640-03f4575c7283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:45.226351 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44773a9-7a2c-44fd-8640-03f4575c7283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:45.226660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44773a9-7a2c-44fd-8640-03f4575c7283 admin admin] PATH_INFO: `/v3/users/1acea39349724e06b5372a6305f29e1c` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:45.229834 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44773a9-7a2c-44fd-8640-03f4575c7283 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1acea39349724e06b5372a6305f29e1c)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:45.238134 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44773a9-7a2c-44fd-8640-03f4575c7283 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:45.253309 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-ac295d07-dcda-4556-9250-87aa527ddf3a None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:45.254894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ac295d07-dcda-4556-9250-87aa527ddf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:45.270396 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1043/2070] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:00:45.271507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac295d07-dcda-4556-9250-87aa527ddf3a None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:45.296389 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac295d07-dcda-4556-9250-87aa527ddf3a None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:45.305843 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03692e-9629-4fc0-a289-ce50d1e12108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:45.306488 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03692e-9629-4fc0-a289-ce50d1e12108 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:45.306801 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03692e-9629-4fc0-a289-ce50d1e12108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:45.307088 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03692e-9629-4fc0-a289-ce50d1e12108 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:45.307803 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03692e-9629-4fc0-a289-ce50d1e12108 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:00:45.308124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03692e-9629-4fc0-a289-ce50d1e12108 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:45.309732 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03692e-9629-4fc0-a289-ce50d1e12108 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:45.325345 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1044/2071] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:00:45.329764 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03692e-9629-4fc0-a289-ce50d1e12108 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:45.341128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03692e-9629-4fc0-a289-ce50d1e12108 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:45.346494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578542ee-c1b1-46dc-8787-47fe9c3da2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:45.347152 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578542ee-c1b1-46dc-8787-47fe9c3da2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:45.347447 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578542ee-c1b1-46dc-8787-47fe9c3da2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:45.347883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578542ee-c1b1-46dc-8787-47fe9c3da2f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:45.348569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578542ee-c1b1-46dc-8787-47fe9c3da2f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:45.351339 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578542ee-c1b1-46dc-8787-47fe9c3da2f7 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:45.479388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1045/2072] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:45 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:00:45.480660 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d55f79-fdb1-4cb1-b348-48cb7a76cd38 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:45.480958 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d55f79-fdb1-4cb1-b348-48cb7a76cd38 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:45.481230 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d55f79-fdb1-4cb1-b348-48cb7a76cd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:45.511996 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c44773a9-7a2c-44fd-8640-03f4575c7283 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1acea39349724e06b5372a6305f29e1c'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:45.524001 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c44773a9-7a2c-44fd-8640-03f4575c7283 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1acea39349724e06b5372a6305f29e1c'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:45.532019 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-19d55f79-fdb1-4cb1-b348-48cb7a76cd38 None None] MFA Rules not processed for user `8ab708da71f04d2ab83f3f438a8d49d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:45.533259 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-19d55f79-fdb1-4cb1-b348-48cb7a76cd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:45.598881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1046/2073] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:45.603709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d55f79-fdb1-4cb1-b348-48cb7a76cd38 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:45.615470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c44773a9-7a2c-44fd-8640-03f4575c7283 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1acea39349724e06b5372a6305f29e1c'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:45.616095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c44773a9-7a2c-44fd-8640-03f4575c7283 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1acea39349724e06b5372a6305f29e1c'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:45.631620 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c44773a9-7a2c-44fd-8640-03f4575c7283 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1acea39349724e06b5372a6305f29e1c'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:45.639480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1028/2074] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:45 2022] DELETE /identity/v3/users/1acea39349724e06b5372a6305f29e1c => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:45.640554 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44773a9-7a2c-44fd-8640-03f4575c7283 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:45.642147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-c44773a9-7a2c-44fd-8640-03f4575c7283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:45.698299 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d55f79-fdb1-4cb1-b348-48cb7a76cd38 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:45.767424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44773a9-7a2c-44fd-8640-03f4575c7283 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:45.772844 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b057b-b837-49d3-8afe-954ec8da4a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:45.773174 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa581d-7ef7-4247-b6f2-37a8f99c493e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:45.773502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b057b-b837-49d3-8afe-954ec8da4a15 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:45.773975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b057b-b837-49d3-8afe-954ec8da4a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:45.774080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa581d-7ef7-4247-b6f2-37a8f99c493e admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:45.774252 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b057b-b837-49d3-8afe-954ec8da4a15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:45.774414 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa581d-7ef7-4247-b6f2-37a8f99c493e admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:45.774698 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa581d-7ef7-4247-b6f2-37a8f99c493e admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:45.776778 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b057b-b837-49d3-8afe-954ec8da4a15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:45.776866 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa581d-7ef7-4247-b6f2-37a8f99c493e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:45.777182 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b057b-b837-49d3-8afe-954ec8da4a15 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:45.777651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa581d-7ef7-4247-b6f2-37a8f99c493e admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:45.887792 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1047/2075] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:45 2022] POST /identity/v3/users => generated 288 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:45.891883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa581d-7ef7-4247-b6f2-37a8f99c493e admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:45.893704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1029/2076] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:45 2022] POST /identity/v3/projects => generated 383 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:45.894590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b057b-b837-49d3-8afe-954ec8da4a15 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:45.894770 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-9afa581d-7ef7-4247-b6f2-37a8f99c493e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:45.913545 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa581d-7ef7-4247-b6f2-37a8f99c493e admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:45.988694 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b057b-b837-49d3-8afe-954ec8da4a15 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:45.993877 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3488bf6-7d42-4b18-a1f9-670e3af6face admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:45.994582 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3488bf6-7d42-4b18-a1f9-670e3af6face admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:45.994723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a4b19-df10-47e2-abaa-e4119a7cdecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:45.995003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3488bf6-7d42-4b18-a1f9-670e3af6face admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:45.995858 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3488bf6-7d42-4b18-a1f9-670e3af6face admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:45.995983 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a4b19-df10-47e2-abaa-e4119a7cdecc admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:45.995983 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a4b19-df10-47e2-abaa-e4119a7cdecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:45.995983 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a4b19-df10-47e2-abaa-e4119a7cdecc admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:45.996242 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3488bf6-7d42-4b18-a1f9-670e3af6face admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:45.996848 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a4b19-df10-47e2-abaa-e4119a7cdecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:45.998168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3488bf6-7d42-4b18-a1f9-670e3af6face admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:45.999009 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a4b19-df10-47e2-abaa-e4119a7cdecc admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:46.011134 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1048/2077] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:46.015205 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3488bf6-7d42-4b18-a1f9-670e3af6face admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:46.029087 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3488bf6-7d42-4b18-a1f9-670e3af6face admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:46.035767 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcba7b1-8435-4aa5-8831-4766e9b2ed52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:46.036557 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcba7b1-8435-4aa5-8831-4766e9b2ed52 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:46.036850 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcba7b1-8435-4aa5-8831-4766e9b2ed52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:46.037134 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcba7b1-8435-4aa5-8831-4766e9b2ed52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:46.037870 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcba7b1-8435-4aa5-8831-4766e9b2ed52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:46.039612 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcba7b1-8435-4aa5-8831-4766e9b2ed52 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:46.051755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1049/2078] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:00:46.056427 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcba7b1-8435-4aa5-8831-4766e9b2ed52 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:46.079890 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcba7b1-8435-4aa5-8831-4766e9b2ed52 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:46.087277 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20352dd1-1b37-4b41-912d-801ad567af52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:46.088310 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20352dd1-1b37-4b41-912d-801ad567af52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:46.088749 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20352dd1-1b37-4b41-912d-801ad567af52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:46.089207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20352dd1-1b37-4b41-912d-801ad567af52 admin admin] PATH_INFO: `/v3/projects/6da09a07ce2848cb84666f16588849dc/users/706c93865d0d4980a9f80e00665b1c37/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:46.117360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20352dd1-1b37-4b41-912d-801ad567af52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da09a07ce2848cb84666f16588849dc, user_id=706c93865d0d4980a9f80e00665b1c37, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:46.121711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1030/2079] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:45 2022] POST /identity/v3/users => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:46.123280 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20352dd1-1b37-4b41-912d-801ad567af52 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:46.123405 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a4b19-df10-47e2-abaa-e4119a7cdecc admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:46.148252 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a4b19-df10-47e2-abaa-e4119a7cdecc admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:46.153254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afabf6-eccc-419a-b3a7-72e206d3884c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:46.153883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afabf6-eccc-419a-b3a7-72e206d3884c admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:46.154169 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afabf6-eccc-419a-b3a7-72e206d3884c admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:46.154448 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afabf6-eccc-419a-b3a7-72e206d3884c admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:46.155247 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afabf6-eccc-419a-b3a7-72e206d3884c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:46.159514 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afabf6-eccc-419a-b3a7-72e206d3884c admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:46.171877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1031/2080] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:00:46.176137 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afabf6-eccc-419a-b3a7-72e206d3884c admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:46.188463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afabf6-eccc-419a-b3a7-72e206d3884c admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:46.195054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67935fcd-902c-4a1e-bd80-7d670d8c3928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:46.195749 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67935fcd-902c-4a1e-bd80-7d670d8c3928 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:46.196033 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67935fcd-902c-4a1e-bd80-7d670d8c3928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:46.199194 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67935fcd-902c-4a1e-bd80-7d670d8c3928 admin admin] PATH_INFO: `/v3/projects/9f93d5e79ca5423981816c5c149af717/users/d2c02a724d934c878c079287662105d8/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:46.213814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67935fcd-902c-4a1e-bd80-7d670d8c3928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f93d5e79ca5423981816c5c149af717, user_id=d2c02a724d934c878c079287662105d8, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:46.216861 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67935fcd-902c-4a1e-bd80-7d670d8c3928 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:46.232337 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1050/2081] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:46 2022] PUT /identity/v3/projects/6da09a07ce2848cb84666f16588849dc/users/706c93865d0d4980a9f80e00665b1c37/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:46.233845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646960b-a43b-4902-9910-afa4f9c5e5fa None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:46.234142 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646960b-a43b-4902-9910-afa4f9c5e5fa None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:46.234428 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646960b-a43b-4902-9910-afa4f9c5e5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:46.245638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:46.269699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-d646960b-a43b-4902-9910-afa4f9c5e5fa None None] MFA Rules not processed for user `706c93865d0d4980a9f80e00665b1c37`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:46.271040 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d646960b-a43b-4902-9910-afa4f9c5e5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:46.312389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1032/2082] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:46 2022] PUT /identity/v3/projects/9f93d5e79ca5423981816c5c149af717/users/d2c02a724d934c878c079287662105d8/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:46.319345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67935fcd-902c-4a1e-bd80-7d670d8c3928 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:46.362488 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1051/2083] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:46.364150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646960b-a43b-4902-9910-afa4f9c5e5fa None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:46.369125 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d646960b-a43b-4902-9910-afa4f9c5e5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:46.411518 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67935fcd-902c-4a1e-bd80-7d670d8c3928 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:46.418832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432aa2bb-01fc-4ede-b233-003a4a73b1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:46.421243 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aa2bb-01fc-4ede-b233-003a4a73b1fd admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:46.422631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aa2bb-01fc-4ede-b233-003a4a73b1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:46.423981 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aa2bb-01fc-4ede-b233-003a4a73b1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:46.424319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432aa2bb-01fc-4ede-b233-003a4a73b1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:46.426099 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432aa2bb-01fc-4ede-b233-003a4a73b1fd admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:46.429103 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:46.436937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1033/2084] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:00:46.440748 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432aa2bb-01fc-4ede-b233-003a4a73b1fd admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:46.450635 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646960b-a43b-4902-9910-afa4f9c5e5fa None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:46.451148 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432aa2bb-01fc-4ede-b233-003a4a73b1fd admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:46.455660 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af42ad6-11df-44e7-b6ef-cf0b3fbea52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:46.456030 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e9a46-3c16-4c5b-9686-c55d7fac2ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:46.458937 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af42ad6-11df-44e7-b6ef-cf0b3fbea52c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:46.458937 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af42ad6-11df-44e7-b6ef-cf0b3fbea52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:46.459801 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e9a46-3c16-4c5b-9686-c55d7fac2ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:46.459958 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af42ad6-11df-44e7-b6ef-cf0b3fbea52c admin admin] PATH_INFO: `/v3/projects/4e486a56a28342fd87f6f6463c594d4b` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:46.460052 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e9a46-3c16-4c5b-9686-c55d7fac2ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:46.460052 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e9a46-3c16-4c5b-9686-c55d7fac2ee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:46.460052 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e9a46-3c16-4c5b-9686-c55d7fac2ee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:46.460296 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af42ad6-11df-44e7-b6ef-cf0b3fbea52c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e486a56a28342fd87f6f6463c594d4b)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:46.460608 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af42ad6-11df-44e7-b6ef-cf0b3fbea52c admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:46.460708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e9a46-3c16-4c5b-9686-c55d7fac2ee0 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:46.534405 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1034/2085] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:46 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:46.535482 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e9a46-3c16-4c5b-9686-c55d7fac2ee0 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:46.599009 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e9a46-3c16-4c5b-9686-c55d7fac2ee0 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:46.604154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3acdf9-eaed-49b5-bf9a-5652bf2e5c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:46.605302 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3acdf9-eaed-49b5-bf9a-5652bf2e5c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:46.605602 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3acdf9-eaed-49b5-bf9a-5652bf2e5c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:46.605888 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3acdf9-eaed-49b5-bf9a-5652bf2e5c27 admin admin] PATH_INFO: `/v3/projects/9f93d5e79ca5423981816c5c149af717/users/d2c02a724d934c878c079287662105d8/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:46.608044 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3acdf9-eaed-49b5-bf9a-5652bf2e5c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f93d5e79ca5423981816c5c149af717, user_id=d2c02a724d934c878c079287662105d8, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:46.610872 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3acdf9-eaed-49b5-bf9a-5652bf2e5c27 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:46.623065 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1035/2086] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:46 2022] PUT /identity/v3/projects/9f93d5e79ca5423981816c5c149af717/users/d2c02a724d934c878c079287662105d8/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:46.623935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3acdf9-eaed-49b5-bf9a-5652bf2e5c27 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:46.648637 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5af42ad6-11df-44e7-b6ef-cf0b3fbea52c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e486a56a28342fd87f6f6463c594d4b', 'request_id': 'req-5af42ad6-11df-44e7-b6ef-cf0b3fbea52c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:46.663817 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5af42ad6-11df-44e7-b6ef-cf0b3fbea52c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e486a56a28342fd87f6f6463c594d4b', 'request_id': 'req-5af42ad6-11df-44e7-b6ef-cf0b3fbea52c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:46.702689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3acdf9-eaed-49b5-bf9a-5652bf2e5c27 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:46.708797 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce10ee3-2cea-4495-b28d-366d97d41ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:46.709996 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce10ee3-2cea-4495-b28d-366d97d41ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:46.710298 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce10ee3-2cea-4495-b28d-366d97d41ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:46.710931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce10ee3-2cea-4495-b28d-366d97d41ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:46.711786 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce10ee3-2cea-4495-b28d-366d97d41ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:46.713736 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce10ee3-2cea-4495-b28d-366d97d41ce9 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:46.762461 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5af42ad6-11df-44e7-b6ef-cf0b3fbea52c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e486a56a28342fd87f6f6463c594d4b', 'request_id': 'req-5af42ad6-11df-44e7-b6ef-cf0b3fbea52c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:46.777610 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5af42ad6-11df-44e7-b6ef-cf0b3fbea52c admin admin] The token cache is being invalidate because project 4e486a56a28342fd87f6f6463c594d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:46.778047 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5af42ad6-11df-44e7-b6ef-cf0b3fbea52c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:46.779209 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-5af42ad6-11df-44e7-b6ef-cf0b3fbea52c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:46.786772 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1052/2087] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:46 2022] DELETE /identity/v3/projects/4e486a56a28342fd87f6f6463c594d4b => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:46.788323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56638735-ba7c-4b55-9468-d2ca8f405f43 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:46.788623 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56638735-ba7c-4b55-9468-d2ca8f405f43 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:46.788909 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56638735-ba7c-4b55-9468-d2ca8f405f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:46.802473 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1036/2088] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:46 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:46.813295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce10ee3-2cea-4495-b28d-366d97d41ce9 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:46.815965 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-dce10ee3-2cea-4495-b28d-366d97d41ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:46.830642 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-56638735-ba7c-4b55-9468-d2ca8f405f43 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:46.832540 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-56638735-ba7c-4b55-9468-d2ca8f405f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:46.834411 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce10ee3-2cea-4495-b28d-366d97d41ce9 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:46.843024 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1053/2089] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:46.846425 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba62d84-cf32-472d-af03-eae199242d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:46.846425 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba62d84-cf32-472d-af03-eae199242d78 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:46.846425 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba62d84-cf32-472d-af03-eae199242d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:46.846425 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba62d84-cf32-472d-af03-eae199242d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:46.852336 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba62d84-cf32-472d-af03-eae199242d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:46.854700 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8da3ae-0b19-4e41-88b3-8c3265e320e0 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:46.856790 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8da3ae-0b19-4e41-88b3-8c3265e320e0 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:46.856790 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8da3ae-0b19-4e41-88b3-8c3265e320e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:46.857970 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba62d84-cf32-472d-af03-eae199242d78 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:46.879847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1037/2090] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:00:46.885443 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba62d84-cf32-472d-af03-eae199242d78 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:46.905442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-9d8da3ae-0b19-4e41-88b3-8c3265e320e0 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:46.905442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-9d8da3ae-0b19-4e41-88b3-8c3265e320e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:46.905442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1054/2091] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:46.914223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba62d84-cf32-472d-af03-eae199242d78 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:46.921182 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37011330-8df8-44af-b67b-28a42acf5fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:46.922123 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37011330-8df8-44af-b67b-28a42acf5fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:46.922613 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37011330-8df8-44af-b67b-28a42acf5fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:46.923116 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37011330-8df8-44af-b67b-28a42acf5fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:46.924398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37011330-8df8-44af-b67b-28a42acf5fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:46.927055 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37011330-8df8-44af-b67b-28a42acf5fc1 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:46.941513 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8da3ae-0b19-4e41-88b3-8c3265e320e0 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:46.963325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8da3ae-0b19-4e41-88b3-8c3265e320e0 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:46.967556 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1038/2092] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:00:46.973049 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37011330-8df8-44af-b67b-28a42acf5fc1 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:46.986774 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7b197-b838-4c63-a012-305a28bfbbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:46.986774 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7b197-b838-4c63-a012-305a28bfbbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:46.986774 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7b197-b838-4c63-a012-305a28bfbbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:46.986774 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7b197-b838-4c63-a012-305a28bfbbb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:46.987186 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7b197-b838-4c63-a012-305a28bfbbb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:00:46.987186 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7b197-b838-4c63-a012-305a28bfbbb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:46.987186 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7b197-b838-4c63-a012-305a28bfbbb7 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:46.994157 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37011330-8df8-44af-b67b-28a42acf5fc1 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:47.003989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1055/2093] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:00:47.007691 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7c78d-b6d8-42f8-bd13-88bf2d658c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:47.008495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7c78d-b6d8-42f8-bd13-88bf2d658c35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:47.008917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7c78d-b6d8-42f8-bd13-88bf2d658c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:47.009405 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7c78d-b6d8-42f8-bd13-88bf2d658c35 admin admin] PATH_INFO: `/v3/projects/5f5020d2bd974c00845af3c46c41f0b9/users/7a402e2216644d8796e390f6b20c07b2/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:47.010991 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7b197-b838-4c63-a012-305a28bfbbb7 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:47.022185 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7b197-b838-4c63-a012-305a28bfbbb7 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:47.027610 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e2631-dae0-4fb7-bb80-3bda7e04b452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:47.027979 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e2631-dae0-4fb7-bb80-3bda7e04b452 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:47.028319 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e2631-dae0-4fb7-bb80-3bda7e04b452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:47.028702 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e2631-dae0-4fb7-bb80-3bda7e04b452 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:47.029634 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e2631-dae0-4fb7-bb80-3bda7e04b452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:47.032052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e2631-dae0-4fb7-bb80-3bda7e04b452 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:47.037226 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7c78d-b6d8-42f8-bd13-88bf2d658c35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f5020d2bd974c00845af3c46c41f0b9, user_id=7a402e2216644d8796e390f6b20c07b2, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:47.038657 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7c78d-b6d8-42f8-bd13-88bf2d658c35 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:47.126926 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1039/2094] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:46 2022] PUT /identity/v3/projects/5f5020d2bd974c00845af3c46c41f0b9/users/7a402e2216644d8796e390f6b20c07b2/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:47.138347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24462c7-1483-4bef-894a-aeca2194a7d4 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:47.138710 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24462c7-1483-4bef-894a-aeca2194a7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:47.139108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24462c7-1483-4bef-894a-aeca2194a7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:47.147803 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:47.166690 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1056/2095] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:47 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:00:47.171075 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e2631-dae0-4fb7-bb80-3bda7e04b452 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:47.179722 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-c24462c7-1483-4bef-894a-aeca2194a7d4 None None] MFA Rules not processed for user `7a402e2216644d8796e390f6b20c07b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:47.181398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-c24462c7-1483-4bef-894a-aeca2194a7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:47.266841 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1040/2096] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:00:47.271529 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24462c7-1483-4bef-894a-aeca2194a7d4 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:47.278924 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e2631-dae0-4fb7-bb80-3bda7e04b452 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:47.286918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf75acc-0ff6-4f6c-b0d9-d9aaa5f83576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:47.288094 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf75acc-0ff6-4f6c-b0d9-d9aaa5f83576 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:47.288487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf75acc-0ff6-4f6c-b0d9-d9aaa5f83576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:47.289461 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf75acc-0ff6-4f6c-b0d9-d9aaa5f83576 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:47.289661 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24462c7-1483-4bef-894a-aeca2194a7d4 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:47.290358 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf75acc-0ff6-4f6c-b0d9-d9aaa5f83576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:47.292647 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf75acc-0ff6-4f6c-b0d9-d9aaa5f83576 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:47.295633 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290ef7b-f7b8-4f9e-8a7f-24a0c2c242cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:47.298037 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290ef7b-f7b8-4f9e-8a7f-24a0c2c242cb admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:47.298813 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290ef7b-f7b8-4f9e-8a7f-24a0c2c242cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:47.299512 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290ef7b-f7b8-4f9e-8a7f-24a0c2c242cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:47.300600 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290ef7b-f7b8-4f9e-8a7f-24a0c2c242cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:47.304719 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290ef7b-f7b8-4f9e-8a7f-24a0c2c242cb admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:47.408987 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1057/2097] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:47 2022] POST /identity/v3/users => generated 287 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:00:47.414993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf75acc-0ff6-4f6c-b0d9-d9aaa5f83576 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:47.417150 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1041/2098] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:47 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:47.418370 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290ef7b-f7b8-4f9e-8a7f-24a0c2c242cb admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:47.434194 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf75acc-0ff6-4f6c-b0d9-d9aaa5f83576 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:47.492970 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:47.510682 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290ef7b-f7b8-4f9e-8a7f-24a0c2c242cb admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:47.512985 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58f1a5-b390-4cfc-85ea-34bfba70d270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:47.513651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58f1a5-b390-4cfc-85ea-34bfba70d270 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:47.513944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58f1a5-b390-4cfc-85ea-34bfba70d270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:47.514227 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58f1a5-b390-4cfc-85ea-34bfba70d270 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:47.515035 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58f1a5-b390-4cfc-85ea-34bfba70d270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:47.517568 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58f1a5-b390-4cfc-85ea-34bfba70d270 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:47.522313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d674e6-54d6-4be5-a2d7-dfd4ee8a3516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:47.523224 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d674e6-54d6-4be5-a2d7-dfd4ee8a3516 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:47.523728 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d674e6-54d6-4be5-a2d7-dfd4ee8a3516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:47.524400 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d674e6-54d6-4be5-a2d7-dfd4ee8a3516 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:47.525311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d674e6-54d6-4be5-a2d7-dfd4ee8a3516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:47.528302 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d674e6-54d6-4be5-a2d7-dfd4ee8a3516 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:47.532061 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1058/2099] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:47.536025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58f1a5-b390-4cfc-85ea-34bfba70d270 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:47.552294 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58f1a5-b390-4cfc-85ea-34bfba70d270 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:47.557895 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a515e00-804c-4c01-a3ea-8e6a6f2747f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:47.558630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a515e00-804c-4c01-a3ea-8e6a6f2747f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:47.559025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a515e00-804c-4c01-a3ea-8e6a6f2747f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:47.559383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a515e00-804c-4c01-a3ea-8e6a6f2747f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:47.560186 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a515e00-804c-4c01-a3ea-8e6a6f2747f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:47.561875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a515e00-804c-4c01-a3ea-8e6a6f2747f4 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:47.577367 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1059/2100] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:00:47.589520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a515e00-804c-4c01-a3ea-8e6a6f2747f4 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:47.609172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a515e00-804c-4c01-a3ea-8e6a6f2747f4 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:47.616671 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104285d-4dca-42d1-8cb9-1cba3b268a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:47.617719 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104285d-4dca-42d1-8cb9-1cba3b268a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:47.618010 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104285d-4dca-42d1-8cb9-1cba3b268a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:47.618300 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104285d-4dca-42d1-8cb9-1cba3b268a7f admin admin] PATH_INFO: `/v3/projects/833ecc99df744fbaa377bc72dea72e00/users/f5a2f84d95fb485bb674534362b1193c/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:47.640386 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104285d-4dca-42d1-8cb9-1cba3b268a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=833ecc99df744fbaa377bc72dea72e00, user_id=f5a2f84d95fb485bb674534362b1193c, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:47.645180 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104285d-4dca-42d1-8cb9-1cba3b268a7f admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:47.655761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1042/2101] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:47 2022] POST /identity/v3/users => generated 295 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:47.657478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d674e6-54d6-4be5-a2d7-dfd4ee8a3516 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:47.668158 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d674e6-54d6-4be5-a2d7-dfd4ee8a3516 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:47.672952 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc3f90-fd2f-4d99-b6a0-46a890548b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:47.673759 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc3f90-fd2f-4d99-b6a0-46a890548b7f admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:47.674188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc3f90-fd2f-4d99-b6a0-46a890548b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:47.674608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc3f90-fd2f-4d99-b6a0-46a890548b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:47.675495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc3f90-fd2f-4d99-b6a0-46a890548b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:47.677337 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc3f90-fd2f-4d99-b6a0-46a890548b7f admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:47.689933 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1043/2102] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:47.698391 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc3f90-fd2f-4d99-b6a0-46a890548b7f admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:47.713248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc3f90-fd2f-4d99-b6a0-46a890548b7f admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:47.723126 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab533d-4a8b-4b4b-a0dc-933d56bf5e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:47.725298 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab533d-4a8b-4b4b-a0dc-933d56bf5e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:47.726070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab533d-4a8b-4b4b-a0dc-933d56bf5e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:47.726701 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab533d-4a8b-4b4b-a0dc-933d56bf5e1e admin admin] PATH_INFO: `/v3/projects/5026c8c43ef04fd7aeb605c4c181d79f/users/147944a44a4248e69bf382fc48a007dd/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:47.745668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab533d-4a8b-4b4b-a0dc-933d56bf5e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5026c8c43ef04fd7aeb605c4c181d79f, user_id=147944a44a4248e69bf382fc48a007dd, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:47.748861 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab533d-4a8b-4b4b-a0dc-933d56bf5e1e admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:47.749210 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1060/2103] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:47 2022] PUT /identity/v3/projects/833ecc99df744fbaa377bc72dea72e00/users/f5a2f84d95fb485bb674534362b1193c/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:47.762031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75bc15-17c1-4785-b686-01be63b40d3f None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:47.762487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75bc15-17c1-4785-b686-01be63b40d3f None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:47.762806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75bc15-17c1-4785-b686-01be63b40d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:47.794643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-aa75bc15-17c1-4785-b686-01be63b40d3f None None] MFA Rules not processed for user `f5a2f84d95fb485bb674534362b1193c`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:47.796563 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-aa75bc15-17c1-4785-b686-01be63b40d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:47.873855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1061/2104] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:00:47.877730 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1044/2105] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:47 2022] PUT /identity/v3/projects/5026c8c43ef04fd7aeb605c4c181d79f/users/147944a44a4248e69bf382fc48a007dd/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:47.881783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75bc15-17c1-4785-b686-01be63b40d3f None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:47.886172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab533d-4a8b-4b4b-a0dc-933d56bf5e1e admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:47.890140 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-ddab533d-4a8b-4b4b-a0dc-933d56bf5e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:47.966670 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75bc15-17c1-4785-b686-01be63b40d3f None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:47.979732 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab533d-4a8b-4b4b-a0dc-933d56bf5e1e admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:47.986936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b684109-fc70-4b72-8bdb-2c48c122978c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:47.988216 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b684109-fc70-4b72-8bdb-2c48c122978c service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:47.988974 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b684109-fc70-4b72-8bdb-2c48c122978c service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:47.989287 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b684109-fc70-4b72-8bdb-2c48c122978c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:48.039107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:48.069479 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72b784-98af-40c9-bba0-1a78e744d32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:48.070246 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72b784-98af-40c9-bba0-1a78e744d32d admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:48.070634 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72b784-98af-40c9-bba0-1a78e744d32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:48.071065 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72b784-98af-40c9-bba0-1a78e744d32d admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:48.072581 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb72b784-98af-40c9-bba0-1a78e744d32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:48.081060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb72b784-98af-40c9-bba0-1a78e744d32d admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:48.111361 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1062/2106] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:48.117151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72b784-98af-40c9-bba0-1a78e744d32d admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:48.139107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72b784-98af-40c9-bba0-1a78e744d32d admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:48.147753 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1aa071-216c-4615-b2a0-74ed25e32cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:48.150163 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1aa071-216c-4615-b2a0-74ed25e32cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:48.150163 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1aa071-216c-4615-b2a0-74ed25e32cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:48.150163 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1aa071-216c-4615-b2a0-74ed25e32cb3 admin admin] PATH_INFO: `/v3/projects/5026c8c43ef04fd7aeb605c4c181d79f/users/147944a44a4248e69bf382fc48a007dd/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:48.150903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b684109-fc70-4b72-8bdb-2c48c122978c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:48.152542 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1aa071-216c-4615-b2a0-74ed25e32cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5026c8c43ef04fd7aeb605c4c181d79f, user_id=147944a44a4248e69bf382fc48a007dd, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:48.152680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b684109-fc70-4b72-8bdb-2c48c122978c service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:48.156757 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1aa071-216c-4615-b2a0-74ed25e32cb3 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:48.190481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1045/2107] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:00:48.191213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1063/2108] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:48 2022] PUT /identity/v3/projects/5026c8c43ef04fd7aeb605c4c181d79f/users/147944a44a4248e69bf382fc48a007dd/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:48.201969 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacfb46-382b-44a6-a197-c0b97538f99a None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:48.202272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacfb46-382b-44a6-a197-c0b97538f99a None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:48.202561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacfb46-382b-44a6-a197-c0b97538f99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:48.264245 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-1cacfb46-382b-44a6-a197-c0b97538f99a None None] MFA Rules not processed for user `147944a44a4248e69bf382fc48a007dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:48.266154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-1cacfb46-382b-44a6-a197-c0b97538f99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:48.442229 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1046/2109] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:48.455193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1aa071-216c-4615-b2a0-74ed25e32cb3 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:48.458565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-6f1aa071-216c-4615-b2a0-74ed25e32cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:48.591646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1aa071-216c-4615-b2a0-74ed25e32cb3 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:48.615002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32932635-886c-4d09-b96d-8fccc78b9595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:48.615836 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32932635-886c-4d09-b96d-8fccc78b9595 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:48.616193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32932635-886c-4d09-b96d-8fccc78b9595 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:48.616778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32932635-886c-4d09-b96d-8fccc78b9595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:48.626548 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-32932635-886c-4d09-b96d-8fccc78b9595 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:48.629366 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:48.793581 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32932635-886c-4d09-b96d-8fccc78b9595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:48.802826 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32932635-886c-4d09-b96d-8fccc78b9595 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:48.815560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1064/2110] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:50.343013 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:50.408830 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:52.448623 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cacfb46-382b-44a6-a197-c0b97538f99a None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:52.459173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cacfb46-382b-44a6-a197-c0b97538f99a None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:52.463980 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b6c24-8217-4401-aced-f97c98b43375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:52.464859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b6c24-8217-4401-aced-f97c98b43375 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:52.465755 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b6c24-8217-4401-aced-f97c98b43375 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:52.466125 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b6c24-8217-4401-aced-f97c98b43375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:52.547980 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b6c24-8217-4401-aced-f97c98b43375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:52.550547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b6c24-8217-4401-aced-f97c98b43375 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:52.574615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1047/2111] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:53.351173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32932635-886c-4d09-b96d-8fccc78b9595 service cinder] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:53.352809 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-32932635-886c-4d09-b96d-8fccc78b9595 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:53.386439 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:53.451987 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32932635-886c-4d09-b96d-8fccc78b9595 service cinder] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:53.457258 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b2ddc-cc82-4a64-b456-950246b26d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:53.457998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b2ddc-cc82-4a64-b456-950246b26d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:53.458207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b2ddc-cc82-4a64-b456-950246b26d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:53.464379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b2ddc-cc82-4a64-b456-950246b26d0e admin admin] PATH_INFO: `/v3/users/7edfb118d3b3418ebc40b0c5affd8fdf` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:53.464379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b2ddc-cc82-4a64-b456-950246b26d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7edfb118d3b3418ebc40b0c5affd8fdf)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:53.464379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b2ddc-cc82-4a64-b456-950246b26d0e admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:53.732626 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-824b2ddc-cc82-4a64-b456-950246b26d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7edfb118d3b3418ebc40b0c5affd8fdf'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:53.741690 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-824b2ddc-cc82-4a64-b456-950246b26d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7edfb118d3b3418ebc40b0c5affd8fdf'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:53.742486 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-824b2ddc-cc82-4a64-b456-950246b26d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7edfb118d3b3418ebc40b0c5affd8fdf'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:53.755001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-824b2ddc-cc82-4a64-b456-950246b26d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7edfb118d3b3418ebc40b0c5affd8fdf'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:53.756081 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-824b2ddc-cc82-4a64-b456-950246b26d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7edfb118d3b3418ebc40b0c5affd8fdf'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:53.850952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1065/2112] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:53 2022] DELETE /identity/v3/users/7edfb118d3b3418ebc40b0c5affd8fdf => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:53.854963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238a322-b9a6-45c6-bb62-64dc3b62add7 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:53.855489 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238a322-b9a6-45c6-bb62-64dc3b62add7 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:53.855489 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238a322-b9a6-45c6-bb62-64dc3b62add7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:53.877966 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-3238a322-b9a6-45c6-bb62-64dc3b62add7 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:53.878369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3238a322-b9a6-45c6-bb62-64dc3b62add7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:53.906668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:53.941655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1048/2113] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:00:53.951836 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b2ddc-cc82-4a64-b456-950246b26d0e admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:53.953269 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-824b2ddc-cc82-4a64-b456-950246b26d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:54.033644 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b2ddc-cc82-4a64-b456-950246b26d0e admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:54.040601 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bb647-74a0-458f-a6e6-76be77e33978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:54.041311 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bb647-74a0-458f-a6e6-76be77e33978 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:54.041687 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bb647-74a0-458f-a6e6-76be77e33978 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:54.042038 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bb647-74a0-458f-a6e6-76be77e33978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:54.063236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4bb647-74a0-458f-a6e6-76be77e33978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:54.064668 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4bb647-74a0-458f-a6e6-76be77e33978 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:54.132544 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1066/2114] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:54.482300 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238a322-b9a6-45c6-bb62-64dc3b62add7 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:54.483754 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3238a322-b9a6-45c6-bb62-64dc3b62add7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:54.508966 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238a322-b9a6-45c6-bb62-64dc3b62add7 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:54.522345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23736e-b647-409f-8c00-606fcda68642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:54.526385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23736e-b647-409f-8c00-606fcda68642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:54.526385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23736e-b647-409f-8c00-606fcda68642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:54.526385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23736e-b647-409f-8c00-606fcda68642 admin admin] PATH_INFO: `/v3/users/f5a2f84d95fb485bb674534362b1193c` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:54.527254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23736e-b647-409f-8c00-606fcda68642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a2f84d95fb485bb674534362b1193c)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:54.529497 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23736e-b647-409f-8c00-606fcda68642 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:54.620255 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bb647-74a0-458f-a6e6-76be77e33978 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:54.625739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ea4bb647-74a0-458f-a6e6-76be77e33978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:54.712263 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:54.739202 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bb647-74a0-458f-a6e6-76be77e33978 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:54.753045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a9cc7-2e85-4a37-8d01-cc6db2edce9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:54.753688 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a9cc7-2e85-4a37-8d01-cc6db2edce9c service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:54.753994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a9cc7-2e85-4a37-8d01-cc6db2edce9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:54.754253 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a9cc7-2e85-4a37-8d01-cc6db2edce9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:54.757558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-670a9cc7-2e85-4a37-8d01-cc6db2edce9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:54.761682 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-fd23736e-b647-409f-8c00-606fcda68642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a2f84d95fb485bb674534362b1193c'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:54.774521 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-fd23736e-b647-409f-8c00-606fcda68642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a2f84d95fb485bb674534362b1193c'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:54.828266 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a9cc7-2e85-4a37-8d01-cc6db2edce9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:54.829695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a9cc7-2e85-4a37-8d01-cc6db2edce9c service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:54.834117 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-fd23736e-b647-409f-8c00-606fcda68642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a2f84d95fb485bb674534362b1193c'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:54.835621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-fd23736e-b647-409f-8c00-606fcda68642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a2f84d95fb485bb674534362b1193c'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:54.842888 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1067/2115] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:00:54.854313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-fd23736e-b647-409f-8c00-606fcda68642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a2f84d95fb485bb674534362b1193c'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:54.861077 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1049/2116] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:54 2022] DELETE /identity/v3/users/f5a2f84d95fb485bb674534362b1193c => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:54.866575 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271c3e1-1fe9-4292-8d3f-3ddafde3bf70 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:54.866900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271c3e1-1fe9-4292-8d3f-3ddafde3bf70 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:54.867185 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271c3e1-1fe9-4292-8d3f-3ddafde3bf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:54.886186 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23736e-b647-409f-8c00-606fcda68642 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:54.889903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-fd23736e-b647-409f-8c00-606fcda68642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:54.895485 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-b271c3e1-1fe9-4292-8d3f-3ddafde3bf70 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:54.896876 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b271c3e1-1fe9-4292-8d3f-3ddafde3bf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:54.977978 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23736e-b647-409f-8c00-606fcda68642 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:54.978811 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1068/2117] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:54.988933 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271c3e1-1fe9-4292-8d3f-3ddafde3bf70 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:54.990543 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b271c3e1-1fe9-4292-8d3f-3ddafde3bf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:54.993792 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac0153-a131-401c-992a-056cfd951e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:54.994927 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac0153-a131-401c-992a-056cfd951e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:54.995223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac0153-a131-401c-992a-056cfd951e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:54.995501 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac0153-a131-401c-992a-056cfd951e7d admin admin] PATH_INFO: `/v3/projects/ad71702cf704412cb04964b351702d79` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:54.997003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac0153-a131-401c-992a-056cfd951e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad71702cf704412cb04964b351702d79)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:55.000825 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac0153-a131-401c-992a-056cfd951e7d admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:55.081151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271c3e1-1fe9-4292-8d3f-3ddafde3bf70 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:55.088032 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19825805-79ee-4f86-ad77-e3a98b8ca3b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:55.088571 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19825805-79ee-4f86-ad77-e3a98b8ca3b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:55.089003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19825805-79ee-4f86-ad77-e3a98b8ca3b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:55.089299 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19825805-79ee-4f86-ad77-e3a98b8ca3b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:55.108744 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19825805-79ee-4f86-ad77-e3a98b8ca3b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:55.111454 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19825805-79ee-4f86-ad77-e3a98b8ca3b6 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:55.143733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1069/2118] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:55.147134 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-eaac0153-a131-401c-992a-056cfd951e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad71702cf704412cb04964b351702d79', 'request_id': 'req-eaac0153-a131-401c-992a-056cfd951e7d'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:55.155386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-eaac0153-a131-401c-992a-056cfd951e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad71702cf704412cb04964b351702d79', 'request_id': 'req-eaac0153-a131-401c-992a-056cfd951e7d'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:55.167210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:55.293780 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-eaac0153-a131-401c-992a-056cfd951e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad71702cf704412cb04964b351702d79', 'request_id': 'req-eaac0153-a131-401c-992a-056cfd951e7d'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:55.309586 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-eaac0153-a131-401c-992a-056cfd951e7d admin admin] The token cache is being invalidate because project ad71702cf704412cb04964b351702d79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:55.309987 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-eaac0153-a131-401c-992a-056cfd951e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:55.310587 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-eaac0153-a131-401c-992a-056cfd951e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:55.312239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1050/2119] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:54 2022] DELETE /identity/v3/projects/ad71702cf704412cb04964b351702d79 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:55.316581 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19825805-79ee-4f86-ad77-e3a98b8ca3b6 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:55.334624 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a1229-4178-418f-a03f-9f4d207c7849 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:55.334951 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a1229-4178-418f-a03f-9f4d207c7849 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:55.335239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a1229-4178-418f-a03f-9f4d207c7849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:55.336990 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19825805-79ee-4f86-ad77-e3a98b8ca3b6 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:55.364150 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-b50a1229-4178-418f-a03f-9f4d207c7849 None None] MFA Rules not processed for user `d2c02a724d934c878c079287662105d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:55.366150 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b50a1229-4178-418f-a03f-9f4d207c7849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:55.423193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35c25c-c7df-4da6-b01f-c73006b8024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:55.423941 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35c25c-c7df-4da6-b01f-c73006b8024a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:55.424725 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35c25c-c7df-4da6-b01f-c73006b8024a admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:55.425879 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35c25c-c7df-4da6-b01f-c73006b8024a admin admin] PATH_INFO: `/v3/users/c26b6d377dc546cf95f4e4a5b8509982` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:55.428168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35c25c-c7df-4da6-b01f-c73006b8024a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c26b6d377dc546cf95f4e4a5b8509982)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:55.431854 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35c25c-c7df-4da6-b01f-c73006b8024a admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:55.475647 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1051/2120] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:00:55.483502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a1229-4178-418f-a03f-9f4d207c7849 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:55.485172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b50a1229-4178-418f-a03f-9f4d207c7849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:55.572148 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a1229-4178-418f-a03f-9f4d207c7849 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:55.575943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b5852-dd54-497a-ad3c-65d3da778414 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b99f03a7c14a2e89384dcca532dc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:55.576581 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b5852-dd54-497a-ad3c-65d3da778414 service glance] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:55.576864 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b5852-dd54-497a-ad3c-65d3da778414 service glance] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:55.577139 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b5852-dd54-497a-ad3c-65d3da778414 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:55.578971 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-843b5852-dd54-497a-ad3c-65d3da778414 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:55.651463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8c35c25c-c7df-4da6-b01f-c73006b8024a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c26b6d377dc546cf95f4e4a5b8509982'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:55.654857 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b5852-dd54-497a-ad3c-65d3da778414 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:55.656714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b5852-dd54-497a-ad3c-65d3da778414 service glance] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:55.659016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8c35c25c-c7df-4da6-b01f-c73006b8024a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c26b6d377dc546cf95f4e4a5b8509982'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:55.659885 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8c35c25c-c7df-4da6-b01f-c73006b8024a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c26b6d377dc546cf95f4e4a5b8509982'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:55.667027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1052/2121] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:00:55.672910 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8c35c25c-c7df-4da6-b01f-c73006b8024a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c26b6d377dc546cf95f4e4a5b8509982'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:55.673591 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8c35c25c-c7df-4da6-b01f-c73006b8024a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c26b6d377dc546cf95f4e4a5b8509982'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:55.735579 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b5852-dd54-497a-ad3c-65d3da778414 service glance] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:55.737747 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-843b5852-dd54-497a-ad3c-65d3da778414 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:55.756935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b5852-dd54-497a-ad3c-65d3da778414 service glance] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:55.762587 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf40d82-cfb2-427b-a4e1-8657ae9ed3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:55.763663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf40d82-cfb2-427b-a4e1-8657ae9ed3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:55.763663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf40d82-cfb2-427b-a4e1-8657ae9ed3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:55.763833 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf40d82-cfb2-427b-a4e1-8657ae9ed3f9 admin admin] PATH_INFO: `/v3/projects/833ecc99df744fbaa377bc72dea72e00` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:55.765816 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf40d82-cfb2-427b-a4e1-8657ae9ed3f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=833ecc99df744fbaa377bc72dea72e00)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:55.768610 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf40d82-cfb2-427b-a4e1-8657ae9ed3f9 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:55.783335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1070/2122] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:55 2022] DELETE /identity/v3/users/c26b6d377dc546cf95f4e4a5b8509982 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:55.985353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-aaf40d82-cfb2-427b-a4e1-8657ae9ed3f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '833ecc99df744fbaa377bc72dea72e00', 'request_id': 'req-aaf40d82-cfb2-427b-a4e1-8657ae9ed3f9'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:55.991013 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-aaf40d82-cfb2-427b-a4e1-8657ae9ed3f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '833ecc99df744fbaa377bc72dea72e00', 'request_id': 'req-aaf40d82-cfb2-427b-a4e1-8657ae9ed3f9'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:56.049264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d796b84-a6f7-4470-9fca-3c8291c79c01 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:56.052497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d796b84-a6f7-4470-9fca-3c8291c79c01 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:56.052497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d796b84-a6f7-4470-9fca-3c8291c79c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:56.074787 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-2d796b84-a6f7-4470-9fca-3c8291c79c01 None None] MFA Rules not processed for user `b9d70abf4f754530a3cf6efa7a782736`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:56.076126 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-2d796b84-a6f7-4470-9fca-3c8291c79c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:56.094334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-aaf40d82-cfb2-427b-a4e1-8657ae9ed3f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '833ecc99df744fbaa377bc72dea72e00', 'request_id': 'req-aaf40d82-cfb2-427b-a4e1-8657ae9ed3f9'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:56.107859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-aaf40d82-cfb2-427b-a4e1-8657ae9ed3f9 admin admin] The token cache is being invalidate because project 833ecc99df744fbaa377bc72dea72e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:56.108666 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-aaf40d82-cfb2-427b-a4e1-8657ae9ed3f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:56.109842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-aaf40d82-cfb2-427b-a4e1-8657ae9ed3f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:56.113622 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1053/2123] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:55 2022] DELETE /identity/v3/projects/833ecc99df744fbaa377bc72dea72e00 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:56.118461 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec8dbf-272c-4df6-b3ac-9b3773774970 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:56.118851 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec8dbf-272c-4df6-b3ac-9b3773774970 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:56.119147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec8dbf-272c-4df6-b3ac-9b3773774970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:56.154860 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-a9ec8dbf-272c-4df6-b3ac-9b3773774970 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:56.154860 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a9ec8dbf-272c-4df6-b3ac-9b3773774970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:56.166889 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1071/2124] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 3 13:00:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:00:56.230139 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d796b84-a6f7-4470-9fca-3c8291c79c01 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:56.232142 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-2d796b84-a6f7-4470-9fca-3c8291c79c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:56.266083 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1054/2125] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:00:56.274619 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa80a4-dba4-445f-872a-b3d83d50acfd None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:56.276282 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa80a4-dba4-445f-872a-b3d83d50acfd None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:56.276282 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa80a4-dba4-445f-872a-b3d83d50acfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:56.298545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-6afa80a4-dba4-445f-872a-b3d83d50acfd None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:56.299977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-6afa80a4-dba4-445f-872a-b3d83d50acfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:56.311733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1055/2126] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:56.313164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa80a4-dba4-445f-872a-b3d83d50acfd None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:56.325130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa80a4-dba4-445f-872a-b3d83d50acfd None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:56.331384 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d796b84-a6f7-4470-9fca-3c8291c79c01 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:56.337531 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dc99f-35ea-4eea-b88d-ce920da9207a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:56.338363 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dc99f-35ea-4eea-b88d-ce920da9207a admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:56.338662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dc99f-35ea-4eea-b88d-ce920da9207a admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:56.338967 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dc99f-35ea-4eea-b88d-ce920da9207a admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:56.339693 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dc99f-35ea-4eea-b88d-ce920da9207a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:00:56.340064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dc99f-35ea-4eea-b88d-ce920da9207a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:56.341699 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dc99f-35ea-4eea-b88d-ce920da9207a admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:56.345928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ffef9-dbf2-425a-98b6-7f69ae07c260 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5209ec838a4f45d6b746edb27970c93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:56.351654 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ffef9-dbf2-425a-98b6-7f69ae07c260 service swift] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:56.351654 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ffef9-dbf2-425a-98b6-7f69ae07c260 service swift] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:56.351654 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ffef9-dbf2-425a-98b6-7f69ae07c260 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:56.363969 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1056/2127] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:00:56.364974 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dc99f-35ea-4eea-b88d-ce920da9207a admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:56.367042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ffef9-dbf2-425a-98b6-7f69ae07c260 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:56.372373 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ffef9-dbf2-425a-98b6-7f69ae07c260 service swift] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:56.376319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dc99f-35ea-4eea-b88d-ce920da9207a admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:56.386651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1072/2128] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 3 13:00:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 03 13:00:56.389431 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e31a23-b273-4e77-8ba1-34a80e1b0cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:56.390383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e31a23-b273-4e77-8ba1-34a80e1b0cac admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:56.390659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e31a23-b273-4e77-8ba1-34a80e1b0cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:56.390976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e31a23-b273-4e77-8ba1-34a80e1b0cac admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:56.391859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e31a23-b273-4e77-8ba1-34a80e1b0cac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:56.394936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e31a23-b273-4e77-8ba1-34a80e1b0cac admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:56.437382 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:56.527706 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1057/2129] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:56 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:56.543650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ffef9-dbf2-425a-98b6-7f69ae07c260 service swift] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:56.575363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ffef9-dbf2-425a-98b6-7f69ae07c260 service swift] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:56.777745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4fe5c-128e-425c-a7c6-3168d13fffb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:56.778414 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4fe5c-128e-425c-a7c6-3168d13fffb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:56.778643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4fe5c-128e-425c-a7c6-3168d13fffb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:56.779649 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4fe5c-128e-425c-a7c6-3168d13fffb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:56.780351 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4fe5c-128e-425c-a7c6-3168d13fffb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:56.780954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:56.782583 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4fe5c-128e-425c-a7c6-3168d13fffb2 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:56.895464 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1073/2130] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:56 2022] POST /identity/v3/users => generated 287 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:56.898539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e31a23-b273-4e77-8ba1-34a80e1b0cac admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:56.919495 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:56.957234 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e31a23-b273-4e77-8ba1-34a80e1b0cac admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:56.987074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a14da-103d-40bb-b962-419f0bc70ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:56.987851 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a14da-103d-40bb-b962-419f0bc70ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:56.992368 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a14da-103d-40bb-b962-419f0bc70ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:56.992708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a14da-103d-40bb-b962-419f0bc70ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:56.993623 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a14da-103d-40bb-b962-419f0bc70ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:56.997974 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a14da-103d-40bb-b962-419f0bc70ddb admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:57.035630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4fe5c-128e-425c-a7c6-3168d13fffb2 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:57.037652 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-dfc4fe5c-128e-425c-a7c6-3168d13fffb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:57.047734 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1058/2131] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:57.051758 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a14da-103d-40bb-b962-419f0bc70ddb admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:57.077389 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4fe5c-128e-425c-a7c6-3168d13fffb2 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:57.085485 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a14da-103d-40bb-b962-419f0bc70ddb admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:57.092372 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af87e7-9097-4032-afaf-37aa5b791699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:57.104989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af87e7-9097-4032-afaf-37aa5b791699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:57.105517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af87e7-9097-4032-afaf-37aa5b791699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:57.108083 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af87e7-9097-4032-afaf-37aa5b791699 admin admin] PATH_INFO: `/v3/projects/bd9717753e8e4732a55d36f4a4bc3422` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:57.112730 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af87e7-9097-4032-afaf-37aa5b791699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd9717753e8e4732a55d36f4a4bc3422)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:57.114993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af87e7-9097-4032-afaf-37aa5b791699 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:57.115798 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0aa13-346f-4afa-a9ed-19c144ecf32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:57.116522 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0aa13-346f-4afa-a9ed-19c144ecf32a admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:57.116872 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0aa13-346f-4afa-a9ed-19c144ecf32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:57.117225 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0aa13-346f-4afa-a9ed-19c144ecf32a admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:57.118704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0aa13-346f-4afa-a9ed-19c144ecf32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:57.122031 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0aa13-346f-4afa-a9ed-19c144ecf32a admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:57.147036 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1059/2132] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:57.151806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0aa13-346f-4afa-a9ed-19c144ecf32a admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:57.171326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0aa13-346f-4afa-a9ed-19c144ecf32a admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:57.179572 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6d038-03c1-497b-968f-ff9b1f09d6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:57.180382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6d038-03c1-497b-968f-ff9b1f09d6b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:57.181605 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6d038-03c1-497b-968f-ff9b1f09d6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:57.182563 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6d038-03c1-497b-968f-ff9b1f09d6b4 admin admin] PATH_INFO: `/v3/projects/ef1e829edd5a4a5f8c5133cb5e37c284/users/79fd9e0292fb4ebab755519ecc20235e/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:57.206694 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6d038-03c1-497b-968f-ff9b1f09d6b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1e829edd5a4a5f8c5133cb5e37c284, user_id=79fd9e0292fb4ebab755519ecc20235e, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:57.211820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6d038-03c1-497b-968f-ff9b1f09d6b4 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:57.349233 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1060/2133] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:57 2022] PUT /identity/v3/projects/ef1e829edd5a4a5f8c5133cb5e37c284/users/79fd9e0292fb4ebab755519ecc20235e/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:57.350863 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaa136-1a88-4336-972e-63866664eb9a None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:57.351257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaa136-1a88-4336-972e-63866664eb9a None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:57.351711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaa136-1a88-4336-972e-63866664eb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:57.375614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-59af87e7-9097-4032-afaf-37aa5b791699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd9717753e8e4732a55d36f4a4bc3422', 'request_id': 'req-59af87e7-9097-4032-afaf-37aa5b791699'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:57.381134 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-4aeaa136-1a88-4336-972e-63866664eb9a None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:57.382589 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-4aeaa136-1a88-4336-972e-63866664eb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:57.385176 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-59af87e7-9097-4032-afaf-37aa5b791699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd9717753e8e4732a55d36f4a4bc3422', 'request_id': 'req-59af87e7-9097-4032-afaf-37aa5b791699'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:57.468323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-59af87e7-9097-4032-afaf-37aa5b791699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd9717753e8e4732a55d36f4a4bc3422', 'request_id': 'req-59af87e7-9097-4032-afaf-37aa5b791699'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:57.483503 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-59af87e7-9097-4032-afaf-37aa5b791699 admin admin] The token cache is being invalidate because project bd9717753e8e4732a55d36f4a4bc3422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:57.483801 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-59af87e7-9097-4032-afaf-37aa5b791699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:57.484486 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-59af87e7-9097-4032-afaf-37aa5b791699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:57.487069 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1074/2134] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:57 2022] DELETE /identity/v3/projects/bd9717753e8e4732a55d36f4a4bc3422 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:57.493610 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d1148-3de2-415f-a95a-16f99bee08d3 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:57.493906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d1148-3de2-415f-a95a-16f99bee08d3 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:57.494198 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d1148-3de2-415f-a95a-16f99bee08d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:57.520980 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-a53d1148-3de2-415f-a95a-16f99bee08d3 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:57.522759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-a53d1148-3de2-415f-a95a-16f99bee08d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:57.526986 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1061/2135] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:57.535523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1075/2136] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:00:57.540970 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeaa136-1a88-4336-972e-63866664eb9a None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:57.545110 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-4aeaa136-1a88-4336-972e-63866664eb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:57.553987 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09e1b3-98c5-489d-8a26-cf39598de385 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:57.554284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09e1b3-98c5-489d-8a26-cf39598de385 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:57.554572 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09e1b3-98c5-489d-8a26-cf39598de385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:57.592234 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-2a09e1b3-98c5-489d-8a26-cf39598de385 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:57.593496 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-2a09e1b3-98c5-489d-8a26-cf39598de385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:57.609000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1076/2137] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:57.613036 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09e1b3-98c5-489d-8a26-cf39598de385 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:57.637584 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09e1b3-98c5-489d-8a26-cf39598de385 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:57.705464 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e685561-91f9-48e1-b447-dcc7189ee379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:57.705464 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e685561-91f9-48e1-b447-dcc7189ee379 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:57.705464 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e685561-91f9-48e1-b447-dcc7189ee379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:57.705464 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e685561-91f9-48e1-b447-dcc7189ee379 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:57.707258 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e685561-91f9-48e1-b447-dcc7189ee379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:00:57.707258 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e685561-91f9-48e1-b447-dcc7189ee379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:57.707258 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e685561-91f9-48e1-b447-dcc7189ee379 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:57.707477 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeaa136-1a88-4336-972e-63866664eb9a None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:57.707477 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bad30-872c-40b8-8acf-e8e1d0689d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:57.707477 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bad30-872c-40b8-8acf-e8e1d0689d75 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:57.707477 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bad30-872c-40b8-8acf-e8e1d0689d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:57.707774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bad30-872c-40b8-8acf-e8e1d0689d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:57.707774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bad30-872c-40b8-8acf-e8e1d0689d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:57.707774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bad30-872c-40b8-8acf-e8e1d0689d75 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:57.707977 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1077/2138] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:00:57.715436 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e685561-91f9-48e1-b447-dcc7189ee379 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:57.729976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1062/2139] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:00:57.734618 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e685561-91f9-48e1-b447-dcc7189ee379 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:57.742676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692427c-be0d-49da-af93-bbed6a41783f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:57.760487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692427c-be0d-49da-af93-bbed6a41783f admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:57.760487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692427c-be0d-49da-af93-bbed6a41783f admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:57.760487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692427c-be0d-49da-af93-bbed6a41783f admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:57.760487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692427c-be0d-49da-af93-bbed6a41783f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:57.760487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692427c-be0d-49da-af93-bbed6a41783f admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:58.205173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1078/2140] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:57 2022] POST /identity/v3/projects => generated 385 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:58.209642 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bad30-872c-40b8-8acf-e8e1d0689d75 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:58.223848 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bad30-872c-40b8-8acf-e8e1d0689d75 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:58.327025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d4669-a1bd-4f38-b05d-e696412d3d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:58.327740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d4669-a1bd-4f38-b05d-e696412d3d8b admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:58.328030 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d4669-a1bd-4f38-b05d-e696412d3d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:58.328310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d4669-a1bd-4f38-b05d-e696412d3d8b admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:58.329134 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d4669-a1bd-4f38-b05d-e696412d3d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:58.331716 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d4669-a1bd-4f38-b05d-e696412d3d8b admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:58.474926 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1063/2141] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:58 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:58.475392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692427c-be0d-49da-af93-bbed6a41783f admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:58.495940 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692427c-be0d-49da-af93-bbed6a41783f admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:58.506451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a6bf5-7ea8-4d2a-9a18-d466b4b8f39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:58.509013 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a6bf5-7ea8-4d2a-9a18-d466b4b8f39b admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:58.510637 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a6bf5-7ea8-4d2a-9a18-d466b4b8f39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:58.511103 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a6bf5-7ea8-4d2a-9a18-d466b4b8f39b admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:58.512611 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a6bf5-7ea8-4d2a-9a18-d466b4b8f39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:58.514969 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a6bf5-7ea8-4d2a-9a18-d466b4b8f39b admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:58.540665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1079/2142] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:58.543423 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d4669-a1bd-4f38-b05d-e696412d3d8b admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:58.561397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d4669-a1bd-4f38-b05d-e696412d3d8b admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:58.571336 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17438655-48a2-4a10-9e64-c3ba7aab073c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:58.572152 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17438655-48a2-4a10-9e64-c3ba7aab073c admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:58.572309 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17438655-48a2-4a10-9e64-c3ba7aab073c admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:58.572598 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17438655-48a2-4a10-9e64-c3ba7aab073c admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:58.573316 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17438655-48a2-4a10-9e64-c3ba7aab073c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:58.575000 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17438655-48a2-4a10-9e64-c3ba7aab073c admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:58.609648 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a6bf5-7ea8-4d2a-9a18-d466b4b8f39b admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:58.615908 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1064/2143] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:58.630075 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a6bf5-7ea8-4d2a-9a18-d466b4b8f39b admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:58.642706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f13ba-225d-459c-98d2-58bf4d62c844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:58.645918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f13ba-225d-459c-98d2-58bf4d62c844 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:58.646231 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f13ba-225d-459c-98d2-58bf4d62c844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:58.646522 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f13ba-225d-459c-98d2-58bf4d62c844 admin admin] PATH_INFO: `/v3/projects/b61de993c530404f82b797dfe0ddf2b1/users/88c9772b5eb34909921d7aa7fee549aa/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:58.684169 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f13ba-225d-459c-98d2-58bf4d62c844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61de993c530404f82b797dfe0ddf2b1, user_id=88c9772b5eb34909921d7aa7fee549aa, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:58.686933 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f13ba-225d-459c-98d2-58bf4d62c844 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:58.827845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:58.834306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1080/2144] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:58 2022] PUT /identity/v3/projects/b61de993c530404f82b797dfe0ddf2b1/users/88c9772b5eb34909921d7aa7fee549aa/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:58.845740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7728f-45e0-45f6-8955-09cf4263d475 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:58.846033 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7728f-45e0-45f6-8955-09cf4263d475 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:58.846317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7728f-45e0-45f6-8955-09cf4263d475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:58.891228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-72a7728f-45e0-45f6-8955-09cf4263d475 None None] MFA Rules not processed for user `88c9772b5eb34909921d7aa7fee549aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:58.891789 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-72a7728f-45e0-45f6-8955-09cf4263d475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:58.914777 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:59.016582 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1065/2145] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:59.030495 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f13ba-225d-459c-98d2-58bf4d62c844 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:59.036737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-f53f13ba-225d-459c-98d2-58bf4d62c844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:59.132632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f13ba-225d-459c-98d2-58bf4d62c844 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:59.138701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e5c77-7957-48df-9719-44f34dddef3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:59.162599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e5c77-7957-48df-9719-44f34dddef3c service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:59.163221 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e5c77-7957-48df-9719-44f34dddef3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:59.163345 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e5c77-7957-48df-9719-44f34dddef3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:59.193330 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e5c77-7957-48df-9719-44f34dddef3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:59.196666 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e5c77-7957-48df-9719-44f34dddef3c service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:59.216027 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1081/2146] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:59.250149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7728f-45e0-45f6-8955-09cf4263d475 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:59.419157 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7728f-45e0-45f6-8955-09cf4263d475 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:59.428250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c88adb-0753-4b8b-ae4c-ae8f0b2e39ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:59.432305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c88adb-0753-4b8b-ae4c-ae8f0b2e39ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:59.436051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c88adb-0753-4b8b-ae4c-ae8f0b2e39ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:59.436051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c88adb-0753-4b8b-ae4c-ae8f0b2e39ca admin admin] PATH_INFO: `/v3/users/88c9772b5eb34909921d7aa7fee549aa` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:59.437621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c88adb-0753-4b8b-ae4c-ae8f0b2e39ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c9772b5eb34909921d7aa7fee549aa)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:59.443112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c88adb-0753-4b8b-ae4c-ae8f0b2e39ca admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:59.729713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-48c88adb-0753-4b8b-ae4c-ae8f0b2e39ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c9772b5eb34909921d7aa7fee549aa'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:59.752980 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-48c88adb-0753-4b8b-ae4c-ae8f0b2e39ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c9772b5eb34909921d7aa7fee549aa'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:59.862686 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-48c88adb-0753-4b8b-ae4c-ae8f0b2e39ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c9772b5eb34909921d7aa7fee549aa'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:59.863604 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-48c88adb-0753-4b8b-ae4c-ae8f0b2e39ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c9772b5eb34909921d7aa7fee549aa'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:59.914952 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-48c88adb-0753-4b8b-ae4c-ae8f0b2e39ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c9772b5eb34909921d7aa7fee549aa'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:59.945125 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba5b76-61c8-4a84-84e2-5a537bcf1a3b None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:59.946008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba5b76-61c8-4a84-84e2-5a537bcf1a3b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:59.946536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba5b76-61c8-4a84-84e2-5a537bcf1a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:59.950354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1066/2147] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:59 2022] DELETE /identity/v3/users/88c9772b5eb34909921d7aa7fee549aa => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:59.990371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-81ba5b76-61c8-4a84-84e2-5a537bcf1a3b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:59.997532 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-81ba5b76-61c8-4a84-84e2-5a537bcf1a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:00.034148 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:00.185157 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1082/2148] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:00.197679 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c88adb-0753-4b8b-ae4c-ae8f0b2e39ca admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:00.199559 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-48c88adb-0753-4b8b-ae4c-ae8f0b2e39ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:00.314643 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c88adb-0753-4b8b-ae4c-ae8f0b2e39ca admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:00.319604 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842db91b-4cb1-40ce-9ebf-4f0051a071b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:00.320349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842db91b-4cb1-40ce-9ebf-4f0051a071b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:00.320785 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842db91b-4cb1-40ce-9ebf-4f0051a071b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:00.321182 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842db91b-4cb1-40ce-9ebf-4f0051a071b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:00.333586 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842db91b-4cb1-40ce-9ebf-4f0051a071b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:00.360362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842db91b-4cb1-40ce-9ebf-4f0051a071b3 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:00.390298 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1067/2149] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:00.524700 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b137e7-8a7e-46de-bf50-df694c2faed7 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:00.525300 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b137e7-8a7e-46de-bf50-df694c2faed7 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:00.525300 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b137e7-8a7e-46de-bf50-df694c2faed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:00.528712 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:00.578965 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-60b137e7-8a7e-46de-bf50-df694c2faed7 None None] MFA Rules not processed for user `79fd9e0292fb4ebab755519ecc20235e`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:00.581377 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-60b137e7-8a7e-46de-bf50-df694c2faed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:00.689189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1083/2150] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:01:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:00.702087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842db91b-4cb1-40ce-9ebf-4f0051a071b3 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:00.704565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-842db91b-4cb1-40ce-9ebf-4f0051a071b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:00.852345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842db91b-4cb1-40ce-9ebf-4f0051a071b3 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:00.857426 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fd7de-077f-4b85-8b32-519eb62910c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:00.859245 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fd7de-077f-4b85-8b32-519eb62910c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:00.859529 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fd7de-077f-4b85-8b32-519eb62910c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:00.859808 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fd7de-077f-4b85-8b32-519eb62910c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:00.872979 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6fd7de-077f-4b85-8b32-519eb62910c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:00.874571 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6fd7de-077f-4b85-8b32-519eb62910c8 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:00.886707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1068/2151] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:01.391338 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b137e7-8a7e-46de-bf50-df694c2faed7 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:01.392971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-60b137e7-8a7e-46de-bf50-df694c2faed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:01.407794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:01.420246 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b137e7-8a7e-46de-bf50-df694c2faed7 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:01.432980 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cbb17-5d11-4a6a-8105-83962ad62662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:01.436731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cbb17-5d11-4a6a-8105-83962ad62662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:01.439607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cbb17-5d11-4a6a-8105-83962ad62662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:01.440028 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cbb17-5d11-4a6a-8105-83962ad62662 admin admin] PATH_INFO: `/v3/projects/b61de993c530404f82b797dfe0ddf2b1` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:01.445103 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cbb17-5d11-4a6a-8105-83962ad62662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b61de993c530404f82b797dfe0ddf2b1)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:01.449397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cbb17-5d11-4a6a-8105-83962ad62662 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:01.555064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fd7de-077f-4b85-8b32-519eb62910c8 service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:01.556526 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-9e6fd7de-077f-4b85-8b32-519eb62910c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:01.585857 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fd7de-077f-4b85-8b32-519eb62910c8 service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:01.595800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f1317-5240-4a39-b2e1-6b2ee3cbc8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:01.596656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f1317-5240-4a39-b2e1-6b2ee3cbc8c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:01.596942 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f1317-5240-4a39-b2e1-6b2ee3cbc8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:01.597223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f1317-5240-4a39-b2e1-6b2ee3cbc8c4 admin admin] PATH_INFO: `/v3/users/706c93865d0d4980a9f80e00665b1c37` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:01.598513 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f1317-5240-4a39-b2e1-6b2ee3cbc8c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=706c93865d0d4980a9f80e00665b1c37)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:01.600749 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f1317-5240-4a39-b2e1-6b2ee3cbc8c4 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:01.695056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-3e7cbb17-5d11-4a6a-8105-83962ad62662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b61de993c530404f82b797dfe0ddf2b1', 'request_id': 'req-3e7cbb17-5d11-4a6a-8105-83962ad62662'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:01.709968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-3e7cbb17-5d11-4a6a-8105-83962ad62662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b61de993c530404f82b797dfe0ddf2b1', 'request_id': 'req-3e7cbb17-5d11-4a6a-8105-83962ad62662'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:01.817026 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-3e7cbb17-5d11-4a6a-8105-83962ad62662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b61de993c530404f82b797dfe0ddf2b1', 'request_id': 'req-3e7cbb17-5d11-4a6a-8105-83962ad62662'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:01.849467 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-3e7cbb17-5d11-4a6a-8105-83962ad62662 admin admin] The token cache is being invalidate because project b61de993c530404f82b797dfe0ddf2b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:01:01.851659 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-3e7cbb17-5d11-4a6a-8105-83962ad62662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:01.852634 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-3e7cbb17-5d11-4a6a-8105-83962ad62662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:01.855900 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-7a1f1317-5240-4a39-b2e1-6b2ee3cbc8c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '706c93865d0d4980a9f80e00665b1c37'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:01.859135 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1084/2152] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:01:01 2022] DELETE /identity/v3/projects/b61de993c530404f82b797dfe0ddf2b1 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:01.866236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba4824-f20c-4d2d-91dd-9648d8583dc2 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:01.866528 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba4824-f20c-4d2d-91dd-9648d8583dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:01.866922 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba4824-f20c-4d2d-91dd-9648d8583dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:01.878087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-7a1f1317-5240-4a39-b2e1-6b2ee3cbc8c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '706c93865d0d4980a9f80e00665b1c37'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:01.914050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-78ba4824-f20c-4d2d-91dd-9648d8583dc2 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:01.916297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-78ba4824-f20c-4d2d-91dd-9648d8583dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:01.948574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-7a1f1317-5240-4a39-b2e1-6b2ee3cbc8c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '706c93865d0d4980a9f80e00665b1c37'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:01.949378 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-7a1f1317-5240-4a39-b2e1-6b2ee3cbc8c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '706c93865d0d4980a9f80e00665b1c37'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:01.971911 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-7a1f1317-5240-4a39-b2e1-6b2ee3cbc8c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '706c93865d0d4980a9f80e00665b1c37'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:01.985041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1069/2153] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:01:01 2022] DELETE /identity/v3/users/706c93865d0d4980a9f80e00665b1c37 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:01.990970 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831b10e-4841-4048-9163-3effe363937e None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:01.991400 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831b10e-4841-4048-9163-3effe363937e None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:01.992069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831b10e-4841-4048-9163-3effe363937e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:02.022684 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-9831b10e-4841-4048-9163-3effe363937e None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:02.026502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-9831b10e-4841-4048-9163-3effe363937e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:02.030848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1085/2154] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:02.040138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0aa7b5-2211-4a31-8988-44e04b7e8d9c None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:02.040824 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0aa7b5-2211-4a31-8988-44e04b7e8d9c None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:02.041267 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0aa7b5-2211-4a31-8988-44e04b7e8d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:02.090048 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-2f0aa7b5-2211-4a31-8988-44e04b7e8d9c None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:02.092031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-2f0aa7b5-2211-4a31-8988-44e04b7e8d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:02.250823 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1070/2155] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:01:02.259428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831b10e-4841-4048-9163-3effe363937e None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:02.261084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-9831b10e-4841-4048-9163-3effe363937e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:02.313449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1086/2156] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:02.314352 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0aa7b5-2211-4a31-8988-44e04b7e8d9c None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:02.330695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0aa7b5-2211-4a31-8988-44e04b7e8d9c None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:02.343259 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311994f8-daba-4f56-9112-3965cb2ce737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:02.344017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311994f8-daba-4f56-9112-3965cb2ce737 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:02.344451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311994f8-daba-4f56-9112-3965cb2ce737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:02.344798 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311994f8-daba-4f56-9112-3965cb2ce737 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:02.345585 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311994f8-daba-4f56-9112-3965cb2ce737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:01:02.345968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311994f8-daba-4f56-9112-3965cb2ce737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:02.348427 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311994f8-daba-4f56-9112-3965cb2ce737 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:02.354434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831b10e-4841-4048-9163-3effe363937e None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:02.358306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12269f99-5913-49bb-8558-65c6c2a4929c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:02.358962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12269f99-5913-49bb-8558-65c6c2a4929c service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:02.359244 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12269f99-5913-49bb-8558-65c6c2a4929c service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:02.359521 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12269f99-5913-49bb-8558-65c6c2a4929c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:02.369235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1087/2157] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:01:02.370236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311994f8-daba-4f56-9112-3965cb2ce737 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:02.370349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12269f99-5913-49bb-8558-65c6c2a4929c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:02.371732 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12269f99-5913-49bb-8558-65c6c2a4929c service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:02.383553 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1071/2158] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:01:02.383817 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311994f8-daba-4f56-9112-3965cb2ce737 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:02.388773 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d726e2e-62f7-4b94-810e-e04f6c1d748c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:02.389536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d726e2e-62f7-4b94-810e-e04f6c1d748c admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:02.389835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d726e2e-62f7-4b94-810e-e04f6c1d748c admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:02.390270 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d726e2e-62f7-4b94-810e-e04f6c1d748c admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:02.391068 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d726e2e-62f7-4b94-810e-e04f6c1d748c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:02.393073 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d726e2e-62f7-4b94-810e-e04f6c1d748c admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:02.683545 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1088/2159] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:01:02 2022] POST /identity/v3/projects => generated 377 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:01:02.687719 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12269f99-5913-49bb-8558-65c6c2a4929c service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:02.700744 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12269f99-5913-49bb-8558-65c6c2a4929c service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:02.800113 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5d7d9-8798-4c41-b474-a236c3ef96ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:02.800113 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5d7d9-8798-4c41-b474-a236c3ef96ee admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:02.800113 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5d7d9-8798-4c41-b474-a236c3ef96ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:02.800113 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5d7d9-8798-4c41-b474-a236c3ef96ee admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:02.800470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5d7d9-8798-4c41-b474-a236c3ef96ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:02.800470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5d7d9-8798-4c41-b474-a236c3ef96ee admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:02.819729 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:02.938467 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1072/2160] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:01:02 2022] POST /identity/v3/users => generated 289 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:01:02.946306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d726e2e-62f7-4b94-810e-e04f6c1d748c admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:02.964078 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d726e2e-62f7-4b94-810e-e04f6c1d748c admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:02.972366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ae4bc-6c11-45a3-9c25-1b09d7034692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:02.973018 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ae4bc-6c11-45a3-9c25-1b09d7034692 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:02.973308 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ae4bc-6c11-45a3-9c25-1b09d7034692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:02.973590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ae4bc-6c11-45a3-9c25-1b09d7034692 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:02.974342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ae4bc-6c11-45a3-9c25-1b09d7034692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:02.975993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ae4bc-6c11-45a3-9c25-1b09d7034692 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:03.002356 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1089/2161] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:03.007249 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5d7d9-8798-4c41-b474-a236c3ef96ee admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:03.009388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:03.025631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5d7d9-8798-4c41-b474-a236c3ef96ee admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:03.031929 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa837fa-6469-4184-b276-28cd791f36b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:03.032786 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa837fa-6469-4184-b276-28cd791f36b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:03.033865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa837fa-6469-4184-b276-28cd791f36b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:03.034460 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa837fa-6469-4184-b276-28cd791f36b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:03.035617 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa837fa-6469-4184-b276-28cd791f36b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:03.037552 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa837fa-6469-4184-b276-28cd791f36b8 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:03.055749 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1073/2162] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:03.060140 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ae4bc-6c11-45a3-9c25-1b09d7034692 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:03.078647 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ae4bc-6c11-45a3-9c25-1b09d7034692 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:03.086535 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ebcf6-551f-43e4-9f0d-60d551eb7b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:03.089682 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ebcf6-551f-43e4-9f0d-60d551eb7b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:03.090060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ebcf6-551f-43e4-9f0d-60d551eb7b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:03.090356 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ebcf6-551f-43e4-9f0d-60d551eb7b00 admin admin] PATH_INFO: `/v3/projects/b0abbfb4c0ba40969f865fc573288b92/users/38513e00dedf4e7b9829d4be70b2bcc1/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:03.116950 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ebcf6-551f-43e4-9f0d-60d551eb7b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0abbfb4c0ba40969f865fc573288b92, user_id=38513e00dedf4e7b9829d4be70b2bcc1, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:03.121301 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ebcf6-551f-43e4-9f0d-60d551eb7b00 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:03.134082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa837fa-6469-4184-b276-28cd791f36b8 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:03.135834 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-7fa837fa-6469-4184-b276-28cd791f36b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:03.173330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa837fa-6469-4184-b276-28cd791f36b8 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:03.187733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52faa2-9632-4db2-bb47-983a7f9e00c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:03.188546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52faa2-9632-4db2-bb47-983a7f9e00c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:03.197546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52faa2-9632-4db2-bb47-983a7f9e00c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:03.197546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52faa2-9632-4db2-bb47-983a7f9e00c0 admin admin] PATH_INFO: `/v3/projects/6da09a07ce2848cb84666f16588849dc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:03.197546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52faa2-9632-4db2-bb47-983a7f9e00c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da09a07ce2848cb84666f16588849dc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:03.197546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52faa2-9632-4db2-bb47-983a7f9e00c0 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:03.242825 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1090/2163] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:03 2022] PUT /identity/v3/projects/b0abbfb4c0ba40969f865fc573288b92/users/38513e00dedf4e7b9829d4be70b2bcc1/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:03.249149 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1ef77-e2bc-43ee-8d46-bf9a791be370 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:03.249560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1ef77-e2bc-43ee-8d46-bf9a791be370 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:03.249953 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1ef77-e2bc-43ee-8d46-bf9a791be370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:03.305201 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-54a1ef77-e2bc-43ee-8d46-bf9a791be370 None None] MFA Rules not processed for user `38513e00dedf4e7b9829d4be70b2bcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:03.306456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-54a1ef77-e2bc-43ee-8d46-bf9a791be370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:03.391392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-9b52faa2-9632-4db2-bb47-983a7f9e00c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da09a07ce2848cb84666f16588849dc', 'request_id': 'req-9b52faa2-9632-4db2-bb47-983a7f9e00c0'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:03.412273 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-9b52faa2-9632-4db2-bb47-983a7f9e00c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da09a07ce2848cb84666f16588849dc', 'request_id': 'req-9b52faa2-9632-4db2-bb47-983a7f9e00c0'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:03.499904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-9b52faa2-9632-4db2-bb47-983a7f9e00c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da09a07ce2848cb84666f16588849dc', 'request_id': 'req-9b52faa2-9632-4db2-bb47-983a7f9e00c0'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:03.500118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1091/2164] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:01:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:03.520153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1ef77-e2bc-43ee-8d46-bf9a791be370 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:03.523676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-54a1ef77-e2bc-43ee-8d46-bf9a791be370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:03.529414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-9b52faa2-9632-4db2-bb47-983a7f9e00c0 admin admin] The token cache is being invalidate because project 6da09a07ce2848cb84666f16588849dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:01:03.530430 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-9b52faa2-9632-4db2-bb47-983a7f9e00c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:03.534930 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-9b52faa2-9632-4db2-bb47-983a7f9e00c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:03.538391 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1074/2165] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:01:03 2022] DELETE /identity/v3/projects/6da09a07ce2848cb84666f16588849dc => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:03.545867 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52faa2-9632-4db2-bb47-983a7f9e00c0 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:03.549016 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-9b52faa2-9632-4db2-bb47-983a7f9e00c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:03.697027 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1ef77-e2bc-43ee-8d46-bf9a791be370 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:03.733192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52faa2-9632-4db2-bb47-983a7f9e00c0 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:03.754583 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece167fd-6aa3-4776-8f60-0bf26292093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:03.757871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece167fd-6aa3-4776-8f60-0bf26292093f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:03.760822 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece167fd-6aa3-4776-8f60-0bf26292093f admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:03.771453 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece167fd-6aa3-4776-8f60-0bf26292093f admin admin] PATH_INFO: `/v3/users/7a402e2216644d8796e390f6b20c07b2` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:03.773047 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece167fd-6aa3-4776-8f60-0bf26292093f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a402e2216644d8796e390f6b20c07b2)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:03.789033 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece167fd-6aa3-4776-8f60-0bf26292093f admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:03.816257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee4b6f-9f09-480a-ba40-0c0f8b29ce2b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b99f03a7c14a2e89384dcca532dc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:03.816965 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee4b6f-9f09-480a-ba40-0c0f8b29ce2b service glance] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:03.817248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee4b6f-9f09-480a-ba40-0c0f8b29ce2b service glance] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:03.817559 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee4b6f-9f09-480a-ba40-0c0f8b29ce2b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:03.826925 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ebee4b6f-9f09-480a-ba40-0c0f8b29ce2b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:03.914001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee4b6f-9f09-480a-ba40-0c0f8b29ce2b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:03.915509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee4b6f-9f09-480a-ba40-0c0f8b29ce2b service glance] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:03.935513 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1092/2166] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:03.935854 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee4b6f-9f09-480a-ba40-0c0f8b29ce2b service glance] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:03.942023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ebee4b6f-9f09-480a-ba40-0c0f8b29ce2b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:03.966304 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee4b6f-9f09-480a-ba40-0c0f8b29ce2b service glance] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:03.971452 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4870e15-a491-42a2-b4bd-454702409f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:03.973358 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4870e15-a491-42a2-b4bd-454702409f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:03.974346 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4870e15-a491-42a2-b4bd-454702409f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:03.974706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4870e15-a491-42a2-b4bd-454702409f26 admin admin] PATH_INFO: `/v3/users/bbf46bef60464329afdf2df75842a41e` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:03.977207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4870e15-a491-42a2-b4bd-454702409f26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbf46bef60464329afdf2df75842a41e)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:03.979761 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4870e15-a491-42a2-b4bd-454702409f26 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:04.095305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ece167fd-6aa3-4776-8f60-0bf26292093f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a402e2216644d8796e390f6b20c07b2'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:04.110992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ece167fd-6aa3-4776-8f60-0bf26292093f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a402e2216644d8796e390f6b20c07b2'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:04.230193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ece167fd-6aa3-4776-8f60-0bf26292093f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a402e2216644d8796e390f6b20c07b2'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:04.230879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ece167fd-6aa3-4776-8f60-0bf26292093f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a402e2216644d8796e390f6b20c07b2'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:04.251654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ece167fd-6aa3-4776-8f60-0bf26292093f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a402e2216644d8796e390f6b20c07b2'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:04.261692 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1075/2167] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:01:03 2022] DELETE /identity/v3/users/7a402e2216644d8796e390f6b20c07b2 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:04.263496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05450a02-a90a-4eed-9f83-2a92ea4698d2 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:04.264412 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05450a02-a90a-4eed-9f83-2a92ea4698d2 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:04.266321 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c4870e15-a491-42a2-b4bd-454702409f26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbf46bef60464329afdf2df75842a41e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:04.273506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05450a02-a90a-4eed-9f83-2a92ea4698d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:04.292331 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c4870e15-a491-42a2-b4bd-454702409f26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbf46bef60464329afdf2df75842a41e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:04.304410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c4870e15-a491-42a2-b4bd-454702409f26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbf46bef60464329afdf2df75842a41e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:04.310188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-05450a02-a90a-4eed-9f83-2a92ea4698d2 None None] MFA Rules not processed for user `79fd9e0292fb4ebab755519ecc20235e`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:04.330208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c4870e15-a491-42a2-b4bd-454702409f26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbf46bef60464329afdf2df75842a41e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:04.331078 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c4870e15-a491-42a2-b4bd-454702409f26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbf46bef60464329afdf2df75842a41e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:04.334384 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-05450a02-a90a-4eed-9f83-2a92ea4698d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:04.414832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:04.421067 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1093/2168] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:01:03 2022] DELETE /identity/v3/users/bbf46bef60464329afdf2df75842a41e => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:04.460321 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1076/2169] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:01:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:04.523987 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:04.835791 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4870e15-a491-42a2-b4bd-454702409f26 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:04.837684 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-c4870e15-a491-42a2-b4bd-454702409f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:05.026286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4870e15-a491-42a2-b4bd-454702409f26 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:05.059671 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98698023-107f-4be3-b351-2af74d1b65b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:05.060490 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98698023-107f-4be3-b351-2af74d1b65b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:05.060987 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98698023-107f-4be3-b351-2af74d1b65b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:05.061267 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98698023-107f-4be3-b351-2af74d1b65b5 admin admin] PATH_INFO: `/v3/projects/b4c4a2f8c7864ee692c5b1b55b4aacac` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:05.063245 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98698023-107f-4be3-b351-2af74d1b65b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4c4a2f8c7864ee692c5b1b55b4aacac)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:05.067280 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98698023-107f-4be3-b351-2af74d1b65b5 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:05.079879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05450a02-a90a-4eed-9f83-2a92ea4698d2 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:05.082075 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-05450a02-a90a-4eed-9f83-2a92ea4698d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:05.253003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-98698023-107f-4be3-b351-2af74d1b65b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'request_id': 'req-98698023-107f-4be3-b351-2af74d1b65b5'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:05.286417 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-98698023-107f-4be3-b351-2af74d1b65b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'request_id': 'req-98698023-107f-4be3-b351-2af74d1b65b5'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:05.318835 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05450a02-a90a-4eed-9f83-2a92ea4698d2 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:05.365865 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-98698023-107f-4be3-b351-2af74d1b65b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4c4a2f8c7864ee692c5b1b55b4aacac', 'request_id': 'req-98698023-107f-4be3-b351-2af74d1b65b5'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:05.377425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:05.393364 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-98698023-107f-4be3-b351-2af74d1b65b5 admin admin] The token cache is being invalidate because project b4c4a2f8c7864ee692c5b1b55b4aacac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:01:05.394389 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-98698023-107f-4be3-b351-2af74d1b65b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:05.395673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-98698023-107f-4be3-b351-2af74d1b65b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:05.399853 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1094/2170] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:01:04 2022] DELETE /identity/v3/projects/b4c4a2f8c7864ee692c5b1b55b4aacac => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:05.408748 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c91ed2-52e8-4f03-9502-9bd506273256 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:05.408748 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c91ed2-52e8-4f03-9502-9bd506273256 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:05.408748 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c91ed2-52e8-4f03-9502-9bd506273256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:05.448821 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-77c91ed2-52e8-4f03-9502-9bd506273256 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:05.452282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-77c91ed2-52e8-4f03-9502-9bd506273256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:05.457421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4e491-a923-4d74-a5a9-f7448d7f6e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:05.458874 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4e491-a923-4d74-a5a9-f7448d7f6e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:05.459265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4e491-a923-4d74-a5a9-f7448d7f6e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:05.459653 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4e491-a923-4d74-a5a9-f7448d7f6e0d admin admin] PATH_INFO: `/v3/projects/5f5020d2bd974c00845af3c46c41f0b9` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:05.462390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4e491-a923-4d74-a5a9-f7448d7f6e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f5020d2bd974c00845af3c46c41f0b9)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:05.465248 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4e491-a923-4d74-a5a9-f7448d7f6e0d admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:05.467146 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1095/2171] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:01:05.474508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e607fcd-c002-4931-a9b5-846a63ece53b None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:05.474820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e607fcd-c002-4931-a9b5-846a63ece53b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:05.475423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e607fcd-c002-4931-a9b5-846a63ece53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:05.497680 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-6e607fcd-c002-4931-a9b5-846a63ece53b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:05.508580 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-6e607fcd-c002-4931-a9b5-846a63ece53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:05.512863 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1096/2172] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:05.513787 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e607fcd-c002-4931-a9b5-846a63ece53b None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:05.524970 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e607fcd-c002-4931-a9b5-846a63ece53b None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:05.535629 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535807dd-6334-442b-bed4-41ea7098cfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:05.540379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535807dd-6334-442b-bed4-41ea7098cfc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:05.540379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535807dd-6334-442b-bed4-41ea7098cfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:05.540379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535807dd-6334-442b-bed4-41ea7098cfc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:05.540379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535807dd-6334-442b-bed4-41ea7098cfc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:01:05.540379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535807dd-6334-442b-bed4-41ea7098cfc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:05.540379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535807dd-6334-442b-bed4-41ea7098cfc5 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:05.556777 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1097/2173] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:01:05.562886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535807dd-6334-442b-bed4-41ea7098cfc5 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:05.575924 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535807dd-6334-442b-bed4-41ea7098cfc5 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:05.581457 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda2962-202f-40f4-91e7-0114f0ac930d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:05.582088 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda2962-202f-40f4-91e7-0114f0ac930d admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:05.582549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda2962-202f-40f4-91e7-0114f0ac930d admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:05.583299 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda2962-202f-40f4-91e7-0114f0ac930d admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:05.584431 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda2962-202f-40f4-91e7-0114f0ac930d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:05.586477 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda2962-202f-40f4-91e7-0114f0ac930d admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:05.667876 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2de4e491-a923-4d74-a5a9-f7448d7f6e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f5020d2bd974c00845af3c46c41f0b9', 'request_id': 'req-2de4e491-a923-4d74-a5a9-f7448d7f6e0d'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:05.679311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2de4e491-a923-4d74-a5a9-f7448d7f6e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f5020d2bd974c00845af3c46c41f0b9', 'request_id': 'req-2de4e491-a923-4d74-a5a9-f7448d7f6e0d'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:05.712506 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1098/2174] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:01:05 2022] POST /identity/v3/projects => generated 367 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:01:05.716913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda2962-202f-40f4-91e7-0114f0ac930d admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:05.790229 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2de4e491-a923-4d74-a5a9-f7448d7f6e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f5020d2bd974c00845af3c46c41f0b9', 'request_id': 'req-2de4e491-a923-4d74-a5a9-f7448d7f6e0d'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:05.807338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2de4e491-a923-4d74-a5a9-f7448d7f6e0d admin admin] The token cache is being invalidate because project 5f5020d2bd974c00845af3c46c41f0b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:01:05.807639 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2de4e491-a923-4d74-a5a9-f7448d7f6e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:05.809165 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2de4e491-a923-4d74-a5a9-f7448d7f6e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:05.811887 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1077/2175] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:01:05 2022] DELETE /identity/v3/projects/5f5020d2bd974c00845af3c46c41f0b9 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:01:05.818386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4e491-a923-4d74-a5a9-f7448d7f6e0d admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:05.822589 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:05.823810 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda2962-202f-40f4-91e7-0114f0ac930d admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:05.827889 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-2de4e491-a923-4d74-a5a9-f7448d7f6e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:05.842466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b810a7-bc6d-4644-a94a-e41f4c689b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:05.844422 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b810a7-bc6d-4644-a94a-e41f4c689b1a admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:05.844715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b810a7-bc6d-4644-a94a-e41f4c689b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:05.844996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b810a7-bc6d-4644-a94a-e41f4c689b1a admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:05.848130 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b810a7-bc6d-4644-a94a-e41f4c689b1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:05.853328 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b810a7-bc6d-4644-a94a-e41f4c689b1a admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:05.940924 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4e491-a923-4d74-a5a9-f7448d7f6e0d admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:05.945770 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596468b8-2830-41ec-a66f-1a2efc6b8a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:05.946473 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596468b8-2830-41ec-a66f-1a2efc6b8a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:05.946852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596468b8-2830-41ec-a66f-1a2efc6b8a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:05.947135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596468b8-2830-41ec-a66f-1a2efc6b8a5c admin admin] PATH_INFO: `/v3/users/147944a44a4248e69bf382fc48a007dd` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:05.948409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596468b8-2830-41ec-a66f-1a2efc6b8a5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=147944a44a4248e69bf382fc48a007dd)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:05.950468 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596468b8-2830-41ec-a66f-1a2efc6b8a5c admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:05.974356 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1099/2176] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:01:05 2022] POST /identity/v3/users => generated 284 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:01:05.977464 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b810a7-bc6d-4644-a94a-e41f4c689b1a admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:05.984631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e1b810a7-bc6d-4644-a94a-e41f4c689b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:06.004945 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b810a7-bc6d-4644-a94a-e41f4c689b1a admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:06.015627 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ea850-25aa-442e-a97a-8b114caed0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:06.016523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ea850-25aa-442e-a97a-8b114caed0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:06.018016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ea850-25aa-442e-a97a-8b114caed0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:06.018565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ea850-25aa-442e-a97a-8b114caed0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:06.019646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ea850-25aa-442e-a97a-8b114caed0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:06.031381 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ea850-25aa-442e-a97a-8b114caed0c4 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:06.046011 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1100/2177] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:06.047724 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ea850-25aa-442e-a97a-8b114caed0c4 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:06.062240 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ea850-25aa-442e-a97a-8b114caed0c4 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:06.068817 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda1f6c-13d0-4457-a406-d0279ede8e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:06.069513 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda1f6c-13d0-4457-a406-d0279ede8e2d admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:06.071295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda1f6c-13d0-4457-a406-d0279ede8e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:06.071295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda1f6c-13d0-4457-a406-d0279ede8e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:06.071295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda1f6c-13d0-4457-a406-d0279ede8e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:06.072551 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda1f6c-13d0-4457-a406-d0279ede8e2d admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:06.086803 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1101/2178] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:06.091058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda1f6c-13d0-4457-a406-d0279ede8e2d admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:06.108283 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda1f6c-13d0-4457-a406-d0279ede8e2d admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:06.115334 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c439a9-346c-40a7-b2db-58040f660e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:06.116051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c439a9-346c-40a7-b2db-58040f660e3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:06.116413 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c439a9-346c-40a7-b2db-58040f660e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:06.116643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c439a9-346c-40a7-b2db-58040f660e3b admin admin] PATH_INFO: `/v3/projects/945067284a4a49338989c4bd2452a144/users/5119115a782d41b2b473ad1738086021/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:06.135759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c439a9-346c-40a7-b2db-58040f660e3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=945067284a4a49338989c4bd2452a144, user_id=5119115a782d41b2b473ad1738086021, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:06.149119 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c439a9-346c-40a7-b2db-58040f660e3b admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:06.213782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-596468b8-2830-41ec-a66f-1a2efc6b8a5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147944a44a4248e69bf382fc48a007dd'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:06.227239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-596468b8-2830-41ec-a66f-1a2efc6b8a5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147944a44a4248e69bf382fc48a007dd'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:06.279006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1102/2179] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:06 2022] PUT /identity/v3/projects/945067284a4a49338989c4bd2452a144/users/5119115a782d41b2b473ad1738086021/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:06.285033 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae4eca-6c70-4f0e-9a70-ff1285259629 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:06.285424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae4eca-6c70-4f0e-9a70-ff1285259629 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:06.286703 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae4eca-6c70-4f0e-9a70-ff1285259629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:06.333787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-596468b8-2830-41ec-a66f-1a2efc6b8a5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147944a44a4248e69bf382fc48a007dd'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:06.334573 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-596468b8-2830-41ec-a66f-1a2efc6b8a5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147944a44a4248e69bf382fc48a007dd'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:06.354010 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-596468b8-2830-41ec-a66f-1a2efc6b8a5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147944a44a4248e69bf382fc48a007dd'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:06.372180 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1078/2180] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:01:05 2022] DELETE /identity/v3/users/147944a44a4248e69bf382fc48a007dd => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:06.377985 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-d9ae4eca-6c70-4f0e-9a70-ff1285259629 None None] MFA Rules not processed for user `5119115a782d41b2b473ad1738086021`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:06.382753 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d9ae4eca-6c70-4f0e-9a70-ff1285259629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:06.524156 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1103/2181] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:01:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:06.524604 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596468b8-2830-41ec-a66f-1a2efc6b8a5c admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:06.524604 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-596468b8-2830-41ec-a66f-1a2efc6b8a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:06.749640 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596468b8-2830-41ec-a66f-1a2efc6b8a5c admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:06.771262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1fcca-2376-42ee-8a6f-f533908eb61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:06.771843 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1fcca-2376-42ee-8a6f-f533908eb61d admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:06.772132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1fcca-2376-42ee-8a6f-f533908eb61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:06.772416 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1fcca-2376-42ee-8a6f-f533908eb61d admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:06.773123 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1fcca-2376-42ee-8a6f-f533908eb61d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:06.775328 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1fcca-2376-42ee-8a6f-f533908eb61d admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:06.906578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1079/2182] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:01:06 2022] POST /identity/v3/projects => generated 369 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:01:06.910931 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae4eca-6c70-4f0e-9a70-ff1285259629 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:06.927600 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae4eca-6c70-4f0e-9a70-ff1285259629 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:07.018762 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e915a-6117-4b39-868b-886ec425e50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:07.019543 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e915a-6117-4b39-868b-886ec425e50b admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:07.019835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e915a-6117-4b39-868b-886ec425e50b admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:07.020138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e915a-6117-4b39-868b-886ec425e50b admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:07.025030 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e915a-6117-4b39-868b-886ec425e50b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:07.025030 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e915a-6117-4b39-868b-886ec425e50b admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:07.056628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:07.175234 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1104/2183] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:01:06 2022] POST /identity/v3/users => generated 291 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:01:07.176989 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1fcca-2376-42ee-8a6f-f533908eb61d admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:07.188830 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1fcca-2376-42ee-8a6f-f533908eb61d admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:07.194014 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66852381-b11c-4719-9701-a681f1503659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:07.194664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66852381-b11c-4719-9701-a681f1503659 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:07.195039 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66852381-b11c-4719-9701-a681f1503659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:07.195320 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66852381-b11c-4719-9701-a681f1503659 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:07.196037 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66852381-b11c-4719-9701-a681f1503659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:07.197832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66852381-b11c-4719-9701-a681f1503659 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:07.213392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1080/2184] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:07.217388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e915a-6117-4b39-868b-886ec425e50b admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:07.232320 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e915a-6117-4b39-868b-886ec425e50b admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:07.239947 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad247f2-fa27-4419-806f-eb4304b80cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:07.241179 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad247f2-fa27-4419-806f-eb4304b80cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:07.241571 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad247f2-fa27-4419-806f-eb4304b80cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:07.242025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad247f2-fa27-4419-806f-eb4304b80cd0 admin admin] PATH_INFO: `/v3/projects/eb243a1558d24bf0bfd107e6b21beadd/users/359043681f454c819b9969d913393715/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:07.271997 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad247f2-fa27-4419-806f-eb4304b80cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb243a1558d24bf0bfd107e6b21beadd, user_id=359043681f454c819b9969d913393715, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:07.275755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad247f2-fa27-4419-806f-eb4304b80cd0 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:07.279538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66852381-b11c-4719-9701-a681f1503659 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:07.281797 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-66852381-b11c-4719-9701-a681f1503659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:07.301074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66852381-b11c-4719-9701-a681f1503659 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:07.307536 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b577c87-9c0c-48f6-9177-d15ba464b426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:07.308326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b577c87-9c0c-48f6-9177-d15ba464b426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:07.308746 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b577c87-9c0c-48f6-9177-d15ba464b426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:07.309126 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b577c87-9c0c-48f6-9177-d15ba464b426 admin admin] PATH_INFO: `/v3/projects/5026c8c43ef04fd7aeb605c4c181d79f` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:07.310443 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b577c87-9c0c-48f6-9177-d15ba464b426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5026c8c43ef04fd7aeb605c4c181d79f)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:07.312873 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b577c87-9c0c-48f6-9177-d15ba464b426 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:07.348611 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:07.364118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1105/2185] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:07 2022] PUT /identity/v3/projects/eb243a1558d24bf0bfd107e6b21beadd/users/359043681f454c819b9969d913393715/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:01:07.367042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad247f2-fa27-4419-806f-eb4304b80cd0 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:07.465657 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad247f2-fa27-4419-806f-eb4304b80cd0 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:07.488198 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-5b577c87-9c0c-48f6-9177-d15ba464b426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5026c8c43ef04fd7aeb605c4c181d79f', 'request_id': 'req-5b577c87-9c0c-48f6-9177-d15ba464b426'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:07.505360 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-5b577c87-9c0c-48f6-9177-d15ba464b426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5026c8c43ef04fd7aeb605c4c181d79f', 'request_id': 'req-5b577c87-9c0c-48f6-9177-d15ba464b426'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:07.545788 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0587a9e-3d3a-46cf-8658-5f3de7636294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:07.546675 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0587a9e-3d3a-46cf-8658-5f3de7636294 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:07.546967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0587a9e-3d3a-46cf-8658-5f3de7636294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:07.547745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0587a9e-3d3a-46cf-8658-5f3de7636294 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:07.548505 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0587a9e-3d3a-46cf-8658-5f3de7636294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:07.550728 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0587a9e-3d3a-46cf-8658-5f3de7636294 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:07.566786 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1106/2186] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:07.569015 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0587a9e-3d3a-46cf-8658-5f3de7636294 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:07.584355 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0587a9e-3d3a-46cf-8658-5f3de7636294 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:07.596605 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898001e9-19a8-4a88-9a47-c9fa5d464e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:07.596785 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-5b577c87-9c0c-48f6-9177-d15ba464b426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5026c8c43ef04fd7aeb605c4c181d79f', 'request_id': 'req-5b577c87-9c0c-48f6-9177-d15ba464b426'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:07.596882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898001e9-19a8-4a88-9a47-c9fa5d464e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:07.596882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898001e9-19a8-4a88-9a47-c9fa5d464e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:07.596882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898001e9-19a8-4a88-9a47-c9fa5d464e23 admin admin] PATH_INFO: `/v3/projects/eb243a1558d24bf0bfd107e6b21beadd/users/359043681f454c819b9969d913393715/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:07.596882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898001e9-19a8-4a88-9a47-c9fa5d464e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb243a1558d24bf0bfd107e6b21beadd, user_id=359043681f454c819b9969d913393715, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:07.599230 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898001e9-19a8-4a88-9a47-c9fa5d464e23 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:07.615709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1107/2187] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:07 2022] PUT /identity/v3/projects/eb243a1558d24bf0bfd107e6b21beadd/users/359043681f454c819b9969d913393715/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:07.618721 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-5b577c87-9c0c-48f6-9177-d15ba464b426 admin admin] The token cache is being invalidate because project 5026c8c43ef04fd7aeb605c4c181d79f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:01:07.619153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-5b577c87-9c0c-48f6-9177-d15ba464b426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:07.619958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-5b577c87-9c0c-48f6-9177-d15ba464b426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:07.621863 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1081/2188] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:01:07 2022] DELETE /identity/v3/projects/5026c8c43ef04fd7aeb605c4c181d79f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:01:07.626853 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8304c0-f561-4903-892a-ddf21d22e012 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:07.627220 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8304c0-f561-4903-892a-ddf21d22e012 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:07.627608 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8304c0-f561-4903-892a-ddf21d22e012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:07.627812 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db367a0-b318-49c2-95dc-3f38fa01369f None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:07.628097 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db367a0-b318-49c2-95dc-3f38fa01369f None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:07.628420 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db367a0-b318-49c2-95dc-3f38fa01369f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:07.652707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-0c8304c0-f561-4903-892a-ddf21d22e012 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:07.653908 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-0c8304c0-f561-4903-892a-ddf21d22e012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:07.664807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-5db367a0-b318-49c2-95dc-3f38fa01369f None None] MFA Rules not processed for user `359043681f454c819b9969d913393715`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:07.666359 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-5db367a0-b318-49c2-95dc-3f38fa01369f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:07.728120 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1108/2189] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:01:07.735969 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcf986-926c-4e05-96f9-276e6d390489 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:07.736265 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcf986-926c-4e05-96f9-276e6d390489 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:07.736558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcf986-926c-4e05-96f9-276e6d390489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:07.741976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1082/2190] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:01:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:01:07.752697 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db367a0-b318-49c2-95dc-3f38fa01369f None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:07.754073 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-5db367a0-b318-49c2-95dc-3f38fa01369f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:07.756884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-addcf986-926c-4e05-96f9-276e6d390489 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:07.758127 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-addcf986-926c-4e05-96f9-276e6d390489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:07.766847 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1109/2191] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:01:07.771410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcf986-926c-4e05-96f9-276e6d390489 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:07.780401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcf986-926c-4e05-96f9-276e6d390489 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:07.785427 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de316e-fac2-4330-a9e2-a489c5ee78e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:07.786033 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de316e-fac2-4330-a9e2-a489c5ee78e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:07.786972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de316e-fac2-4330-a9e2-a489c5ee78e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:07.787254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de316e-fac2-4330-a9e2-a489c5ee78e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:07.787956 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de316e-fac2-4330-a9e2-a489c5ee78e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:01:07.788263 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de316e-fac2-4330-a9e2-a489c5ee78e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:07.789891 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de316e-fac2-4330-a9e2-a489c5ee78e9 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:07.801451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1110/2192] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:01:07.805739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de316e-fac2-4330-a9e2-a489c5ee78e9 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:07.815868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de316e-fac2-4330-a9e2-a489c5ee78e9 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:07.820599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56183053-93bf-452c-b284-305d178c44c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:07.821159 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db367a0-b318-49c2-95dc-3f38fa01369f None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:07.821275 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56183053-93bf-452c-b284-305d178c44c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:07.821486 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56183053-93bf-452c-b284-305d178c44c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:07.821763 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56183053-93bf-452c-b284-305d178c44c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:07.822442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56183053-93bf-452c-b284-305d178c44c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:07.824510 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56183053-93bf-452c-b284-305d178c44c1 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:07.825194 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac596dd3-92c8-4dae-926b-4434b18c4a9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:07.825819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac596dd3-92c8-4dae-926b-4434b18c4a9f service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:07.826106 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac596dd3-92c8-4dae-926b-4434b18c4a9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:07.826414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac596dd3-92c8-4dae-926b-4434b18c4a9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:07.838416 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac596dd3-92c8-4dae-926b-4434b18c4a9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:07.839994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac596dd3-92c8-4dae-926b-4434b18c4a9f service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:07.865006 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1083/2193] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:01:08.178184 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1111/2194] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:01:07 2022] POST /identity/v3/projects => generated 369 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:01:08.184051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac596dd3-92c8-4dae-926b-4434b18c4a9f service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:08.202330 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac596dd3-92c8-4dae-926b-4434b18c4a9f service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:08.285947 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:08.344290 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a06d0d-14b2-4ba9-b3c5-be7c48b0a477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:08.345824 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a06d0d-14b2-4ba9-b3c5-be7c48b0a477 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:08.346284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a06d0d-14b2-4ba9-b3c5-be7c48b0a477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:08.346904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a06d0d-14b2-4ba9-b3c5-be7c48b0a477 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:08.354378 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a06d0d-14b2-4ba9-b3c5-be7c48b0a477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:08.355936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a06d0d-14b2-4ba9-b3c5-be7c48b0a477 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:08.461564 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:08.469232 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1084/2195] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:01:08 2022] POST /identity/v3/users => generated 285 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:01:08.475657 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56183053-93bf-452c-b284-305d178c44c1 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:08.487199 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56183053-93bf-452c-b284-305d178c44c1 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:08.493782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6be39-0ae2-4a7e-9a46-5afbacda796e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:08.497508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6be39-0ae2-4a7e-9a46-5afbacda796e admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:08.497508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6be39-0ae2-4a7e-9a46-5afbacda796e admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:08.497508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6be39-0ae2-4a7e-9a46-5afbacda796e admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:08.497508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6be39-0ae2-4a7e-9a46-5afbacda796e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:08.498212 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6be39-0ae2-4a7e-9a46-5afbacda796e admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:08.511932 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1112/2196] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:08.515974 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a06d0d-14b2-4ba9-b3c5-be7c48b0a477 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:08.542617 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a06d0d-14b2-4ba9-b3c5-be7c48b0a477 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:08.547892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238a52d-6bfa-4a0c-b005-1a6a514ada43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:08.549159 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238a52d-6bfa-4a0c-b005-1a6a514ada43 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:08.549711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238a52d-6bfa-4a0c-b005-1a6a514ada43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:08.550066 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238a52d-6bfa-4a0c-b005-1a6a514ada43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:08.550923 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238a52d-6bfa-4a0c-b005-1a6a514ada43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:08.554856 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238a52d-6bfa-4a0c-b005-1a6a514ada43 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:08.566671 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1085/2197] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:01:08.574621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6be39-0ae2-4a7e-9a46-5afbacda796e admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:08.598133 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6be39-0ae2-4a7e-9a46-5afbacda796e admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:08.610275 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13114cd1-e32f-4c3a-acbd-0904d9afddbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:08.610275 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13114cd1-e32f-4c3a-acbd-0904d9afddbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:08.610275 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13114cd1-e32f-4c3a-acbd-0904d9afddbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:08.610275 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13114cd1-e32f-4c3a-acbd-0904d9afddbb admin admin] PATH_INFO: `/v3/projects/be6acfba162d402a9a089d8edffdc28c/users/993113a815fe4ee38a8408a28c29b995/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:08.642972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13114cd1-e32f-4c3a-acbd-0904d9afddbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6acfba162d402a9a089d8edffdc28c, user_id=993113a815fe4ee38a8408a28c29b995, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:08.647276 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13114cd1-e32f-4c3a-acbd-0904d9afddbb admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:08.809406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1113/2198] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:08 2022] PUT /identity/v3/projects/be6acfba162d402a9a089d8edffdc28c/users/993113a815fe4ee38a8408a28c29b995/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:08.884963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c89c39-d2bc-4b0a-90ed-636c91fb98b4 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:08.885155 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c89c39-d2bc-4b0a-90ed-636c91fb98b4 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:08.885429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c89c39-d2bc-4b0a-90ed-636c91fb98b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:08.900216 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:08.923582 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-a2c89c39-d2bc-4b0a-90ed-636c91fb98b4 None None] MFA Rules not processed for user `993113a815fe4ee38a8408a28c29b995`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:08.925558 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a2c89c39-d2bc-4b0a-90ed-636c91fb98b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:09.032979 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1086/2199] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:01:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:12.456139 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13114cd1-e32f-4c3a-acbd-0904d9afddbb admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:12.458215 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-13114cd1-e32f-4c3a-acbd-0904d9afddbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:12.495829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:12.547350 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13114cd1-e32f-4c3a-acbd-0904d9afddbb admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:12.553580 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81eb71-2182-4eca-a0da-d92bc4b412c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:12.554362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81eb71-2182-4eca-a0da-d92bc4b412c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:12.554722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81eb71-2182-4eca-a0da-d92bc4b412c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:12.555124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81eb71-2182-4eca-a0da-d92bc4b412c3 admin admin] PATH_INFO: `/v3/users/5119115a782d41b2b473ad1738086021` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:12.556497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81eb71-2182-4eca-a0da-d92bc4b412c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5119115a782d41b2b473ad1738086021)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:12.558564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81eb71-2182-4eca-a0da-d92bc4b412c3 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:12.887835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-4e81eb71-2182-4eca-a0da-d92bc4b412c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5119115a782d41b2b473ad1738086021'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:12.909518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-4e81eb71-2182-4eca-a0da-d92bc4b412c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5119115a782d41b2b473ad1738086021'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:12.926272 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-4e81eb71-2182-4eca-a0da-d92bc4b412c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5119115a782d41b2b473ad1738086021'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:12.941253 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-4e81eb71-2182-4eca-a0da-d92bc4b412c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5119115a782d41b2b473ad1738086021'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:12.942590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-4e81eb71-2182-4eca-a0da-d92bc4b412c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5119115a782d41b2b473ad1738086021'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:13.018938 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1114/2200] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:01:12 2022] DELETE /identity/v3/users/5119115a782d41b2b473ad1738086021 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:13.025409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96c9b6-6919-4ec2-ba0b-f895807a695d None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:13.025963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96c9b6-6919-4ec2-ba0b-f895807a695d None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:13.025963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96c9b6-6919-4ec2-ba0b-f895807a695d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:13.026318 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81eb71-2182-4eca-a0da-d92bc4b412c3 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:13.027910 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-4e81eb71-2182-4eca-a0da-d92bc4b412c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:13.048995 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-0c96c9b6-6919-4ec2-ba0b-f895807a695d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:13.051039 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-0c96c9b6-6919-4ec2-ba0b-f895807a695d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:13.112252 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81eb71-2182-4eca-a0da-d92bc4b412c3 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:13.116792 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba3ca8-4d04-4cdb-91d0-7a2f461fb718 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b99f03a7c14a2e89384dcca532dc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:13.117577 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba3ca8-4d04-4cdb-91d0-7a2f461fb718 service glance] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:13.117984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba3ca8-4d04-4cdb-91d0-7a2f461fb718 service glance] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:13.120250 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba3ca8-4d04-4cdb-91d0-7a2f461fb718 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:13.122642 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-19ba3ca8-4d04-4cdb-91d0-7a2f461fb718 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:13.136154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1087/2201] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:13.149239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96c9b6-6919-4ec2-ba0b-f895807a695d None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:13.151178 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-0c96c9b6-6919-4ec2-ba0b-f895807a695d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:13.202713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba3ca8-4d04-4cdb-91d0-7a2f461fb718 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:13.207282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba3ca8-4d04-4cdb-91d0-7a2f461fb718 service glance] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:13.207945 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:13.213783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1115/2202] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:01:13.221280 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96c9b6-6919-4ec2-ba0b-f895807a695d None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:13.225081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9962d-1dd6-4414-853d-4399862feb51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:13.225778 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9962d-1dd6-4414-853d-4399862feb51 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:13.226025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9962d-1dd6-4414-853d-4399862feb51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:13.226308 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9962d-1dd6-4414-853d-4399862feb51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:13.236897 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9962d-1dd6-4414-853d-4399862feb51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:13.238455 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9962d-1dd6-4414-853d-4399862feb51 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:13.245366 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:13.250848 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1088/2203] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:13.271976 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a5806-883f-4144-9cb2-ad731c44da88 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:13.272256 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a5806-883f-4144-9cb2-ad731c44da88 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:13.272541 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a5806-883f-4144-9cb2-ad731c44da88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:13.294489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-8d5a5806-883f-4144-9cb2-ad731c44da88 None None] MFA Rules not processed for user `8ab708da71f04d2ab83f3f438a8d49d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:13.295908 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-8d5a5806-883f-4144-9cb2-ad731c44da88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:13.367362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1116/2204] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:01:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:01:14.223683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9962d-1dd6-4414-853d-4399862feb51 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:14.225514 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-2be9962d-1dd6-4414-853d-4399862feb51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:14.242104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9962d-1dd6-4414-853d-4399862feb51 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:14.247298 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40779f7-ae23-4089-bef0-c2db4ce47628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:14.248388 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40779f7-ae23-4089-bef0-c2db4ce47628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:14.248856 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40779f7-ae23-4089-bef0-c2db4ce47628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:14.249211 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40779f7-ae23-4089-bef0-c2db4ce47628 admin admin] PATH_INFO: `/v3/projects/945067284a4a49338989c4bd2452a144` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:14.259734 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40779f7-ae23-4089-bef0-c2db4ce47628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=945067284a4a49338989c4bd2452a144)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:14.261741 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40779f7-ae23-4089-bef0-c2db4ce47628 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:14.435187 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-d40779f7-ae23-4089-bef0-c2db4ce47628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '945067284a4a49338989c4bd2452a144', 'request_id': 'req-d40779f7-ae23-4089-bef0-c2db4ce47628'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:14.441950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-d40779f7-ae23-4089-bef0-c2db4ce47628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '945067284a4a49338989c4bd2452a144', 'request_id': 'req-d40779f7-ae23-4089-bef0-c2db4ce47628'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:14.524377 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-d40779f7-ae23-4089-bef0-c2db4ce47628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '945067284a4a49338989c4bd2452a144', 'request_id': 'req-d40779f7-ae23-4089-bef0-c2db4ce47628'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:14.536978 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-d40779f7-ae23-4089-bef0-c2db4ce47628 admin admin] The token cache is being invalidate because project 945067284a4a49338989c4bd2452a144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:01:14.537273 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-d40779f7-ae23-4089-bef0-c2db4ce47628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:14.537945 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-d40779f7-ae23-4089-bef0-c2db4ce47628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:14.539565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1089/2205] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:01:14 2022] DELETE /identity/v3/projects/945067284a4a49338989c4bd2452a144 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:14.543542 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a5806-883f-4144-9cb2-ad731c44da88 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:14.558139 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a5806-883f-4144-9cb2-ad731c44da88 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:14.624878 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db582d26-44e6-4472-bbe9-e09492833bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:14.625886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db582d26-44e6-4472-bbe9-e09492833bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:14.626272 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db582d26-44e6-4472-bbe9-e09492833bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:14.626610 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db582d26-44e6-4472-bbe9-e09492833bdf admin admin] PATH_INFO: `/v3/users/359043681f454c819b9969d913393715` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:14.627937 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db582d26-44e6-4472-bbe9-e09492833bdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=359043681f454c819b9969d913393715)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:14.630060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db582d26-44e6-4472-bbe9-e09492833bdf admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:14.837733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-db582d26-44e6-4472-bbe9-e09492833bdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '359043681f454c819b9969d913393715'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:14.851576 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-db582d26-44e6-4472-bbe9-e09492833bdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '359043681f454c819b9969d913393715'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:14.851576 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-db582d26-44e6-4472-bbe9-e09492833bdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '359043681f454c819b9969d913393715'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:14.875350 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-db582d26-44e6-4472-bbe9-e09492833bdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '359043681f454c819b9969d913393715'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:14.876126 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-db582d26-44e6-4472-bbe9-e09492833bdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '359043681f454c819b9969d913393715'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:14.952755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1117/2206] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:01:14 2022] DELETE /identity/v3/users/359043681f454c819b9969d913393715 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:15.412466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40779f7-ae23-4089-bef0-c2db4ce47628 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:15.414554 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-d40779f7-ae23-4089-bef0-c2db4ce47628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:15.429538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40779f7-ae23-4089-bef0-c2db4ce47628 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:15.501704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c2485-2896-4ee9-bd2a-a7d2d6db99e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:15.502352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c2485-2896-4ee9-bd2a-a7d2d6db99e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:15.502671 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c2485-2896-4ee9-bd2a-a7d2d6db99e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:15.503123 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c2485-2896-4ee9-bd2a-a7d2d6db99e4 admin admin] PATH_INFO: `/v3/projects/eb243a1558d24bf0bfd107e6b21beadd` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:15.504327 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c2485-2896-4ee9-bd2a-a7d2d6db99e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb243a1558d24bf0bfd107e6b21beadd)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:15.507074 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c2485-2896-4ee9-bd2a-a7d2d6db99e4 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:15.684274 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-779c2485-2896-4ee9-bd2a-a7d2d6db99e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb243a1558d24bf0bfd107e6b21beadd', 'request_id': 'req-779c2485-2896-4ee9-bd2a-a7d2d6db99e4'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:15.690485 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-779c2485-2896-4ee9-bd2a-a7d2d6db99e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb243a1558d24bf0bfd107e6b21beadd', 'request_id': 'req-779c2485-2896-4ee9-bd2a-a7d2d6db99e4'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:15.804551 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-779c2485-2896-4ee9-bd2a-a7d2d6db99e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb243a1558d24bf0bfd107e6b21beadd', 'request_id': 'req-779c2485-2896-4ee9-bd2a-a7d2d6db99e4'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:15.820193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-779c2485-2896-4ee9-bd2a-a7d2d6db99e4 admin admin] The token cache is being invalidate because project eb243a1558d24bf0bfd107e6b21beadd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:01:15.820496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-779c2485-2896-4ee9-bd2a-a7d2d6db99e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:15.821344 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-779c2485-2896-4ee9-bd2a-a7d2d6db99e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:15.826776 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1090/2207] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:01:15 2022] DELETE /identity/v3/projects/eb243a1558d24bf0bfd107e6b21beadd => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:15.831933 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc3d4a-9736-4109-8fbc-1fab64d0e00d None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:15.832419 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc3d4a-9736-4109-8fbc-1fab64d0e00d None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:15.832545 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc3d4a-9736-4109-8fbc-1fab64d0e00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:15.853087 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-11bc3d4a-9736-4109-8fbc-1fab64d0e00d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:15.854316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-11bc3d4a-9736-4109-8fbc-1fab64d0e00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:15.876195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:15.919596 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1118/2208] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:15.928491 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6ad84-cade-4bcd-900b-d44f7d52395b None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:15.928780 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6ad84-cade-4bcd-900b-d44f7d52395b None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:15.929076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6ad84-cade-4bcd-900b-d44f7d52395b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:15.948496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-15e6ad84-cade-4bcd-900b-d44f7d52395b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:15.949636 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-15e6ad84-cade-4bcd-900b-d44f7d52395b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:15.958618 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1091/2209] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:15.962988 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc3d4a-9736-4109-8fbc-1fab64d0e00d None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:15.972974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc3d4a-9736-4109-8fbc-1fab64d0e00d None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:15.978390 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d7f03-82bd-472c-8a6b-18f9d73bc280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:15.979036 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d7f03-82bd-472c-8a6b-18f9d73bc280 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:15.979319 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d7f03-82bd-472c-8a6b-18f9d73bc280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:15.979594 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d7f03-82bd-472c-8a6b-18f9d73bc280 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:15.980296 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d7f03-82bd-472c-8a6b-18f9d73bc280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:01:15.980603 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d7f03-82bd-472c-8a6b-18f9d73bc280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:15.982199 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d7f03-82bd-472c-8a6b-18f9d73bc280 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:15.996058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1119/2210] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:01:15.998756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6ad84-cade-4bcd-900b-d44f7d52395b None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:16.013242 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6ad84-cade-4bcd-900b-d44f7d52395b None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:16.018997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77709b-c44d-42e7-ab04-67d1a710ca36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:16.019711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77709b-c44d-42e7-ab04-67d1a710ca36 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.020703 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77709b-c44d-42e7-ab04-67d1a710ca36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.020989 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77709b-c44d-42e7-ab04-67d1a710ca36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.021690 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77709b-c44d-42e7-ab04-67d1a710ca36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:16.023615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77709b-c44d-42e7-ab04-67d1a710ca36 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:16.029162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:16.114455 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1092/2211] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:01:15 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:01:16.116113 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d7f03-82bd-472c-8a6b-18f9d73bc280 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:16.130465 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d7f03-82bd-472c-8a6b-18f9d73bc280 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:16.189698 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60654122-55a2-4b5b-9a21-cc1810cc9539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:16.190327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60654122-55a2-4b5b-9a21-cc1810cc9539 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.190615 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60654122-55a2-4b5b-9a21-cc1810cc9539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.190926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60654122-55a2-4b5b-9a21-cc1810cc9539 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.191596 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60654122-55a2-4b5b-9a21-cc1810cc9539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:16.193610 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60654122-55a2-4b5b-9a21-cc1810cc9539 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:16.258874 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1120/2212] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:01:16 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:01:16.259895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77709b-c44d-42e7-ab04-67d1a710ca36 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:16.277522 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77709b-c44d-42e7-ab04-67d1a710ca36 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:16.280536 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f79394-94c8-49e1-9dfb-bfe32f1dad5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:16.281685 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f79394-94c8-49e1-9dfb-bfe32f1dad5c admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.282389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f79394-94c8-49e1-9dfb-bfe32f1dad5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.282724 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f79394-94c8-49e1-9dfb-bfe32f1dad5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.283459 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f79394-94c8-49e1-9dfb-bfe32f1dad5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:16.285257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f79394-94c8-49e1-9dfb-bfe32f1dad5c admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:16.297331 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1093/2213] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:16.301569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60654122-55a2-4b5b-9a21-cc1810cc9539 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:16.311627 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60654122-55a2-4b5b-9a21-cc1810cc9539 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:16.316328 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236d27e-c933-4e82-ae3e-7e12d7c5600a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:16.317003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236d27e-c933-4e82-ae3e-7e12d7c5600a admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.317293 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236d27e-c933-4e82-ae3e-7e12d7c5600a admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.317572 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236d27e-c933-4e82-ae3e-7e12d7c5600a admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.318268 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236d27e-c933-4e82-ae3e-7e12d7c5600a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:16.320052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236d27e-c933-4e82-ae3e-7e12d7c5600a admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:16.330921 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1121/2214] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:16.335546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f79394-94c8-49e1-9dfb-bfe32f1dad5c admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:16.345683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f79394-94c8-49e1-9dfb-bfe32f1dad5c admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:16.350957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc839b6-e3a9-4b54-9cd5-4f2be41d7bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:16.351615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc839b6-e3a9-4b54-9cd5-4f2be41d7bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.351900 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc839b6-e3a9-4b54-9cd5-4f2be41d7bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.352180 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc839b6-e3a9-4b54-9cd5-4f2be41d7bd2 admin admin] PATH_INFO: `/v3/projects/20dc724e75c840cc9b479a8292ba79bb/users/b7a19da23ca549ce8106dc6295ae37ea/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.366928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc839b6-e3a9-4b54-9cd5-4f2be41d7bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20dc724e75c840cc9b479a8292ba79bb, user_id=b7a19da23ca549ce8106dc6295ae37ea, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:16.369596 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc839b6-e3a9-4b54-9cd5-4f2be41d7bd2 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:16.436311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1094/2215] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:16 2022] PUT /identity/v3/projects/20dc724e75c840cc9b479a8292ba79bb/users/b7a19da23ca549ce8106dc6295ae37ea/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:01:16.448248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26938717-5b5e-4d3d-a551-913bfdf33294 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.448541 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26938717-5b5e-4d3d-a551-913bfdf33294 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.448822 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26938717-5b5e-4d3d-a551-913bfdf33294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.481671 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-26938717-5b5e-4d3d-a551-913bfdf33294 None None] MFA Rules not processed for user `b7a19da23ca549ce8106dc6295ae37ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:16.482254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-26938717-5b5e-4d3d-a551-913bfdf33294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:16.555502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1122/2216] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:01:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:16.556890 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc839b6-e3a9-4b54-9cd5-4f2be41d7bd2 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:16.630230 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc839b6-e3a9-4b54-9cd5-4f2be41d7bd2 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:16.634977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5d6d9-5d80-4c08-838d-1fdf421f503b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:16.635598 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5d6d9-5d80-4c08-838d-1fdf421f503b admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.636712 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5d6d9-5d80-4c08-838d-1fdf421f503b admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.636712 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5d6d9-5d80-4c08-838d-1fdf421f503b admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.636899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5d6d9-5d80-4c08-838d-1fdf421f503b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:16.638709 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5d6d9-5d80-4c08-838d-1fdf421f503b admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:16.737343 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1095/2217] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:01:16 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:01:16.741810 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26938717-5b5e-4d3d-a551-913bfdf33294 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:16.752517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26938717-5b5e-4d3d-a551-913bfdf33294 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:16.765546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:16.814318 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1818c-109d-45b1-84e6-da1043764dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:16.814996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1818c-109d-45b1-84e6-da1043764dbd admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.815288 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1818c-109d-45b1-84e6-da1043764dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.815568 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1818c-109d-45b1-84e6-da1043764dbd admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.816293 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1818c-109d-45b1-84e6-da1043764dbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:16.818903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1818c-109d-45b1-84e6-da1043764dbd admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:16.873311 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1123/2218] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:01:16 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:01:16.877371 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5d6d9-5d80-4c08-838d-1fdf421f503b admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:16.888868 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5d6d9-5d80-4c08-838d-1fdf421f503b admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:16.894178 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da829861-9f64-4c94-ab94-407c0186b99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:16.894997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da829861-9f64-4c94-ab94-407c0186b99b admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.895344 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da829861-9f64-4c94-ab94-407c0186b99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.895691 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da829861-9f64-4c94-ab94-407c0186b99b admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.896499 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da829861-9f64-4c94-ab94-407c0186b99b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:16.898179 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da829861-9f64-4c94-ab94-407c0186b99b admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:16.913363 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1096/2219] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:16.914769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1818c-109d-45b1-84e6-da1043764dbd admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:16.924989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1818c-109d-45b1-84e6-da1043764dbd admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:16.930058 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a4a1f-3175-463e-bde6-fb77c3585fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:16.930725 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a4a1f-3175-463e-bde6-fb77c3585fdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.931054 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a4a1f-3175-463e-bde6-fb77c3585fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.931333 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a4a1f-3175-463e-bde6-fb77c3585fdf admin admin] PATH_INFO: `/v3/projects/57c84e91b679448aae0f64dc5a40b5d5/users/739d72d891864165a561d72aa1c6a672/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.948706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a4a1f-3175-463e-bde6-fb77c3585fdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c84e91b679448aae0f64dc5a40b5d5, user_id=739d72d891864165a561d72aa1c6a672, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:16.951449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a4a1f-3175-463e-bde6-fb77c3585fdf admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:17.061578 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1124/2220] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:16 2022] PUT /identity/v3/projects/57c84e91b679448aae0f64dc5a40b5d5/users/739d72d891864165a561d72aa1c6a672/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:17.065613 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da829861-9f64-4c94-ab94-407c0186b99b admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:17.077589 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da829861-9f64-4c94-ab94-407c0186b99b admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:17.144158 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125034a8-a8d7-44b3-968a-0b28f07fc024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:17.145100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125034a8-a8d7-44b3-968a-0b28f07fc024 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:17.145404 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125034a8-a8d7-44b3-968a-0b28f07fc024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:17.145681 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125034a8-a8d7-44b3-968a-0b28f07fc024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:17.146388 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125034a8-a8d7-44b3-968a-0b28f07fc024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:17.148029 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125034a8-a8d7-44b3-968a-0b28f07fc024 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:17.257301 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1097/2221] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:17.259145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a4a1f-3175-463e-bde6-fb77c3585fdf admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:17.259145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a4a1f-3175-463e-bde6-fb77c3585fdf admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:17.259145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0d607-67c3-4c96-854f-382c79d843b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:17.259145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0d607-67c3-4c96-854f-382c79d843b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:17.259493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0d607-67c3-4c96-854f-382c79d843b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:17.259493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0d607-67c3-4c96-854f-382c79d843b9 admin admin] PATH_INFO: `/v3/projects/57c84e91b679448aae0f64dc5a40b5d5/users/739d72d891864165a561d72aa1c6a672/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:17.259493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0d607-67c3-4c96-854f-382c79d843b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c84e91b679448aae0f64dc5a40b5d5, user_id=739d72d891864165a561d72aa1c6a672, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:17.259493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0d607-67c3-4c96-854f-382c79d843b9 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:17.259493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1125/2222] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:17 2022] PUT /identity/v3/projects/57c84e91b679448aae0f64dc5a40b5d5/users/739d72d891864165a561d72aa1c6a672/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:01:17.259819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd75fc-8ff6-4344-9214-2db81056f7a5 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:17.259819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd75fc-8ff6-4344-9214-2db81056f7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:17.259819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd75fc-8ff6-4344-9214-2db81056f7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:17.259819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-fbcd75fc-8ff6-4344-9214-2db81056f7a5 None None] MFA Rules not processed for user `739d72d891864165a561d72aa1c6a672`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:17.260255 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-fbcd75fc-8ff6-4344-9214-2db81056f7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:17.268934 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:17.355378 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1098/2223] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:01:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:17.370532 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0d607-67c3-4c96-854f-382c79d843b9 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:17.372309 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-4af0d607-67c3-4c96-854f-382c79d843b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:17.433837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0d607-67c3-4c96-854f-382c79d843b9 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:17.440519 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd78bf-f0c4-49ee-bc7b-70646988f193 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:17.440519 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd78bf-f0c4-49ee-bc7b-70646988f193 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:17.440519 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd78bf-f0c4-49ee-bc7b-70646988f193 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:17.440519 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd78bf-f0c4-49ee-bc7b-70646988f193 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:17.502623 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd78bf-f0c4-49ee-bc7b-70646988f193 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:17.504214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd78bf-f0c4-49ee-bc7b-70646988f193 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:17.513382 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1126/2224] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:19.324213 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec598efb-4dc9-43db-a2a9-d8ec4c0ce325 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:19.324715 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec598efb-4dc9-43db-a2a9-d8ec4c0ce325 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:19.324908 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec598efb-4dc9-43db-a2a9-d8ec4c0ce325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:19.350272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-ec598efb-4dc9-43db-a2a9-d8ec4c0ce325 None None] MFA Rules not processed for user `b9d70abf4f754530a3cf6efa7a782736`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:19.354190 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-ec598efb-4dc9-43db-a2a9-d8ec4c0ce325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:19.436928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1099/2225] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 3 13:01:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:19.438148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd78bf-f0c4-49ee-bc7b-70646988f193 service cinder] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:19.440272 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-96fd78bf-f0c4-49ee-bc7b-70646988f193 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:19.487044 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:19.527378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd78bf-f0c4-49ee-bc7b-70646988f193 service cinder] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:19.536890 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb85ac7-8359-42e1-a31f-7d67fe72bd76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5209ec838a4f45d6b746edb27970c93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:19.538021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb85ac7-8359-42e1-a31f-7d67fe72bd76 service swift] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:19.538600 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb85ac7-8359-42e1-a31f-7d67fe72bd76 service swift] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:19.539104 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb85ac7-8359-42e1-a31f-7d67fe72bd76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:19.550472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb85ac7-8359-42e1-a31f-7d67fe72bd76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:19.555445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb85ac7-8359-42e1-a31f-7d67fe72bd76 service swift] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:19.569044 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1127/2226] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 3 13:01:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 03 13:01:29.417031 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=50 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:29.575970 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=21 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:40.591265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec598efb-4dc9-43db-a2a9-d8ec4c0ce325 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:40.592771 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-ec598efb-4dc9-43db-a2a9-d8ec4c0ce325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:40.604882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec598efb-4dc9-43db-a2a9-d8ec4c0ce325 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:40.608721 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca261c-56c0-4531-83c3-6bc49675a7e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:40.613337 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca261c-56c0-4531-83c3-6bc49675a7e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:40.613337 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca261c-56c0-4531-83c3-6bc49675a7e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:40.613337 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca261c-56c0-4531-83c3-6bc49675a7e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:40.620618 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca261c-56c0-4531-83c3-6bc49675a7e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:40.622154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca261c-56c0-4531-83c3-6bc49675a7e2 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:40.632614 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1100/2227] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:50.628505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=6 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:12.558509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb85ac7-8359-42e1-a31f-7d67fe72bd76 service swift] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:12.560971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-3bb85ac7-8359-42e1-a31f-7d67fe72bd76 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:12.622946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb85ac7-8359-42e1-a31f-7d67fe72bd76 service swift] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:12.627995 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56bce7-4cae-4596-948f-89ae30611792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:12.628630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56bce7-4cae-4596-948f-89ae30611792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:12.628917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56bce7-4cae-4596-948f-89ae30611792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:12.629197 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56bce7-4cae-4596-948f-89ae30611792 admin admin] PATH_INFO: `/v3/users/38513e00dedf4e7b9829d4be70b2bcc1` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:12.630371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56bce7-4cae-4596-948f-89ae30611792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38513e00dedf4e7b9829d4be70b2bcc1)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:12.632323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56bce7-4cae-4596-948f-89ae30611792 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:12.871918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-ec56bce7-4cae-4596-948f-89ae30611792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38513e00dedf4e7b9829d4be70b2bcc1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:12.886843 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-ec56bce7-4cae-4596-948f-89ae30611792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38513e00dedf4e7b9829d4be70b2bcc1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:12.887731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-ec56bce7-4cae-4596-948f-89ae30611792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38513e00dedf4e7b9829d4be70b2bcc1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:12.902824 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-ec56bce7-4cae-4596-948f-89ae30611792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38513e00dedf4e7b9829d4be70b2bcc1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:12.903651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-ec56bce7-4cae-4596-948f-89ae30611792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38513e00dedf4e7b9829d4be70b2bcc1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:13.005718 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1128/2228] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:02:12 2022] DELETE /identity/v3/users/38513e00dedf4e7b9829d4be70b2bcc1 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:13.010217 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e08a5f-b4a9-48c2-b313-c9c869f3973d None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:13.010686 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e08a5f-b4a9-48c2-b313-c9c869f3973d None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:13.010821 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e08a5f-b4a9-48c2-b313-c9c869f3973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:13.029694 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-85e08a5f-b4a9-48c2-b313-c9c869f3973d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:13.031193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-85e08a5f-b4a9-48c2-b313-c9c869f3973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:13.100150 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1101/2229] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:13.114091 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56bce7-4cae-4596-948f-89ae30611792 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:13.115609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ec56bce7-4cae-4596-948f-89ae30611792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:13.176220 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56bce7-4cae-4596-948f-89ae30611792 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:13.180016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef92a4-fb8b-4a22-810b-7956db6f5c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:13.180630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef92a4-fb8b-4a22-810b-7956db6f5c8f service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:13.180911 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef92a4-fb8b-4a22-810b-7956db6f5c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:13.181183 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef92a4-fb8b-4a22-810b-7956db6f5c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:13.189920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef92a4-fb8b-4a22-810b-7956db6f5c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:13.192015 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef92a4-fb8b-4a22-810b-7956db6f5c8f service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:13.201310 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1129/2230] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:13.736017 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e08a5f-b4a9-48c2-b313-c9c869f3973d None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:13.737578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-85e08a5f-b4a9-48c2-b313-c9c869f3973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:13.765131 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e08a5f-b4a9-48c2-b313-c9c869f3973d None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:13.772476 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be260b4-228a-4394-b328-09d6b115421f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:13.773073 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be260b4-228a-4394-b328-09d6b115421f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:13.773360 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be260b4-228a-4394-b328-09d6b115421f admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:13.773655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be260b4-228a-4394-b328-09d6b115421f admin admin] PATH_INFO: `/v3/projects/b0abbfb4c0ba40969f865fc573288b92` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:13.774960 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be260b4-228a-4394-b328-09d6b115421f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0abbfb4c0ba40969f865fc573288b92)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:13.777050 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be260b4-228a-4394-b328-09d6b115421f admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:13.899507 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2be260b4-228a-4394-b328-09d6b115421f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0abbfb4c0ba40969f865fc573288b92', 'request_id': 'req-2be260b4-228a-4394-b328-09d6b115421f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:13.906188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2be260b4-228a-4394-b328-09d6b115421f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0abbfb4c0ba40969f865fc573288b92', 'request_id': 'req-2be260b4-228a-4394-b328-09d6b115421f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:14.008256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2be260b4-228a-4394-b328-09d6b115421f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0abbfb4c0ba40969f865fc573288b92', 'request_id': 'req-2be260b4-228a-4394-b328-09d6b115421f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:14.020088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2be260b4-228a-4394-b328-09d6b115421f admin admin] The token cache is being invalidate because project b0abbfb4c0ba40969f865fc573288b92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:02:14.020688 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2be260b4-228a-4394-b328-09d6b115421f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:14.021178 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2be260b4-228a-4394-b328-09d6b115421f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:14.022815 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1102/2231] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:02:13 2022] DELETE /identity/v3/projects/b0abbfb4c0ba40969f865fc573288b92 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:14.027868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5041720-1c1e-48b1-a547-01881cef6c7c None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:14.028285 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5041720-1c1e-48b1-a547-01881cef6c7c None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:14.029361 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5041720-1c1e-48b1-a547-01881cef6c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:14.050135 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-f5041720-1c1e-48b1-a547-01881cef6c7c None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:14.054823 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-f5041720-1c1e-48b1-a547-01881cef6c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:14.069898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:14.112639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1130/2232] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:14.121833 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726c7ed-4262-4857-ace9-8543f8d8e2b9 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:14.122463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726c7ed-4262-4857-ace9-8543f8d8e2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:14.122752 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726c7ed-4262-4857-ace9-8543f8d8e2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:14.143987 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-b726c7ed-4262-4857-ace9-8543f8d8e2b9 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:14.145196 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b726c7ed-4262-4857-ace9-8543f8d8e2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:14.153821 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1103/2233] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:14.158465 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5041720-1c1e-48b1-a547-01881cef6c7c None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:14.168660 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5041720-1c1e-48b1-a547-01881cef6c7c None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:14.173240 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ea1f1-40f5-44c9-9189-d9b2daa81e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:14.173845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ea1f1-40f5-44c9-9189-d9b2daa81e66 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:14.174127 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ea1f1-40f5-44c9-9189-d9b2daa81e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:14.175014 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ea1f1-40f5-44c9-9189-d9b2daa81e66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:14.175773 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ea1f1-40f5-44c9-9189-d9b2daa81e66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:02:14.176080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ea1f1-40f5-44c9-9189-d9b2daa81e66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:14.180964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ea1f1-40f5-44c9-9189-d9b2daa81e66 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:14.189253 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1131/2234] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:02:14.193452 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726c7ed-4262-4857-ace9-8543f8d8e2b9 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:14.202709 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726c7ed-4262-4857-ace9-8543f8d8e2b9 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:14.207406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0287aa-e681-4ab4-bd4c-44f26068b60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:14.208010 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0287aa-e681-4ab4-bd4c-44f26068b60a admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:14.208292 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0287aa-e681-4ab4-bd4c-44f26068b60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:14.208570 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0287aa-e681-4ab4-bd4c-44f26068b60a admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:14.209246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0287aa-e681-4ab4-bd4c-44f26068b60a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:14.211202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0287aa-e681-4ab4-bd4c-44f26068b60a admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:14.315719 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1104/2235] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:02:14 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:02:14.319922 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ea1f1-40f5-44c9-9189-d9b2daa81e66 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:14.329839 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ea1f1-40f5-44c9-9189-d9b2daa81e66 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:14.387449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52561bb9-1ee2-467e-b8f3-17e9de888c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:14.388062 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52561bb9-1ee2-467e-b8f3-17e9de888c9e admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:14.388344 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52561bb9-1ee2-467e-b8f3-17e9de888c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:14.388617 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52561bb9-1ee2-467e-b8f3-17e9de888c9e admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:14.389285 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52561bb9-1ee2-467e-b8f3-17e9de888c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:14.391317 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52561bb9-1ee2-467e-b8f3-17e9de888c9e admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:14.470125 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1132/2236] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:02:14 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:02:14.473627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0287aa-e681-4ab4-bd4c-44f26068b60a admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:14.484602 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0287aa-e681-4ab4-bd4c-44f26068b60a admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:14.495051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747a928-541a-4da6-92b6-868e231e6c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:14.495051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747a928-541a-4da6-92b6-868e231e6c9a admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:14.495051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747a928-541a-4da6-92b6-868e231e6c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:14.495051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747a928-541a-4da6-92b6-868e231e6c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:14.496008 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747a928-541a-4da6-92b6-868e231e6c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:14.496008 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747a928-541a-4da6-92b6-868e231e6c9a admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:14.504877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1105/2237] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:02:14.509154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52561bb9-1ee2-467e-b8f3-17e9de888c9e admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:14.520371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52561bb9-1ee2-467e-b8f3-17e9de888c9e admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:14.525043 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eced9eb-d63d-48e4-8c20-2a89c0264f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:14.525656 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eced9eb-d63d-48e4-8c20-2a89c0264f4e admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:14.526070 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eced9eb-d63d-48e4-8c20-2a89c0264f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:14.526463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eced9eb-d63d-48e4-8c20-2a89c0264f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:14.527221 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eced9eb-d63d-48e4-8c20-2a89c0264f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:14.528807 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eced9eb-d63d-48e4-8c20-2a89c0264f4e admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:14.540349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1133/2238] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:14.544825 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747a928-541a-4da6-92b6-868e231e6c9a admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:14.554927 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747a928-541a-4da6-92b6-868e231e6c9a admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:14.559575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb9e73-3176-463b-9fd6-61db23f3df57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:14.560228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb9e73-3176-463b-9fd6-61db23f3df57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:14.560514 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb9e73-3176-463b-9fd6-61db23f3df57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:14.560791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb9e73-3176-463b-9fd6-61db23f3df57 admin admin] PATH_INFO: `/v3/projects/a237b4e912e748c09eb3f9eeaf261d13/users/062fa418f14c4044a09448fe1437cebd/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:14.575835 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb9e73-3176-463b-9fd6-61db23f3df57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a237b4e912e748c09eb3f9eeaf261d13, user_id=062fa418f14c4044a09448fe1437cebd, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:14.578698 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb9e73-3176-463b-9fd6-61db23f3df57 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:14.650760 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1106/2239] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:02:14 2022] PUT /identity/v3/projects/a237b4e912e748c09eb3f9eeaf261d13/users/062fa418f14c4044a09448fe1437cebd/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:14.662029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b07b87-cf22-4266-9d4c-1e5911ae82f5 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:14.662407 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b07b87-cf22-4266-9d4c-1e5911ae82f5 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:14.662689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b07b87-cf22-4266-9d4c-1e5911ae82f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:14.689854 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-c8b07b87-cf22-4266-9d4c-1e5911ae82f5 None None] MFA Rules not processed for user `062fa418f14c4044a09448fe1437cebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:14.691133 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-c8b07b87-cf22-4266-9d4c-1e5911ae82f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:14.763878 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1134/2240] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:02:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:02:14.775725 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb9e73-3176-463b-9fd6-61db23f3df57 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:14.777466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-d3eb9e73-3176-463b-9fd6-61db23f3df57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:14.800815 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:14.840254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb9e73-3176-463b-9fd6-61db23f3df57 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:14.847834 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393f4f7-6857-4200-8db1-f370167421d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b99f03a7c14a2e89384dcca532dc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:14.847834 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393f4f7-6857-4200-8db1-f370167421d3 service glance] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:14.847834 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393f4f7-6857-4200-8db1-f370167421d3 service glance] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:14.847834 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393f4f7-6857-4200-8db1-f370167421d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:14.856389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393f4f7-6857-4200-8db1-f370167421d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:14.857955 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393f4f7-6857-4200-8db1-f370167421d3 service glance] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:14.867593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1107/2241] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:24.760695 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:24.896779 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=17 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:32.981499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b07b87-cf22-4266-9d4c-1e5911ae82f5 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:32.982953 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-c8b07b87-cf22-4266-9d4c-1e5911ae82f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:33.061794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b07b87-cf22-4266-9d4c-1e5911ae82f5 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:33.066929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ae4e4-b583-4c3e-a61a-00f0e2ebc7e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de27d25fad634658a1abcb776d9a7b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:33.067559 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ae4e4-b583-4c3e-a61a-00f0e2ebc7e2 service placement] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:33.067847 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ae4e4-b583-4c3e-a61a-00f0e2ebc7e2 service placement] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:33.068126 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ae4e4-b583-4c3e-a61a-00f0e2ebc7e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:33.070309 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-7c7ae4e4-b583-4c3e-a61a-00f0e2ebc7e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:33.083117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ae4e4-b583-4c3e-a61a-00f0e2ebc7e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:33.084697 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ae4e4-b583-4c3e-a61a-00f0e2ebc7e2 service placement] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:33.094653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1135/2242] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:33.622602 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187f077-d3ae-4162-bf06-a178e1a4e762 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:33.622602 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187f077-d3ae-4162-bf06-a178e1a4e762 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:33.622602 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187f077-d3ae-4162-bf06-a178e1a4e762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:33.644031 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-e187f077-d3ae-4162-bf06-a178e1a4e762 None None] MFA Rules not processed for user `79fd9e0292fb4ebab755519ecc20235e`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:33.645654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e187f077-d3ae-4162-bf06-a178e1a4e762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:33.850409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1108/2243] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:02:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:34.850766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ae4e4-b583-4c3e-a61a-00f0e2ebc7e2 service placement] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:34.852777 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-7c7ae4e4-b583-4c3e-a61a-00f0e2ebc7e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:34.932887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ae4e4-b583-4c3e-a61a-00f0e2ebc7e2 service placement] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:34.937416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc6c19-79d9-4fc4-9da0-2529978ce5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:34.938062 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc6c19-79d9-4fc4-9da0-2529978ce5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:34.938350 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc6c19-79d9-4fc4-9da0-2529978ce5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:34.938631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc6c19-79d9-4fc4-9da0-2529978ce5c0 admin admin] PATH_INFO: `/v3/users/b7a19da23ca549ce8106dc6295ae37ea` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:34.939844 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc6c19-79d9-4fc4-9da0-2529978ce5c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7a19da23ca549ce8106dc6295ae37ea)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:34.941785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc6c19-79d9-4fc4-9da0-2529978ce5c0 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:35.190835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-55bc6c19-79d9-4fc4-9da0-2529978ce5c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7a19da23ca549ce8106dc6295ae37ea'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:35.198494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-55bc6c19-79d9-4fc4-9da0-2529978ce5c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7a19da23ca549ce8106dc6295ae37ea'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:35.199224 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-55bc6c19-79d9-4fc4-9da0-2529978ce5c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7a19da23ca549ce8106dc6295ae37ea'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:35.214930 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-55bc6c19-79d9-4fc4-9da0-2529978ce5c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7a19da23ca549ce8106dc6295ae37ea'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:35.215678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-55bc6c19-79d9-4fc4-9da0-2529978ce5c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7a19da23ca549ce8106dc6295ae37ea'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:35.324426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1136/2244] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:02:34 2022] DELETE /identity/v3/users/b7a19da23ca549ce8106dc6295ae37ea => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:35.329517 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcaef3-1601-4573-8c4c-ceec065ff5e4 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:35.330240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcaef3-1601-4573-8c4c-ceec065ff5e4 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:35.330475 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcaef3-1601-4573-8c4c-ceec065ff5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:35.350184 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-a2bcaef3-1601-4573-8c4c-ceec065ff5e4 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:35.351441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a2bcaef3-1601-4573-8c4c-ceec065ff5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:35.411394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1109/2245] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:35.421080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc6c19-79d9-4fc4-9da0-2529978ce5c0 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:35.422523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-55bc6c19-79d9-4fc4-9da0-2529978ce5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:35.434032 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:35.482069 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc6c19-79d9-4fc4-9da0-2529978ce5c0 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:35.486118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd2e25-7728-480c-a7dd-2dc75a9e8370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:35.486785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd2e25-7728-480c-a7dd-2dc75a9e8370 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:35.487108 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd2e25-7728-480c-a7dd-2dc75a9e8370 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:35.487392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd2e25-7728-480c-a7dd-2dc75a9e8370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:35.496453 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd2e25-7728-480c-a7dd-2dc75a9e8370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:35.500534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd2e25-7728-480c-a7dd-2dc75a9e8370 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:35.507765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1137/2246] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:35.952266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcaef3-1601-4573-8c4c-ceec065ff5e4 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:35.954002 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a2bcaef3-1601-4573-8c4c-ceec065ff5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:35.973449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcaef3-1601-4573-8c4c-ceec065ff5e4 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:35.986997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44bda0-84fe-41f0-b1bb-512551555a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:35.986997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44bda0-84fe-41f0-b1bb-512551555a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:35.986997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44bda0-84fe-41f0-b1bb-512551555a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:35.986997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44bda0-84fe-41f0-b1bb-512551555a77 admin admin] PATH_INFO: `/v3/projects/20dc724e75c840cc9b479a8292ba79bb` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:35.987367 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44bda0-84fe-41f0-b1bb-512551555a77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20dc724e75c840cc9b479a8292ba79bb)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:35.987367 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44bda0-84fe-41f0-b1bb-512551555a77 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:36.094040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-3f44bda0-84fe-41f0-b1bb-512551555a77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20dc724e75c840cc9b479a8292ba79bb', 'request_id': 'req-3f44bda0-84fe-41f0-b1bb-512551555a77'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:36.102201 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-3f44bda0-84fe-41f0-b1bb-512551555a77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20dc724e75c840cc9b479a8292ba79bb', 'request_id': 'req-3f44bda0-84fe-41f0-b1bb-512551555a77'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:36.167098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-3f44bda0-84fe-41f0-b1bb-512551555a77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20dc724e75c840cc9b479a8292ba79bb', 'request_id': 'req-3f44bda0-84fe-41f0-b1bb-512551555a77'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:36.178403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-3f44bda0-84fe-41f0-b1bb-512551555a77 admin admin] The token cache is being invalidate because project 20dc724e75c840cc9b479a8292ba79bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:02:36.178695 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-3f44bda0-84fe-41f0-b1bb-512551555a77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:36.179419 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-3f44bda0-84fe-41f0-b1bb-512551555a77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:36.181166 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1110/2247] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:02:35 2022] DELETE /identity/v3/projects/20dc724e75c840cc9b479a8292ba79bb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:36.185391 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd2e25-7728-480c-a7dd-2dc75a9e8370 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:36.195647 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd2e25-7728-480c-a7dd-2dc75a9e8370 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:36.274519 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312cf05-a87e-4ed2-9ede-2b70b8f4654d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:36.275229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312cf05-a87e-4ed2-9ede-2b70b8f4654d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:36.275724 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312cf05-a87e-4ed2-9ede-2b70b8f4654d admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:36.276009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312cf05-a87e-4ed2-9ede-2b70b8f4654d admin admin] PATH_INFO: `/v3/users/739d72d891864165a561d72aa1c6a672` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:36.277318 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312cf05-a87e-4ed2-9ede-2b70b8f4654d admin admin] RBAC: Authorizing `identity:delete_user(user_id=739d72d891864165a561d72aa1c6a672)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:36.279542 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312cf05-a87e-4ed2-9ede-2b70b8f4654d admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:36.536206 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-1312cf05-a87e-4ed2-9ede-2b70b8f4654d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '739d72d891864165a561d72aa1c6a672'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:36.544723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-1312cf05-a87e-4ed2-9ede-2b70b8f4654d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '739d72d891864165a561d72aa1c6a672'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:36.545453 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-1312cf05-a87e-4ed2-9ede-2b70b8f4654d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '739d72d891864165a561d72aa1c6a672'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:36.558487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-1312cf05-a87e-4ed2-9ede-2b70b8f4654d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '739d72d891864165a561d72aa1c6a672'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:36.559189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-1312cf05-a87e-4ed2-9ede-2b70b8f4654d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '739d72d891864165a561d72aa1c6a672'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:36.644985 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1138/2248] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:02:36 2022] DELETE /identity/v3/users/739d72d891864165a561d72aa1c6a672 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:37.052887 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44bda0-84fe-41f0-b1bb-512551555a77 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:37.055309 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3f44bda0-84fe-41f0-b1bb-512551555a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:37.069108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44bda0-84fe-41f0-b1bb-512551555a77 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:37.102712 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:37.138561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7dc97-fee9-44f4-b6b9-99f581fba9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:37.146798 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7dc97-fee9-44f4-b6b9-99f581fba9db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:37.147170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7dc97-fee9-44f4-b6b9-99f581fba9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:37.149528 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7dc97-fee9-44f4-b6b9-99f581fba9db admin admin] PATH_INFO: `/v3/projects/57c84e91b679448aae0f64dc5a40b5d5` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:37.151070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7dc97-fee9-44f4-b6b9-99f581fba9db admin admin] RBAC: Authorizing `identity:delete_project(project_id=57c84e91b679448aae0f64dc5a40b5d5)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:37.153002 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7dc97-fee9-44f4-b6b9-99f581fba9db admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:37.301469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-65e7dc97-fee9-44f4-b6b9-99f581fba9db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57c84e91b679448aae0f64dc5a40b5d5', 'request_id': 'req-65e7dc97-fee9-44f4-b6b9-99f581fba9db'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:37.310269 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-65e7dc97-fee9-44f4-b6b9-99f581fba9db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57c84e91b679448aae0f64dc5a40b5d5', 'request_id': 'req-65e7dc97-fee9-44f4-b6b9-99f581fba9db'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:37.376802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-65e7dc97-fee9-44f4-b6b9-99f581fba9db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57c84e91b679448aae0f64dc5a40b5d5', 'request_id': 'req-65e7dc97-fee9-44f4-b6b9-99f581fba9db'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:37.391775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-65e7dc97-fee9-44f4-b6b9-99f581fba9db admin admin] The token cache is being invalidate because project 57c84e91b679448aae0f64dc5a40b5d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:02:37.392345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-65e7dc97-fee9-44f4-b6b9-99f581fba9db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:37.393542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-65e7dc97-fee9-44f4-b6b9-99f581fba9db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:37.395986 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1111/2249] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:02:37 2022] DELETE /identity/v3/projects/57c84e91b679448aae0f64dc5a40b5d5 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:37.401808 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e2e48-4f6c-493f-ba27-f9acbd5ad9ca None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:37.402287 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e2e48-4f6c-493f-ba27-f9acbd5ad9ca None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:37.402580 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e2e48-4f6c-493f-ba27-f9acbd5ad9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:37.435354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-091e2e48-4f6c-493f-ba27-f9acbd5ad9ca None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:37.436652 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-091e2e48-4f6c-493f-ba27-f9acbd5ad9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:37.465101 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:37.503021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1139/2250] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:37.511886 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951920eb-0bbb-40ad-bc3a-1f68d1210ebb None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:37.515200 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951920eb-0bbb-40ad-bc3a-1f68d1210ebb None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:37.515505 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951920eb-0bbb-40ad-bc3a-1f68d1210ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:37.540012 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-951920eb-0bbb-40ad-bc3a-1f68d1210ebb None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:37.541951 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-951920eb-0bbb-40ad-bc3a-1f68d1210ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:37.551462 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1112/2251] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:37.555752 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e2e48-4f6c-493f-ba27-f9acbd5ad9ca None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:37.566321 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e2e48-4f6c-493f-ba27-f9acbd5ad9ca None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:37.571153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1718c2-4d9e-4916-8643-acc626103413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:37.571881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1718c2-4d9e-4916-8643-acc626103413 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:37.572278 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1718c2-4d9e-4916-8643-acc626103413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:37.572657 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1718c2-4d9e-4916-8643-acc626103413 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:37.573684 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1718c2-4d9e-4916-8643-acc626103413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:02:37.573824 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1718c2-4d9e-4916-8643-acc626103413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:37.575556 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1718c2-4d9e-4916-8643-acc626103413 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:37.594830 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1140/2252] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:02:37.594949 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951920eb-0bbb-40ad-bc3a-1f68d1210ebb None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:37.604496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951920eb-0bbb-40ad-bc3a-1f68d1210ebb None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:37.635397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3374962-03c9-4b3b-b8a5-2e93ebc22b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:37.636454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3374962-03c9-4b3b-b8a5-2e93ebc22b26 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:37.636740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3374962-03c9-4b3b-b8a5-2e93ebc22b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:37.637019 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3374962-03c9-4b3b-b8a5-2e93ebc22b26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:37.637704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3374962-03c9-4b3b-b8a5-2e93ebc22b26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:37.639725 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3374962-03c9-4b3b-b8a5-2e93ebc22b26 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:37.722030 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1113/2253] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:02:37 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:02:37.723322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1718c2-4d9e-4916-8643-acc626103413 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:37.733900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1718c2-4d9e-4916-8643-acc626103413 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:37.793960 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad541dc-149d-4b9d-b58c-12cc40c063ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:37.794580 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad541dc-149d-4b9d-b58c-12cc40c063ee admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:37.794893 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad541dc-149d-4b9d-b58c-12cc40c063ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:37.795190 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad541dc-149d-4b9d-b58c-12cc40c063ee admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:37.795848 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad541dc-149d-4b9d-b58c-12cc40c063ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:37.797747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad541dc-149d-4b9d-b58c-12cc40c063ee admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:37.913244 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1141/2254] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:02:37 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:02:37.917884 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3374962-03c9-4b3b-b8a5-2e93ebc22b26 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:37.928856 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3374962-03c9-4b3b-b8a5-2e93ebc22b26 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:37.933465 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99a2a4-3775-47bb-8816-e838d129278e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:37.934090 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99a2a4-3775-47bb-8816-e838d129278e admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:37.934371 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99a2a4-3775-47bb-8816-e838d129278e admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:37.934794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99a2a4-3775-47bb-8816-e838d129278e admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:37.935663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99a2a4-3775-47bb-8816-e838d129278e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:37.937885 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99a2a4-3775-47bb-8816-e838d129278e admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:37.948410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1114/2255] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:37.952550 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad541dc-149d-4b9d-b58c-12cc40c063ee admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:37.963341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad541dc-149d-4b9d-b58c-12cc40c063ee admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:37.968162 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb76b67-8354-47ec-a48d-dc219ebac277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:37.969526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb76b67-8354-47ec-a48d-dc219ebac277 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:37.969526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb76b67-8354-47ec-a48d-dc219ebac277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:37.969526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb76b67-8354-47ec-a48d-dc219ebac277 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:37.970056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb76b67-8354-47ec-a48d-dc219ebac277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:37.971676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb76b67-8354-47ec-a48d-dc219ebac277 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:37.984936 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1142/2256] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:02:37.986199 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99a2a4-3775-47bb-8816-e838d129278e admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:37.996797 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99a2a4-3775-47bb-8816-e838d129278e admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:38.001537 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7268f-1c5d-4aaf-9ea4-92467bea271e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:38.002317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7268f-1c5d-4aaf-9ea4-92467bea271e admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:38.002498 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7268f-1c5d-4aaf-9ea4-92467bea271e admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:38.002800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7268f-1c5d-4aaf-9ea4-92467bea271e admin admin] PATH_INFO: `/v3/projects/e271022dfd8a4d1f8af5ceec46a5c4ae/users/fc8aad3fd65a4b85ae38906a3a58a102/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:38.020192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7268f-1c5d-4aaf-9ea4-92467bea271e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e271022dfd8a4d1f8af5ceec46a5c4ae, user_id=fc8aad3fd65a4b85ae38906a3a58a102, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:38.022924 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7268f-1c5d-4aaf-9ea4-92467bea271e admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:38.114081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1115/2257] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:02:37 2022] PUT /identity/v3/projects/e271022dfd8a4d1f8af5ceec46a5c4ae/users/fc8aad3fd65a4b85ae38906a3a58a102/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:38.124394 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f366c7-7c05-4ff9-9d50-7151dc3ee2da None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:38.124687 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f366c7-7c05-4ff9-9d50-7151dc3ee2da None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:38.124967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f366c7-7c05-4ff9-9d50-7151dc3ee2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:38.173289 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-66f366c7-7c05-4ff9-9d50-7151dc3ee2da None None] MFA Rules not processed for user `fc8aad3fd65a4b85ae38906a3a58a102`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:38.175189 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-66f366c7-7c05-4ff9-9d50-7151dc3ee2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:38.263342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1143/2258] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:02:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:38.267542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7268f-1c5d-4aaf-9ea4-92467bea271e admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:38.347018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:38.353314 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7268f-1c5d-4aaf-9ea4-92467bea271e admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:38.359153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01623e3-9696-4a83-acd3-f1a5c7e8caa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:38.361219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01623e3-9696-4a83-acd3-f1a5c7e8caa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:38.361219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01623e3-9696-4a83-acd3-f1a5c7e8caa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:38.361219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01623e3-9696-4a83-acd3-f1a5c7e8caa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:38.361219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01623e3-9696-4a83-acd3-f1a5c7e8caa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:38.363009 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01623e3-9696-4a83-acd3-f1a5c7e8caa9 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:38.483752 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1116/2259] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:02:38 2022] POST /identity/v3/projects => generated 387 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:02:38.487918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f366c7-7c05-4ff9-9d50-7151dc3ee2da None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:38.499356 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f366c7-7c05-4ff9-9d50-7151dc3ee2da None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:38.527617 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:38.564195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586da44-ff17-4bb0-a47c-877a2b21c314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:38.564806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586da44-ff17-4bb0-a47c-877a2b21c314 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:38.565116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586da44-ff17-4bb0-a47c-877a2b21c314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:38.565393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586da44-ff17-4bb0-a47c-877a2b21c314 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:38.566186 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586da44-ff17-4bb0-a47c-877a2b21c314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:38.568151 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586da44-ff17-4bb0-a47c-877a2b21c314 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:38.664817 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1144/2260] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:02:38 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:02:38.669425 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01623e3-9696-4a83-acd3-f1a5c7e8caa9 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:38.680987 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01623e3-9696-4a83-acd3-f1a5c7e8caa9 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:38.685879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f7f79-8aaa-480a-959c-916bb9e69848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:38.686476 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f7f79-8aaa-480a-959c-916bb9e69848 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:38.686791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f7f79-8aaa-480a-959c-916bb9e69848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:38.687077 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f7f79-8aaa-480a-959c-916bb9e69848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:38.694611 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f7f79-8aaa-480a-959c-916bb9e69848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:38.694611 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f7f79-8aaa-480a-959c-916bb9e69848 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:38.701230 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1117/2261] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:38.705214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586da44-ff17-4bb0-a47c-877a2b21c314 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:38.716617 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586da44-ff17-4bb0-a47c-877a2b21c314 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:38.721473 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fc5f5-72aa-4148-8048-8a21a12daf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:38.729144 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fc5f5-72aa-4148-8048-8a21a12daf5f admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:38.729144 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fc5f5-72aa-4148-8048-8a21a12daf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:38.729144 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fc5f5-72aa-4148-8048-8a21a12daf5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:38.729144 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fc5f5-72aa-4148-8048-8a21a12daf5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:38.729144 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fc5f5-72aa-4148-8048-8a21a12daf5f admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:38.735837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1145/2262] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:02:38.740744 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f7f79-8aaa-480a-959c-916bb9e69848 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:38.750526 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f7f79-8aaa-480a-959c-916bb9e69848 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:38.756081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abe56d-1aa9-4b6f-a1eb-eb83999f4381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:38.756902 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abe56d-1aa9-4b6f-a1eb-eb83999f4381 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:38.757286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abe56d-1aa9-4b6f-a1eb-eb83999f4381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:38.757707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abe56d-1aa9-4b6f-a1eb-eb83999f4381 admin admin] PATH_INFO: `/v3/projects/6d8f84940d924990ba3dbfc92bd1d857/users/22fbb1e9cce24f918ad6eb8838b53f0f/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:38.775099 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abe56d-1aa9-4b6f-a1eb-eb83999f4381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8f84940d924990ba3dbfc92bd1d857, user_id=22fbb1e9cce24f918ad6eb8838b53f0f, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:38.777840 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abe56d-1aa9-4b6f-a1eb-eb83999f4381 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:38.848501 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1118/2263] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:02:38 2022] PUT /identity/v3/projects/6d8f84940d924990ba3dbfc92bd1d857/users/22fbb1e9cce24f918ad6eb8838b53f0f/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:38.859696 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791fa59-481f-4086-bf62-fa5e4dfbadde None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:38.859988 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791fa59-481f-4086-bf62-fa5e4dfbadde None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:38.860296 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791fa59-481f-4086-bf62-fa5e4dfbadde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:38.888501 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-b791fa59-481f-4086-bf62-fa5e4dfbadde None None] MFA Rules not processed for user `22fbb1e9cce24f918ad6eb8838b53f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:38.889745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b791fa59-481f-4086-bf62-fa5e4dfbadde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:38.960202 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1146/2264] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:02:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:38.965148 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abe56d-1aa9-4b6f-a1eb-eb83999f4381 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:39.031037 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abe56d-1aa9-4b6f-a1eb-eb83999f4381 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:39.035879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882d3c7-902f-4348-9bc7-57a9d92b6526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:39.036500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882d3c7-902f-4348-9bc7-57a9d92b6526 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:39.036869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882d3c7-902f-4348-9bc7-57a9d92b6526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:39.037152 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882d3c7-902f-4348-9bc7-57a9d92b6526 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:39.037823 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882d3c7-902f-4348-9bc7-57a9d92b6526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:39.039807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882d3c7-902f-4348-9bc7-57a9d92b6526 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:39.155897 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1119/2265] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:02:38 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:02:39.159972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791fa59-481f-4086-bf62-fa5e4dfbadde None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:39.171529 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791fa59-481f-4086-bf62-fa5e4dfbadde None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:39.235731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a28f07-fc35-4113-838f-599065ed8914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:39.236753 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a28f07-fc35-4113-838f-599065ed8914 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:39.237047 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a28f07-fc35-4113-838f-599065ed8914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:39.237332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a28f07-fc35-4113-838f-599065ed8914 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:39.238190 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a28f07-fc35-4113-838f-599065ed8914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:39.240377 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a28f07-fc35-4113-838f-599065ed8914 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:39.353334 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1147/2266] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:02:39 2022] POST /identity/v3/users => generated 300 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:02:39.357641 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882d3c7-902f-4348-9bc7-57a9d92b6526 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:39.369508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882d3c7-902f-4348-9bc7-57a9d92b6526 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:39.375866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cbbf8-6e69-4de5-8211-c5a511a9c17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:39.376498 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cbbf8-6e69-4de5-8211-c5a511a9c17c admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:39.376794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cbbf8-6e69-4de5-8211-c5a511a9c17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:39.377062 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cbbf8-6e69-4de5-8211-c5a511a9c17c admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:39.377770 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397cbbf8-6e69-4de5-8211-c5a511a9c17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:39.379983 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397cbbf8-6e69-4de5-8211-c5a511a9c17c admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:39.401379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1120/2267] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:02:39.401538 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a28f07-fc35-4113-838f-599065ed8914 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:39.408180 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a28f07-fc35-4113-838f-599065ed8914 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:39.412601 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75722aa4-21c9-456d-9d60-5aaef0a684fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:39.413282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75722aa4-21c9-456d-9d60-5aaef0a684fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:39.413567 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75722aa4-21c9-456d-9d60-5aaef0a684fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:39.413853 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75722aa4-21c9-456d-9d60-5aaef0a684fd admin admin] PATH_INFO: `/v3/projects/0f47e4434d7b4093ab103b2c815178fd/users/c5f28112c30642e7967861e1b1fe2b9e/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:39.428852 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75722aa4-21c9-456d-9d60-5aaef0a684fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f47e4434d7b4093ab103b2c815178fd, user_id=c5f28112c30642e7967861e1b1fe2b9e, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:39.431576 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75722aa4-21c9-456d-9d60-5aaef0a684fd admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:39.488009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:39.493440 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1148/2268] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:02:39 2022] PUT /identity/v3/projects/0f47e4434d7b4093ab103b2c815178fd/users/c5f28112c30642e7967861e1b1fe2b9e/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:39.497475 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cbbf8-6e69-4de5-8211-c5a511a9c17c admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:39.508147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cbbf8-6e69-4de5-8211-c5a511a9c17c admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:39.563347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c58b72-ecaf-4782-81a1-47db375a4bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:39.563961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c58b72-ecaf-4782-81a1-47db375a4bff admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:39.564246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c58b72-ecaf-4782-81a1-47db375a4bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:39.564545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c58b72-ecaf-4782-81a1-47db375a4bff admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:39.565236 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c58b72-ecaf-4782-81a1-47db375a4bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:39.567521 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c58b72-ecaf-4782-81a1-47db375a4bff admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:39.577227 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1121/2269] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:39.581139 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75722aa4-21c9-456d-9d60-5aaef0a684fd admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:39.591415 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75722aa4-21c9-456d-9d60-5aaef0a684fd admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:39.596071 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d2516-d9df-4ff8-b673-2509acbcf897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:39.596728 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d2516-d9df-4ff8-b673-2509acbcf897 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:39.597010 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d2516-d9df-4ff8-b673-2509acbcf897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:39.597286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d2516-d9df-4ff8-b673-2509acbcf897 admin admin] PATH_INFO: `/v3/projects/0f47e4434d7b4093ab103b2c815178fd/users/c5f28112c30642e7967861e1b1fe2b9e/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:39.599312 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d2516-d9df-4ff8-b673-2509acbcf897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f47e4434d7b4093ab103b2c815178fd, user_id=c5f28112c30642e7967861e1b1fe2b9e, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:39.603691 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d2516-d9df-4ff8-b673-2509acbcf897 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:39.614415 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1149/2270] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:02:39 2022] PUT /identity/v3/projects/0f47e4434d7b4093ab103b2c815178fd/users/c5f28112c30642e7967861e1b1fe2b9e/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:39.624262 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7c759-2ec0-4fa9-b515-e39359e7b078 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:39.629555 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7c759-2ec0-4fa9-b515-e39359e7b078 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:39.629555 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7c759-2ec0-4fa9-b515-e39359e7b078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:39.652931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-5db7c759-2ec0-4fa9-b515-e39359e7b078 None None] MFA Rules not processed for user `c5f28112c30642e7967861e1b1fe2b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:39.654126 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-5db7c759-2ec0-4fa9-b515-e39359e7b078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:39.658307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:39.721613 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1122/2271] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:02:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:39.732217 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d2516-d9df-4ff8-b673-2509acbcf897 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:39.734702 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d61d2516-d9df-4ff8-b673-2509acbcf897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:39.791432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d2516-d9df-4ff8-b673-2509acbcf897 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:39.795160 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d39b9-c999-440c-8a59-bf97eb00c5c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:39.795776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d39b9-c999-440c-8a59-bf97eb00c5c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:39.796064 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d39b9-c999-440c-8a59-bf97eb00c5c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:39.796346 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d39b9-c999-440c-8a59-bf97eb00c5c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:39.805846 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d39b9-c999-440c-8a59-bf97eb00c5c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:39.807368 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d39b9-c999-440c-8a59-bf97eb00c5c5 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:39.817511 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1150/2272] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:02:40.942293 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7c759-2ec0-4fa9-b515-e39359e7b078 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:40.947850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-5db7c759-2ec0-4fa9-b515-e39359e7b078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:40.955387 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7c759-2ec0-4fa9-b515-e39359e7b078 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:40.959690 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d9ce8-3793-4fe5-85b2-ffb820ac2b82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:40.960299 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d9ce8-3793-4fe5-85b2-ffb820ac2b82 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:40.960584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d9ce8-3793-4fe5-85b2-ffb820ac2b82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:40.960861 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d9ce8-3793-4fe5-85b2-ffb820ac2b82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:41.023319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d9ce8-3793-4fe5-85b2-ffb820ac2b82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:41.024808 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d9ce8-3793-4fe5-85b2-ffb820ac2b82 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:41.033687 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1123/2273] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:48.120104 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d39b9-c999-440c-8a59-bf97eb00c5c5 service cinder] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:48.121928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-909d39b9-c999-440c-8a59-bf97eb00c5c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:48.181632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d39b9-c999-440c-8a59-bf97eb00c5c5 service cinder] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:48.185293 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169aba8-5398-4bc0-aadb-9396bb5e6f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:48.185914 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169aba8-5398-4bc0-aadb-9396bb5e6f99 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:48.186199 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169aba8-5398-4bc0-aadb-9396bb5e6f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:48.186481 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169aba8-5398-4bc0-aadb-9396bb5e6f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:48.188338 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d169aba8-5398-4bc0-aadb-9396bb5e6f99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:48.262526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169aba8-5398-4bc0-aadb-9396bb5e6f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:48.264127 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169aba8-5398-4bc0-aadb-9396bb5e6f99 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:48.274893 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1151/2274] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:50.711808 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0377e8-1ca5-41d2-99d1-34bb2f976fb8 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:50.712297 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0377e8-1ca5-41d2-99d1-34bb2f976fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:50.712391 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0377e8-1ca5-41d2-99d1-34bb2f976fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:50.743649 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-ef0377e8-1ca5-41d2-99d1-34bb2f976fb8 None None] MFA Rules not processed for user `bb5f78a0ee0642c7bbde2ecf34e090d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:50.745004 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-ef0377e8-1ca5-41d2-99d1-34bb2f976fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:50.814996 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1124/2275] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:02:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:53.473850 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169aba8-5398-4bc0-aadb-9396bb5e6f99 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:53.483347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169aba8-5398-4bc0-aadb-9396bb5e6f99 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:53.487219 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03752759-3aba-4837-8a0c-eda5e6da7359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:53.487944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03752759-3aba-4837-8a0c-eda5e6da7359 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:53.488232 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03752759-3aba-4837-8a0c-eda5e6da7359 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:53.488560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03752759-3aba-4837-8a0c-eda5e6da7359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:53.532960 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:53.548935 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03752759-3aba-4837-8a0c-eda5e6da7359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:53.550407 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03752759-3aba-4837-8a0c-eda5e6da7359 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:53.559303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1152/2276] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:55.423954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0377e8-1ca5-41d2-99d1-34bb2f976fb8 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:55.425482 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-ef0377e8-1ca5-41d2-99d1-34bb2f976fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:55.481988 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:55.503888 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0377e8-1ca5-41d2-99d1-34bb2f976fb8 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:55.509188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f21a78-7bad-4d52-a3e4-ec346df566d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:55.509909 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f21a78-7bad-4d52-a3e4-ec346df566d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:55.510189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f21a78-7bad-4d52-a3e4-ec346df566d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:55.510467 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f21a78-7bad-4d52-a3e4-ec346df566d3 admin admin] PATH_INFO: `/v3/users/993113a815fe4ee38a8408a28c29b995` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:55.511703 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f21a78-7bad-4d52-a3e4-ec346df566d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=993113a815fe4ee38a8408a28c29b995)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:55.513712 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f21a78-7bad-4d52-a3e4-ec346df566d3 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:55.744589 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-93f21a78-7bad-4d52-a3e4-ec346df566d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '993113a815fe4ee38a8408a28c29b995'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:55.760696 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-93f21a78-7bad-4d52-a3e4-ec346df566d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '993113a815fe4ee38a8408a28c29b995'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:55.852449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-93f21a78-7bad-4d52-a3e4-ec346df566d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '993113a815fe4ee38a8408a28c29b995'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:55.853100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-93f21a78-7bad-4d52-a3e4-ec346df566d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '993113a815fe4ee38a8408a28c29b995'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:55.872055 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-93f21a78-7bad-4d52-a3e4-ec346df566d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '993113a815fe4ee38a8408a28c29b995'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:55.879957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1125/2277] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:02:55 2022] DELETE /identity/v3/users/993113a815fe4ee38a8408a28c29b995 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:55.884521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e539ab0-850b-42dc-ad38-251a95f7d666 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:55.885015 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e539ab0-850b-42dc-ad38-251a95f7d666 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:55.885105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e539ab0-850b-42dc-ad38-251a95f7d666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:55.905149 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-7e539ab0-850b-42dc-ad38-251a95f7d666 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:55.906393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-7e539ab0-850b-42dc-ad38-251a95f7d666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:55.982785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1153/2278] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:02:55.992799 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f21a78-7bad-4d52-a3e4-ec346df566d3 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:55.994651 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-93f21a78-7bad-4d52-a3e4-ec346df566d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:56.099494 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f21a78-7bad-4d52-a3e4-ec346df566d3 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:56.106315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddf7e3-0849-41e0-87f1-8d0023986407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:56.108536 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddf7e3-0849-41e0-87f1-8d0023986407 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:56.109384 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddf7e3-0849-41e0-87f1-8d0023986407 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:56.109929 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddf7e3-0849-41e0-87f1-8d0023986407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:56.152323 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddf7e3-0849-41e0-87f1-8d0023986407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:56.155498 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddf7e3-0849-41e0-87f1-8d0023986407 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:56.172204 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1126/2279] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:02:56.845025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e539ab0-850b-42dc-ad38-251a95f7d666 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:56.846845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-7e539ab0-850b-42dc-ad38-251a95f7d666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:56.879851 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e539ab0-850b-42dc-ad38-251a95f7d666 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:56.885937 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52970e2-4a0f-4269-b5c5-c96c5f61a7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:56.888569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52970e2-4a0f-4269-b5c5-c96c5f61a7e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:56.889768 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52970e2-4a0f-4269-b5c5-c96c5f61a7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:56.890204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52970e2-4a0f-4269-b5c5-c96c5f61a7e8 admin admin] PATH_INFO: `/v3/projects/be6acfba162d402a9a089d8edffdc28c` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:56.894353 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52970e2-4a0f-4269-b5c5-c96c5f61a7e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be6acfba162d402a9a089d8edffdc28c)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:56.897181 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52970e2-4a0f-4269-b5c5-c96c5f61a7e8 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:57.046638 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b52970e2-4a0f-4269-b5c5-c96c5f61a7e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be6acfba162d402a9a089d8edffdc28c', 'request_id': 'req-b52970e2-4a0f-4269-b5c5-c96c5f61a7e8'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:57.053518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b52970e2-4a0f-4269-b5c5-c96c5f61a7e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be6acfba162d402a9a089d8edffdc28c', 'request_id': 'req-b52970e2-4a0f-4269-b5c5-c96c5f61a7e8'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:57.132443 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b52970e2-4a0f-4269-b5c5-c96c5f61a7e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be6acfba162d402a9a089d8edffdc28c', 'request_id': 'req-b52970e2-4a0f-4269-b5c5-c96c5f61a7e8'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:57.143966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b52970e2-4a0f-4269-b5c5-c96c5f61a7e8 admin admin] The token cache is being invalidate because project be6acfba162d402a9a089d8edffdc28c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:02:57.144501 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b52970e2-4a0f-4269-b5c5-c96c5f61a7e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:57.146645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b52970e2-4a0f-4269-b5c5-c96c5f61a7e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:57.148450 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1154/2280] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:02:56 2022] DELETE /identity/v3/projects/be6acfba162d402a9a089d8edffdc28c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:57.973477 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddf7e3-0849-41e0-87f1-8d0023986407 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:57.975043 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3fddf7e3-0849-41e0-87f1-8d0023986407 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:57.988638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddf7e3-0849-41e0-87f1-8d0023986407 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:58.046802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0b793-796b-46df-aff0-039bd669a237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:58.047458 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0b793-796b-46df-aff0-039bd669a237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:58.047744 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0b793-796b-46df-aff0-039bd669a237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:58.048022 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0b793-796b-46df-aff0-039bd669a237 admin admin] PATH_INFO: `/v3/users/fc8aad3fd65a4b85ae38906a3a58a102` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:58.049202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0b793-796b-46df-aff0-039bd669a237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc8aad3fd65a4b85ae38906a3a58a102)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:58.051891 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0b793-796b-46df-aff0-039bd669a237 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:58.057911 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:58.251279 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-51a0b793-796b-46df-aff0-039bd669a237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc8aad3fd65a4b85ae38906a3a58a102'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:58.258502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-51a0b793-796b-46df-aff0-039bd669a237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc8aad3fd65a4b85ae38906a3a58a102'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:58.323604 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-51a0b793-796b-46df-aff0-039bd669a237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc8aad3fd65a4b85ae38906a3a58a102'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:58.324269 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-51a0b793-796b-46df-aff0-039bd669a237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc8aad3fd65a4b85ae38906a3a58a102'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:58.336994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-51a0b793-796b-46df-aff0-039bd669a237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc8aad3fd65a4b85ae38906a3a58a102'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:58.342957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1127/2281] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:02:57 2022] DELETE /identity/v3/users/fc8aad3fd65a4b85ae38906a3a58a102 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:58.349444 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df6363-c1ad-4dee-a490-71785a02c7c2 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:58.350609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df6363-c1ad-4dee-a490-71785a02c7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:58.350931 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df6363-c1ad-4dee-a490-71785a02c7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:58.373706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-60df6363-c1ad-4dee-a490-71785a02c7c2 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:58.374998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-60df6363-c1ad-4dee-a490-71785a02c7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:58.436978 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1155/2282] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:02:58.447569 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0b793-796b-46df-aff0-039bd669a237 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:58.449131 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-51a0b793-796b-46df-aff0-039bd669a237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:58.509538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0b793-796b-46df-aff0-039bd669a237 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:58.513141 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc804bb6-78f0-4dd2-a299-02e523603ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:58.513794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc804bb6-78f0-4dd2-a299-02e523603ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:58.514097 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc804bb6-78f0-4dd2-a299-02e523603ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:58.514328 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc804bb6-78f0-4dd2-a299-02e523603ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:58.524566 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc804bb6-78f0-4dd2-a299-02e523603ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:58.525987 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc804bb6-78f0-4dd2-a299-02e523603ce0 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:58.536331 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1128/2283] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:59.059286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df6363-c1ad-4dee-a490-71785a02c7c2 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:59.060867 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-60df6363-c1ad-4dee-a490-71785a02c7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:59.069201 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:59.078758 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df6363-c1ad-4dee-a490-71785a02c7c2 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:59.084837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb74e79-adc9-4ab1-9b6c-e08efaa8a929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:59.085559 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb74e79-adc9-4ab1-9b6c-e08efaa8a929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:59.085852 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb74e79-adc9-4ab1-9b6c-e08efaa8a929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:59.086134 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb74e79-adc9-4ab1-9b6c-e08efaa8a929 admin admin] PATH_INFO: `/v3/projects/e271022dfd8a4d1f8af5ceec46a5c4ae` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:59.089936 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb74e79-adc9-4ab1-9b6c-e08efaa8a929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e271022dfd8a4d1f8af5ceec46a5c4ae)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:59.089936 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb74e79-adc9-4ab1-9b6c-e08efaa8a929 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:59.230568 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-abb74e79-adc9-4ab1-9b6c-e08efaa8a929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e271022dfd8a4d1f8af5ceec46a5c4ae', 'request_id': 'req-abb74e79-adc9-4ab1-9b6c-e08efaa8a929'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:59.237031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-abb74e79-adc9-4ab1-9b6c-e08efaa8a929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e271022dfd8a4d1f8af5ceec46a5c4ae', 'request_id': 'req-abb74e79-adc9-4ab1-9b6c-e08efaa8a929'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:59.329345 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-abb74e79-adc9-4ab1-9b6c-e08efaa8a929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e271022dfd8a4d1f8af5ceec46a5c4ae', 'request_id': 'req-abb74e79-adc9-4ab1-9b6c-e08efaa8a929'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:59.340675 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-abb74e79-adc9-4ab1-9b6c-e08efaa8a929 admin admin] The token cache is being invalidate because project e271022dfd8a4d1f8af5ceec46a5c4ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:02:59.340967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-abb74e79-adc9-4ab1-9b6c-e08efaa8a929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:59.341590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-abb74e79-adc9-4ab1-9b6c-e08efaa8a929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:59.343153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1156/2284] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:02:59 2022] DELETE /identity/v3/projects/e271022dfd8a4d1f8af5ceec46a5c4ae => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:59.347745 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc804bb6-78f0-4dd2-a299-02e523603ce0 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:59.357344 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc804bb6-78f0-4dd2-a299-02e523603ce0 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:59.413211 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219481b-9783-4903-a7d9-945fdf1ba158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:59.413851 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219481b-9783-4903-a7d9-945fdf1ba158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:59.414139 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219481b-9783-4903-a7d9-945fdf1ba158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:59.414417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219481b-9783-4903-a7d9-945fdf1ba158 admin admin] PATH_INFO: `/v3/users/22fbb1e9cce24f918ad6eb8838b53f0f` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:59.415617 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219481b-9783-4903-a7d9-945fdf1ba158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22fbb1e9cce24f918ad6eb8838b53f0f)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:59.417540 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219481b-9783-4903-a7d9-945fdf1ba158 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:59.574696 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:59.589180 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b219481b-9783-4903-a7d9-945fdf1ba158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22fbb1e9cce24f918ad6eb8838b53f0f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:59.600046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b219481b-9783-4903-a7d9-945fdf1ba158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22fbb1e9cce24f918ad6eb8838b53f0f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:59.663973 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b219481b-9783-4903-a7d9-945fdf1ba158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22fbb1e9cce24f918ad6eb8838b53f0f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:59.665385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b219481b-9783-4903-a7d9-945fdf1ba158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22fbb1e9cce24f918ad6eb8838b53f0f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:59.679531 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b219481b-9783-4903-a7d9-945fdf1ba158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22fbb1e9cce24f918ad6eb8838b53f0f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:59.686983 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1129/2285] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:02:59 2022] DELETE /identity/v3/users/22fbb1e9cce24f918ad6eb8838b53f0f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:03:00.287859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb74e79-adc9-4ab1-9b6c-e08efaa8a929 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:00.289326 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-abb74e79-adc9-4ab1-9b6c-e08efaa8a929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:00.314216 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb74e79-adc9-4ab1-9b6c-e08efaa8a929 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:00.398531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee26791-3513-450f-b755-d0df8ca0aae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:00.399331 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee26791-3513-450f-b755-d0df8ca0aae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:00.399624 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee26791-3513-450f-b755-d0df8ca0aae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:00.399943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee26791-3513-450f-b755-d0df8ca0aae2 admin admin] PATH_INFO: `/v3/projects/6d8f84940d924990ba3dbfc92bd1d857` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:00.401216 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee26791-3513-450f-b755-d0df8ca0aae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d8f84940d924990ba3dbfc92bd1d857)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:00.403250 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee26791-3513-450f-b755-d0df8ca0aae2 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:00.539732 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-1ee26791-3513-450f-b755-d0df8ca0aae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d8f84940d924990ba3dbfc92bd1d857', 'request_id': 'req-1ee26791-3513-450f-b755-d0df8ca0aae2'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:00.546005 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-1ee26791-3513-450f-b755-d0df8ca0aae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d8f84940d924990ba3dbfc92bd1d857', 'request_id': 'req-1ee26791-3513-450f-b755-d0df8ca0aae2'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:00.629188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-1ee26791-3513-450f-b755-d0df8ca0aae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d8f84940d924990ba3dbfc92bd1d857', 'request_id': 'req-1ee26791-3513-450f-b755-d0df8ca0aae2'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:00.640194 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-1ee26791-3513-450f-b755-d0df8ca0aae2 admin admin] The token cache is being invalidate because project 6d8f84940d924990ba3dbfc92bd1d857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:03:00.640488 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-1ee26791-3513-450f-b755-d0df8ca0aae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:00.641203 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-1ee26791-3513-450f-b755-d0df8ca0aae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:00.642764 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1157/2286] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:03:00 2022] DELETE /identity/v3/projects/6d8f84940d924990ba3dbfc92bd1d857 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:03:00.646720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219481b-9783-4903-a7d9-945fdf1ba158 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:00.648220 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b219481b-9783-4903-a7d9-945fdf1ba158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:00.661607 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219481b-9783-4903-a7d9-945fdf1ba158 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:00.725102 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da915e9-a226-4f95-a73a-df7eb2be65f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:00.725752 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da915e9-a226-4f95-a73a-df7eb2be65f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:00.726045 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da915e9-a226-4f95-a73a-df7eb2be65f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:00.726326 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da915e9-a226-4f95-a73a-df7eb2be65f5 admin admin] PATH_INFO: `/v3/users/c5f28112c30642e7967861e1b1fe2b9e` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:00.727541 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da915e9-a226-4f95-a73a-df7eb2be65f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f28112c30642e7967861e1b1fe2b9e)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:00.729470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da915e9-a226-4f95-a73a-df7eb2be65f5 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:01.471477 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-3da915e9-a226-4f95-a73a-df7eb2be65f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f28112c30642e7967861e1b1fe2b9e'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:01.490124 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-3da915e9-a226-4f95-a73a-df7eb2be65f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f28112c30642e7967861e1b1fe2b9e'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:01.581211 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-3da915e9-a226-4f95-a73a-df7eb2be65f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f28112c30642e7967861e1b1fe2b9e'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:01.581871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-3da915e9-a226-4f95-a73a-df7eb2be65f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f28112c30642e7967861e1b1fe2b9e'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:01.595897 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-3da915e9-a226-4f95-a73a-df7eb2be65f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f28112c30642e7967861e1b1fe2b9e'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:01.602874 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1130/2287] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:03:00 2022] DELETE /identity/v3/users/c5f28112c30642e7967861e1b1fe2b9e => generated 0 bytes in 957 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:03:01.994025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee26791-3513-450f-b755-d0df8ca0aae2 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:01.997730 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-1ee26791-3513-450f-b755-d0df8ca0aae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:02.008738 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee26791-3513-450f-b755-d0df8ca0aae2 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:02.024193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:02.070074 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f17e5-4077-4e64-9666-1100d083368d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:02.070725 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f17e5-4077-4e64-9666-1100d083368d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:02.071048 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f17e5-4077-4e64-9666-1100d083368d admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:02.071331 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f17e5-4077-4e64-9666-1100d083368d admin admin] PATH_INFO: `/v3/projects/0f47e4434d7b4093ab103b2c815178fd` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:02.072500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f17e5-4077-4e64-9666-1100d083368d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f47e4434d7b4093ab103b2c815178fd)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:02.074462 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f17e5-4077-4e64-9666-1100d083368d admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:02.216855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-066f17e5-4077-4e64-9666-1100d083368d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f47e4434d7b4093ab103b2c815178fd', 'request_id': 'req-066f17e5-4077-4e64-9666-1100d083368d'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:02.228995 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-066f17e5-4077-4e64-9666-1100d083368d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f47e4434d7b4093ab103b2c815178fd', 'request_id': 'req-066f17e5-4077-4e64-9666-1100d083368d'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:02.292010 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-066f17e5-4077-4e64-9666-1100d083368d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f47e4434d7b4093ab103b2c815178fd', 'request_id': 'req-066f17e5-4077-4e64-9666-1100d083368d'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:02.303766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-066f17e5-4077-4e64-9666-1100d083368d admin admin] The token cache is being invalidate because project 0f47e4434d7b4093ab103b2c815178fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:03:02.304063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-066f17e5-4077-4e64-9666-1100d083368d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:02.304824 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-066f17e5-4077-4e64-9666-1100d083368d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:02.306602 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1158/2288] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:03:01 2022] DELETE /identity/v3/projects/0f47e4434d7b4093ab103b2c815178fd => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:03:02.312507 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066f0a5-7916-45eb-bbf9-b8497742ba9a None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:02.313006 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066f0a5-7916-45eb-bbf9-b8497742ba9a None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:02.313108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066f0a5-7916-45eb-bbf9-b8497742ba9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:02.333780 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-5066f0a5-7916-45eb-bbf9-b8497742ba9a None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:02.335158 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-5066f0a5-7916-45eb-bbf9-b8497742ba9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:02.357261 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:02.395671 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1131/2289] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:02.404066 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d4090-2dfd-4c3c-8daf-f0d50820bfa4 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:02.404607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d4090-2dfd-4c3c-8daf-f0d50820bfa4 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:02.404906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d4090-2dfd-4c3c-8daf-f0d50820bfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:02.424925 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-e76d4090-2dfd-4c3c-8daf-f0d50820bfa4 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:02.431198 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e76d4090-2dfd-4c3c-8daf-f0d50820bfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:02.434072 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1159/2290] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:02.438359 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066f0a5-7916-45eb-bbf9-b8497742ba9a None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:02.448985 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066f0a5-7916-45eb-bbf9-b8497742ba9a None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:02.454158 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5c864-f022-4366-ad7b-7c28098bf376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:02.454831 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5c864-f022-4366-ad7b-7c28098bf376 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:02.455113 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5c864-f022-4366-ad7b-7c28098bf376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:02.455390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5c864-f022-4366-ad7b-7c28098bf376 admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:02.456739 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5c864-f022-4366-ad7b-7c28098bf376 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:03:02.457070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5c864-f022-4366-ad7b-7c28098bf376 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:02.458665 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5c864-f022-4366-ad7b-7c28098bf376 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:02.470045 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1132/2291] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:03:02.474365 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d4090-2dfd-4c3c-8daf-f0d50820bfa4 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:02.483574 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d4090-2dfd-4c3c-8daf-f0d50820bfa4 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:02.488271 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63243fac-4488-4523-9464-7478228e8169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:02.488870 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63243fac-4488-4523-9464-7478228e8169 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:02.489171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63243fac-4488-4523-9464-7478228e8169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:02.489512 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63243fac-4488-4523-9464-7478228e8169 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:02.490186 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63243fac-4488-4523-9464-7478228e8169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:02.492173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63243fac-4488-4523-9464-7478228e8169 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:02.613896 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1160/2292] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:03:02 2022] POST /identity/v3/projects => generated 407 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:03:02.617919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5c864-f022-4366-ad7b-7c28098bf376 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:02.632668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5c864-f022-4366-ad7b-7c28098bf376 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:02.714449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81d90d-682c-4947-a0da-65982553179d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:02.715138 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81d90d-682c-4947-a0da-65982553179d admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:02.715429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81d90d-682c-4947-a0da-65982553179d admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:02.715743 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81d90d-682c-4947-a0da-65982553179d admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:02.716455 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81d90d-682c-4947-a0da-65982553179d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:02.718539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81d90d-682c-4947-a0da-65982553179d admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:02.823833 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1133/2293] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:03:02 2022] POST /identity/v3/users => generated 304 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:03:02.829525 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63243fac-4488-4523-9464-7478228e8169 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:02.839936 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63243fac-4488-4523-9464-7478228e8169 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:02.844565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361d9c8-c132-42bb-88c0-3b14b38329aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:02.845182 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361d9c8-c132-42bb-88c0-3b14b38329aa admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:02.845468 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361d9c8-c132-42bb-88c0-3b14b38329aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:02.845747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361d9c8-c132-42bb-88c0-3b14b38329aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:02.846493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361d9c8-c132-42bb-88c0-3b14b38329aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:02.848194 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361d9c8-c132-42bb-88c0-3b14b38329aa admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:02.858425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1161/2294] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:03:02.863322 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81d90d-682c-4947-a0da-65982553179d admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:02.873469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81d90d-682c-4947-a0da-65982553179d admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:02.878695 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406afc33-1549-4d52-9a2f-7fcdc72cdaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:02.879448 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406afc33-1549-4d52-9a2f-7fcdc72cdaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:02.879729 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406afc33-1549-4d52-9a2f-7fcdc72cdaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:02.880003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406afc33-1549-4d52-9a2f-7fcdc72cdaa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:02.880691 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406afc33-1549-4d52-9a2f-7fcdc72cdaa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:02.882268 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406afc33-1549-4d52-9a2f-7fcdc72cdaa5 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:02.892822 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1134/2295] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:03:02.896878 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361d9c8-c132-42bb-88c0-3b14b38329aa admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:02.907163 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361d9c8-c132-42bb-88c0-3b14b38329aa admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:02.911945 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ff8a5-42a7-4b3a-87a5-09032ba845b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:02.912612 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ff8a5-42a7-4b3a-87a5-09032ba845b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:02.912895 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ff8a5-42a7-4b3a-87a5-09032ba845b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:02.913172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ff8a5-42a7-4b3a-87a5-09032ba845b3 admin admin] PATH_INFO: `/v3/projects/c9b6c82ecfb4423e9adbd603d5eed464/users/11d6dbf5f6c74b43a3ed036a3b548641/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:02.928304 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ff8a5-42a7-4b3a-87a5-09032ba845b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b6c82ecfb4423e9adbd603d5eed464, user_id=11d6dbf5f6c74b43a3ed036a3b548641, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:02.930963 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ff8a5-42a7-4b3a-87a5-09032ba845b3 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:03.034712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1162/2296] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:03:02 2022] PUT /identity/v3/projects/c9b6c82ecfb4423e9adbd603d5eed464/users/11d6dbf5f6c74b43a3ed036a3b548641/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:03:03.047059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d6d4d-4e85-40f9-bdef-509e7543481e None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:03.047356 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d6d4d-4e85-40f9-bdef-509e7543481e None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:03.047641 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d6d4d-4e85-40f9-bdef-509e7543481e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:03.076336 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-1b7d6d4d-4e85-40f9-bdef-509e7543481e None None] MFA Rules not processed for user `11d6dbf5f6c74b43a3ed036a3b548641`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:03.077578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-1b7d6d4d-4e85-40f9-bdef-509e7543481e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:03.142476 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1135/2297] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:03:03 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:03.147302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ff8a5-42a7-4b3a-87a5-09032ba845b3 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:03.194839 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:03.215130 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ff8a5-42a7-4b3a-87a5-09032ba845b3 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:03.220033 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a11c8-0058-46dd-935d-b40d38562f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:03.220690 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a11c8-0058-46dd-935d-b40d38562f18 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:03.220976 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a11c8-0058-46dd-935d-b40d38562f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:03.221766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a11c8-0058-46dd-935d-b40d38562f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:03.222486 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a11c8-0058-46dd-935d-b40d38562f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:03.224447 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a11c8-0058-46dd-935d-b40d38562f18 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:03.319272 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1163/2298] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:03:03 2022] POST /identity/v3/projects => generated 409 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:03:03.323334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d6d4d-4e85-40f9-bdef-509e7543481e None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:03.334642 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d6d4d-4e85-40f9-bdef-509e7543481e None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:03.357299 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:03.396029 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17c349-1924-48da-b0b7-e9476323b3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:03.399362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17c349-1924-48da-b0b7-e9476323b3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:03.399362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17c349-1924-48da-b0b7-e9476323b3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:03.399362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17c349-1924-48da-b0b7-e9476323b3e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:03.399362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17c349-1924-48da-b0b7-e9476323b3e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:03.399839 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17c349-1924-48da-b0b7-e9476323b3e7 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:03.497808 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1136/2299] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:03:03 2022] POST /identity/v3/users => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:03:03.501881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a11c8-0058-46dd-935d-b40d38562f18 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:03.512157 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a11c8-0058-46dd-935d-b40d38562f18 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:03.516981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e60c8-10d8-448a-a52a-b2b75deeeabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:03.520028 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e60c8-10d8-448a-a52a-b2b75deeeabe admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:03.520028 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e60c8-10d8-448a-a52a-b2b75deeeabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:03.520028 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e60c8-10d8-448a-a52a-b2b75deeeabe admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:03.520028 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e60c8-10d8-448a-a52a-b2b75deeeabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:03.521011 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e60c8-10d8-448a-a52a-b2b75deeeabe admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:03.531376 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1164/2300] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:03:03.536210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17c349-1924-48da-b0b7-e9476323b3e7 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:03.546183 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17c349-1924-48da-b0b7-e9476323b3e7 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:03.550800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fb35f-40ae-4b62-885b-57de0a9f3fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:03.551452 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fb35f-40ae-4b62-885b-57de0a9f3fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:03.551729 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fb35f-40ae-4b62-885b-57de0a9f3fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:03.552003 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fb35f-40ae-4b62-885b-57de0a9f3fe1 admin admin] PATH_INFO: `/v3/projects/17f43b9985d348639a44277a85ef1a6f/users/a5ed7b4def7c49f88f2877a856e31dbe/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:03.566692 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fb35f-40ae-4b62-885b-57de0a9f3fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f43b9985d348639a44277a85ef1a6f, user_id=a5ed7b4def7c49f88f2877a856e31dbe, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:03.569376 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fb35f-40ae-4b62-885b-57de0a9f3fe1 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:03.635549 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1137/2301] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:03:03 2022] PUT /identity/v3/projects/17f43b9985d348639a44277a85ef1a6f/users/a5ed7b4def7c49f88f2877a856e31dbe/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:03:03.639592 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e60c8-10d8-448a-a52a-b2b75deeeabe admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:03.649992 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e60c8-10d8-448a-a52a-b2b75deeeabe admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:03.707944 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cb61c-a8ea-4c5a-9079-a2b4ba94baac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:03.713961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cb61c-a8ea-4c5a-9079-a2b4ba94baac admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:03.713961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cb61c-a8ea-4c5a-9079-a2b4ba94baac admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:03.713961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cb61c-a8ea-4c5a-9079-a2b4ba94baac admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:03.713961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353cb61c-a8ea-4c5a-9079-a2b4ba94baac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:03.713961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353cb61c-a8ea-4c5a-9079-a2b4ba94baac admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:03.725418 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1165/2302] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:03:03.726690 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fb35f-40ae-4b62-885b-57de0a9f3fe1 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:03.738191 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fb35f-40ae-4b62-885b-57de0a9f3fe1 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:03.742986 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a5fac-a768-406e-8485-20159c8775eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:03.743728 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a5fac-a768-406e-8485-20159c8775eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:03.744098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a5fac-a768-406e-8485-20159c8775eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:03.744441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a5fac-a768-406e-8485-20159c8775eb admin admin] PATH_INFO: `/v3/projects/17f43b9985d348639a44277a85ef1a6f/users/a5ed7b4def7c49f88f2877a856e31dbe/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:03.746470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a5fac-a768-406e-8485-20159c8775eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f43b9985d348639a44277a85ef1a6f, user_id=a5ed7b4def7c49f88f2877a856e31dbe, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:03.749222 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a5fac-a768-406e-8485-20159c8775eb admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:03.759564 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1138/2303] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:03:03 2022] PUT /identity/v3/projects/17f43b9985d348639a44277a85ef1a6f/users/a5ed7b4def7c49f88f2877a856e31dbe/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:03:03.770166 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da2204-f2a0-4448-bc0e-d71e25f6d1bf None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:03.770398 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da2204-f2a0-4448-bc0e-d71e25f6d1bf None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:03.770680 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da2204-f2a0-4448-bc0e-d71e25f6d1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:03.798700 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-85da2204-f2a0-4448-bc0e-d71e25f6d1bf None None] MFA Rules not processed for user `a5ed7b4def7c49f88f2877a856e31dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:03.799964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-85da2204-f2a0-4448-bc0e-d71e25f6d1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:03.881401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1166/2304] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:03:03 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:03.892983 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a5fac-a768-406e-8485-20159c8775eb admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:03.895345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-8e7a5fac-a768-406e-8485-20159c8775eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:03.957323 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a5fac-a768-406e-8485-20159c8775eb admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:03.961024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21c6f3-3aad-4d17-8733-a16fb875ba19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:03.961755 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21c6f3-3aad-4d17-8733-a16fb875ba19 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:03.962052 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21c6f3-3aad-4d17-8733-a16fb875ba19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:03.962317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21c6f3-3aad-4d17-8733-a16fb875ba19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:03.972318 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21c6f3-3aad-4d17-8733-a16fb875ba19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:03.973849 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21c6f3-3aad-4d17-8733-a16fb875ba19 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:03.985840 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1139/2305] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:03 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:04.368557 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da2204-f2a0-4448-bc0e-d71e25f6d1bf None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:04.379057 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da2204-f2a0-4448-bc0e-d71e25f6d1bf None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:04.382624 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2092d-127e-45c8-b95f-9a2f4c621ed1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:04.383279 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2092d-127e-45c8-b95f-9a2f4c621ed1 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:04.383564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2092d-127e-45c8-b95f-9a2f4c621ed1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:04.383841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2092d-127e-45c8-b95f-9a2f4c621ed1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:04.417737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:04.442347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2092d-127e-45c8-b95f-9a2f4c621ed1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:04.444442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2092d-127e-45c8-b95f-9a2f4c621ed1 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:04.453341 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1167/2306] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:04 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:13.979388 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=60,keystone:INSERT=5 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:14.508061 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=11 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:20.738049 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21c6f3-3aad-4d17-8733-a16fb875ba19 service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:20.804252 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21c6f3-3aad-4d17-8733-a16fb875ba19 service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:20.808941 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8d541-ba41-4ad9-ba12-1b8454347a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:20.809594 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8d541-ba41-4ad9-ba12-1b8454347a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:20.809873 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8d541-ba41-4ad9-ba12-1b8454347a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:20.810148 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8d541-ba41-4ad9-ba12-1b8454347a74 admin admin] PATH_INFO: `/v3/users/11d6dbf5f6c74b43a3ed036a3b548641` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:20.811352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8d541-ba41-4ad9-ba12-1b8454347a74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11d6dbf5f6c74b43a3ed036a3b548641)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:20.813281 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8d541-ba41-4ad9-ba12-1b8454347a74 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:20.983243 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-a0f8d541-ba41-4ad9-ba12-1b8454347a74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11d6dbf5f6c74b43a3ed036a3b548641'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:20.990095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-a0f8d541-ba41-4ad9-ba12-1b8454347a74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11d6dbf5f6c74b43a3ed036a3b548641'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:21.054290 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-a0f8d541-ba41-4ad9-ba12-1b8454347a74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11d6dbf5f6c74b43a3ed036a3b548641'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:21.054951 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-a0f8d541-ba41-4ad9-ba12-1b8454347a74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11d6dbf5f6c74b43a3ed036a3b548641'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:21.068346 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-a0f8d541-ba41-4ad9-ba12-1b8454347a74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11d6dbf5f6c74b43a3ed036a3b548641'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:21.074290 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1140/2307] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:03:20 2022] DELETE /identity/v3/users/11d6dbf5f6c74b43a3ed036a3b548641 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:03:21.078826 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43072fca-3e24-4489-be8e-0d9bd4b7e5c9 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:21.079293 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43072fca-3e24-4489-be8e-0d9bd4b7e5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:21.079472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43072fca-3e24-4489-be8e-0d9bd4b7e5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:21.098561 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-43072fca-3e24-4489-be8e-0d9bd4b7e5c9 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:21.099817 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-43072fca-3e24-4489-be8e-0d9bd4b7e5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:21.168445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1168/2308] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:21.178046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8d541-ba41-4ad9-ba12-1b8454347a74 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:21.179489 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a0f8d541-ba41-4ad9-ba12-1b8454347a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:21.236039 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8d541-ba41-4ad9-ba12-1b8454347a74 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:21.239706 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708357bf-71e7-47d0-ba3d-6225803bdd76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:21.240320 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708357bf-71e7-47d0-ba3d-6225803bdd76 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:21.240605 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708357bf-71e7-47d0-ba3d-6225803bdd76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:21.240885 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708357bf-71e7-47d0-ba3d-6225803bdd76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:21.250559 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708357bf-71e7-47d0-ba3d-6225803bdd76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:21.252040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708357bf-71e7-47d0-ba3d-6225803bdd76 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:21.262220 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1141/2309] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:21.658825 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43072fca-3e24-4489-be8e-0d9bd4b7e5c9 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:21.660295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-43072fca-3e24-4489-be8e-0d9bd4b7e5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:21.672534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43072fca-3e24-4489-be8e-0d9bd4b7e5c9 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:21.678191 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107ac21-36ea-4de6-ba1d-350ba10ba92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:21.678964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107ac21-36ea-4de6-ba1d-350ba10ba92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:21.679318 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107ac21-36ea-4de6-ba1d-350ba10ba92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:21.679693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107ac21-36ea-4de6-ba1d-350ba10ba92b admin admin] PATH_INFO: `/v3/projects/c9b6c82ecfb4423e9adbd603d5eed464` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:21.684096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107ac21-36ea-4de6-ba1d-350ba10ba92b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b6c82ecfb4423e9adbd603d5eed464)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:21.684096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107ac21-36ea-4de6-ba1d-350ba10ba92b admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:21.807093 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0107ac21-36ea-4de6-ba1d-350ba10ba92b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b6c82ecfb4423e9adbd603d5eed464', 'request_id': 'req-0107ac21-36ea-4de6-ba1d-350ba10ba92b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:21.813256 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0107ac21-36ea-4de6-ba1d-350ba10ba92b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b6c82ecfb4423e9adbd603d5eed464', 'request_id': 'req-0107ac21-36ea-4de6-ba1d-350ba10ba92b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:21.872016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0107ac21-36ea-4de6-ba1d-350ba10ba92b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b6c82ecfb4423e9adbd603d5eed464', 'request_id': 'req-0107ac21-36ea-4de6-ba1d-350ba10ba92b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:21.883309 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0107ac21-36ea-4de6-ba1d-350ba10ba92b admin admin] The token cache is being invalidate because project c9b6c82ecfb4423e9adbd603d5eed464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:03:21.887713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0107ac21-36ea-4de6-ba1d-350ba10ba92b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:21.887713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0107ac21-36ea-4de6-ba1d-350ba10ba92b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:21.887713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1169/2310] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:03:21 2022] DELETE /identity/v3/projects/c9b6c82ecfb4423e9adbd603d5eed464 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:03:21.889826 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708357bf-71e7-47d0-ba3d-6225803bdd76 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:21.899991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708357bf-71e7-47d0-ba3d-6225803bdd76 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:21.919525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:21.957848 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991a8ba-97ff-4010-94b7-e823d38e9bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:21.958489 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991a8ba-97ff-4010-94b7-e823d38e9bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:21.958804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991a8ba-97ff-4010-94b7-e823d38e9bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:21.959084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991a8ba-97ff-4010-94b7-e823d38e9bc3 admin admin] PATH_INFO: `/v3/users/a5ed7b4def7c49f88f2877a856e31dbe` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:21.960242 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991a8ba-97ff-4010-94b7-e823d38e9bc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5ed7b4def7c49f88f2877a856e31dbe)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:21.962162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991a8ba-97ff-4010-94b7-e823d38e9bc3 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:22.097964 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0991a8ba-97ff-4010-94b7-e823d38e9bc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5ed7b4def7c49f88f2877a856e31dbe'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:22.106158 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0991a8ba-97ff-4010-94b7-e823d38e9bc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5ed7b4def7c49f88f2877a856e31dbe'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:22.165312 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0991a8ba-97ff-4010-94b7-e823d38e9bc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5ed7b4def7c49f88f2877a856e31dbe'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:22.165941 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0991a8ba-97ff-4010-94b7-e823d38e9bc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5ed7b4def7c49f88f2877a856e31dbe'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:22.179123 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-0991a8ba-97ff-4010-94b7-e823d38e9bc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5ed7b4def7c49f88f2877a856e31dbe'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:22.185044 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1142/2311] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:03:21 2022] DELETE /identity/v3/users/a5ed7b4def7c49f88f2877a856e31dbe => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:03:22.567109 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107ac21-36ea-4de6-ba1d-350ba10ba92b admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:22.569733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-0107ac21-36ea-4de6-ba1d-350ba10ba92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:22.585280 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107ac21-36ea-4de6-ba1d-350ba10ba92b admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:22.643867 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8873f92-3cc2-440d-9e5e-d81174c9e2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:22.644446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8873f92-3cc2-440d-9e5e-d81174c9e2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:22.644736 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8873f92-3cc2-440d-9e5e-d81174c9e2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:22.645027 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8873f92-3cc2-440d-9e5e-d81174c9e2f5 admin admin] PATH_INFO: `/v3/projects/17f43b9985d348639a44277a85ef1a6f` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:22.646199 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8873f92-3cc2-440d-9e5e-d81174c9e2f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17f43b9985d348639a44277a85ef1a6f)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:22.648144 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8873f92-3cc2-440d-9e5e-d81174c9e2f5 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:22.738432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:22.754572 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d8873f92-3cc2-440d-9e5e-d81174c9e2f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17f43b9985d348639a44277a85ef1a6f', 'request_id': 'req-d8873f92-3cc2-440d-9e5e-d81174c9e2f5'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:22.760686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d8873f92-3cc2-440d-9e5e-d81174c9e2f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17f43b9985d348639a44277a85ef1a6f', 'request_id': 'req-d8873f92-3cc2-440d-9e5e-d81174c9e2f5'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:22.822489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d8873f92-3cc2-440d-9e5e-d81174c9e2f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17f43b9985d348639a44277a85ef1a6f', 'request_id': 'req-d8873f92-3cc2-440d-9e5e-d81174c9e2f5'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:22.833998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d8873f92-3cc2-440d-9e5e-d81174c9e2f5 admin admin] The token cache is being invalidate because project 17f43b9985d348639a44277a85ef1a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:03:22.834296 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d8873f92-3cc2-440d-9e5e-d81174c9e2f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:22.834937 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d8873f92-3cc2-440d-9e5e-d81174c9e2f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:22.836433 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1170/2312] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:03:22 2022] DELETE /identity/v3/projects/17f43b9985d348639a44277a85ef1a6f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:03:22.841360 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a6dda-1cda-40cf-9c6e-aa59db206454 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:22.841654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a6dda-1cda-40cf-9c6e-aa59db206454 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:22.841936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a6dda-1cda-40cf-9c6e-aa59db206454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:22.861665 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-d05a6dda-1cda-40cf-9c6e-aa59db206454 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:22.862936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-d05a6dda-1cda-40cf-9c6e-aa59db206454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:22.922521 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1143/2313] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:03:22.934497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2a3c8-efc0-4b1c-9ce3-83048bac5c23 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:22.934822 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2a3c8-efc0-4b1c-9ce3-83048bac5c23 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:22.935110 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2a3c8-efc0-4b1c-9ce3-83048bac5c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:22.955273 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-d9f2a3c8-efc0-4b1c-9ce3-83048bac5c23 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:22.956577 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d9f2a3c8-efc0-4b1c-9ce3-83048bac5c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:22.965052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1171/2314] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:22.969261 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a6dda-1cda-40cf-9c6e-aa59db206454 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:22.981156 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a6dda-1cda-40cf-9c6e-aa59db206454 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:22.985854 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d990e86-4f7f-474f-8059-0a778257c2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:22.986461 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d990e86-4f7f-474f-8059-0a778257c2ac admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:22.986763 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d990e86-4f7f-474f-8059-0a778257c2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:22.987054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d990e86-4f7f-474f-8059-0a778257c2ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:22.987761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d990e86-4f7f-474f-8059-0a778257c2ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:03:22.988088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d990e86-4f7f-474f-8059-0a778257c2ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:22.989689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d990e86-4f7f-474f-8059-0a778257c2ac admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:23.001558 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1144/2315] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:03:23.005902 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2a3c8-efc0-4b1c-9ce3-83048bac5c23 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:23.015279 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2a3c8-efc0-4b1c-9ce3-83048bac5c23 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:23.022200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17380e54-51d3-4d4b-b03d-aaf9545bae37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:23.022847 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17380e54-51d3-4d4b-b03d-aaf9545bae37 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:23.023134 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17380e54-51d3-4d4b-b03d-aaf9545bae37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:23.023410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17380e54-51d3-4d4b-b03d-aaf9545bae37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:23.024083 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17380e54-51d3-4d4b-b03d-aaf9545bae37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:23.025967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17380e54-51d3-4d4b-b03d-aaf9545bae37 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:23.109330 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1172/2316] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:03:23 2022] POST /identity/v3/projects => generated 359 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:03:23.113488 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d990e86-4f7f-474f-8059-0a778257c2ac admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:23.125786 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d990e86-4f7f-474f-8059-0a778257c2ac admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:23.153216 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:23.184656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf0d2a-b5fc-4664-9f52-f86803f65d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:23.185501 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf0d2a-b5fc-4664-9f52-f86803f65d14 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:23.186010 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf0d2a-b5fc-4664-9f52-f86803f65d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:23.186723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf0d2a-b5fc-4664-9f52-f86803f65d14 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:23.187417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf0d2a-b5fc-4664-9f52-f86803f65d14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:23.189354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf0d2a-b5fc-4664-9f52-f86803f65d14 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:23.283961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1145/2317] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:03:23 2022] POST /identity/v3/users => generated 280 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:03:23.287770 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17380e54-51d3-4d4b-b03d-aaf9545bae37 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:23.298150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17380e54-51d3-4d4b-b03d-aaf9545bae37 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:23.303291 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee82a5-73d6-4e84-8400-135e4a719bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:23.303897 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee82a5-73d6-4e84-8400-135e4a719bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:23.304180 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee82a5-73d6-4e84-8400-135e4a719bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:23.304459 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee82a5-73d6-4e84-8400-135e4a719bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:23.305159 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee82a5-73d6-4e84-8400-135e4a719bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:23.306760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee82a5-73d6-4e84-8400-135e4a719bf6 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:23.316459 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1173/2318] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:03:23.320919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf0d2a-b5fc-4664-9f52-f86803f65d14 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:23.330604 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf0d2a-b5fc-4664-9f52-f86803f65d14 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:23.335489 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f4102-ff71-4308-90d5-2271cfaa18b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:23.336093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f4102-ff71-4308-90d5-2271cfaa18b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:23.336383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f4102-ff71-4308-90d5-2271cfaa18b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:23.336659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f4102-ff71-4308-90d5-2271cfaa18b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:23.337384 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f4102-ff71-4308-90d5-2271cfaa18b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:23.339034 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f4102-ff71-4308-90d5-2271cfaa18b5 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:23.349365 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1146/2319] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:03:23.353252 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee82a5-73d6-4e84-8400-135e4a719bf6 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:23.363470 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee82a5-73d6-4e84-8400-135e4a719bf6 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:23.368819 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3bbe4-66cf-401a-8501-85ae66d084d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:23.376006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3bbe4-66cf-401a-8501-85ae66d084d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:23.376006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3bbe4-66cf-401a-8501-85ae66d084d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:23.376006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3bbe4-66cf-401a-8501-85ae66d084d2 admin admin] PATH_INFO: `/v3/projects/8f315ed5541440f8895680816167c101/users/0f5f937e9e3c42e98de7254ed0fc8a1b/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:23.385343 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3bbe4-66cf-401a-8501-85ae66d084d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f315ed5541440f8895680816167c101, user_id=0f5f937e9e3c42e98de7254ed0fc8a1b, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:23.388063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3bbe4-66cf-401a-8501-85ae66d084d2 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:23.460196 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1174/2320] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:03:23 2022] PUT /identity/v3/projects/8f315ed5541440f8895680816167c101/users/0f5f937e9e3c42e98de7254ed0fc8a1b/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:03:23.470309 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580aead-0aa3-4960-b5a1-f3362456de16 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:23.470608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580aead-0aa3-4960-b5a1-f3362456de16 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:23.470929 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580aead-0aa3-4960-b5a1-f3362456de16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:23.499823 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-6580aead-0aa3-4960-b5a1-f3362456de16 None None] MFA Rules not processed for user `0f5f937e9e3c42e98de7254ed0fc8a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:23.501042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-6580aead-0aa3-4960-b5a1-f3362456de16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:23.564040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1147/2321] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:03:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:23.597634 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3bbe4-66cf-401a-8501-85ae66d084d2 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:23.599992 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-99f3bbe4-66cf-401a-8501-85ae66d084d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:23.657638 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3bbe4-66cf-401a-8501-85ae66d084d2 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:23.661774 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7471e02-d41e-476f-8bb0-319ca7563429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:23.662377 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7471e02-d41e-476f-8bb0-319ca7563429 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:23.662659 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7471e02-d41e-476f-8bb0-319ca7563429 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:23.662962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7471e02-d41e-476f-8bb0-319ca7563429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:23.671161 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7471e02-d41e-476f-8bb0-319ca7563429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:23.672569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7471e02-d41e-476f-8bb0-319ca7563429 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:23.681763 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1175/2322] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:23.696541 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580aead-0aa3-4960-b5a1-f3362456de16 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:23.757487 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580aead-0aa3-4960-b5a1-f3362456de16 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:23.761907 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a5a9b-a447-44ca-85df-5574b85b9742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:23.762531 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a5a9b-a447-44ca-85df-5574b85b9742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:23.762857 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a5a9b-a447-44ca-85df-5574b85b9742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:23.763122 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a5a9b-a447-44ca-85df-5574b85b9742 admin admin] PATH_INFO: `/v3/users/0f5f937e9e3c42e98de7254ed0fc8a1b` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:23.764275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a5a9b-a447-44ca-85df-5574b85b9742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f5f937e9e3c42e98de7254ed0fc8a1b)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:23.766178 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a5a9b-a447-44ca-85df-5574b85b9742 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:23.916390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:23.922147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-293a5a9b-a447-44ca-85df-5574b85b9742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f5f937e9e3c42e98de7254ed0fc8a1b'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:23.928894 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-293a5a9b-a447-44ca-85df-5574b85b9742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f5f937e9e3c42e98de7254ed0fc8a1b'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:23.988308 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-293a5a9b-a447-44ca-85df-5574b85b9742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f5f937e9e3c42e98de7254ed0fc8a1b'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:23.992601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-293a5a9b-a447-44ca-85df-5574b85b9742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f5f937e9e3c42e98de7254ed0fc8a1b'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:24.004658 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-293a5a9b-a447-44ca-85df-5574b85b9742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f5f937e9e3c42e98de7254ed0fc8a1b'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:24.010522 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1148/2323] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:03:23 2022] DELETE /identity/v3/users/0f5f937e9e3c42e98de7254ed0fc8a1b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:03:24.015478 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f1130-793b-4f2c-ab30-b509720c71af None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:24.015794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f1130-793b-4f2c-ab30-b509720c71af None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:24.016271 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f1130-793b-4f2c-ab30-b509720c71af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:24.039621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-c18f1130-793b-4f2c-ab30-b509720c71af None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:24.040847 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-c18f1130-793b-4f2c-ab30-b509720c71af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:24.087971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:24.099890 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1176/2324] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:24.109672 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a5a9b-a447-44ca-85df-5574b85b9742 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:24.111134 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-293a5a9b-a447-44ca-85df-5574b85b9742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:24.170280 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a5a9b-a447-44ca-85df-5574b85b9742 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:24.174014 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754e79b-a921-4812-baaa-5f488a24c8dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:24.174641 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754e79b-a921-4812-baaa-5f488a24c8dd service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:24.174947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754e79b-a921-4812-baaa-5f488a24c8dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:24.175230 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754e79b-a921-4812-baaa-5f488a24c8dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:24.185055 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754e79b-a921-4812-baaa-5f488a24c8dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:24.186491 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754e79b-a921-4812-baaa-5f488a24c8dd service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:24.195912 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1149/2325] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:24.576541 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f1130-793b-4f2c-ab30-b509720c71af None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:24.578043 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-c18f1130-793b-4f2c-ab30-b509720c71af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:24.591878 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f1130-793b-4f2c-ab30-b509720c71af None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:24.595375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab02b9-4df3-4b67-8033-825716253342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:24.596029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab02b9-4df3-4b67-8033-825716253342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:24.596321 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab02b9-4df3-4b67-8033-825716253342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:24.596599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab02b9-4df3-4b67-8033-825716253342 admin admin] PATH_INFO: `/v3/projects/8f315ed5541440f8895680816167c101` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:24.597806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab02b9-4df3-4b67-8033-825716253342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f315ed5541440f8895680816167c101)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:24.600390 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab02b9-4df3-4b67-8033-825716253342 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:24.706377 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-aaab02b9-4df3-4b67-8033-825716253342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f315ed5541440f8895680816167c101', 'request_id': 'req-aaab02b9-4df3-4b67-8033-825716253342'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:24.713284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-aaab02b9-4df3-4b67-8033-825716253342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f315ed5541440f8895680816167c101', 'request_id': 'req-aaab02b9-4df3-4b67-8033-825716253342'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:24.801132 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-aaab02b9-4df3-4b67-8033-825716253342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f315ed5541440f8895680816167c101', 'request_id': 'req-aaab02b9-4df3-4b67-8033-825716253342'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:24.813368 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-aaab02b9-4df3-4b67-8033-825716253342 admin admin] The token cache is being invalidate because project 8f315ed5541440f8895680816167c101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:03:24.813665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-aaab02b9-4df3-4b67-8033-825716253342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:24.814306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-aaab02b9-4df3-4b67-8033-825716253342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:24.815898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1177/2326] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:03:24 2022] DELETE /identity/v3/projects/8f315ed5541440f8895680816167c101 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:03:24.821313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43989a5-5b78-49b6-9058-e3969a1c9be5 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:24.821541 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43989a5-5b78-49b6-9058-e3969a1c9be5 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:24.821840 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43989a5-5b78-49b6-9058-e3969a1c9be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:24.841726 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-a43989a5-5b78-49b6-9058-e3969a1c9be5 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:24.842988 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a43989a5-5b78-49b6-9058-e3969a1c9be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:24.904441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1150/2327] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:24.908739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733aeb5-ca25-44d0-8cdb-5b36222f45e6 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:24.909034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733aeb5-ca25-44d0-8cdb-5b36222f45e6 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:24.909319 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733aeb5-ca25-44d0-8cdb-5b36222f45e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:24.929461 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-b733aeb5-ca25-44d0-8cdb-5b36222f45e6 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:24.930682 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b733aeb5-ca25-44d0-8cdb-5b36222f45e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:24.938574 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1178/2328] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:03:24.943276 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43989a5-5b78-49b6-9058-e3969a1c9be5 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:24.952873 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43989a5-5b78-49b6-9058-e3969a1c9be5 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:24.957495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acfdfa-b094-4780-b2b3-3f0f2dadaf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:24.958766 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acfdfa-b094-4780-b2b3-3f0f2dadaf7b admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:24.959070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acfdfa-b094-4780-b2b3-3f0f2dadaf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:24.959348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acfdfa-b094-4780-b2b3-3f0f2dadaf7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:24.960049 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acfdfa-b094-4780-b2b3-3f0f2dadaf7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:03:24.960361 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acfdfa-b094-4780-b2b3-3f0f2dadaf7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:24.961955 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acfdfa-b094-4780-b2b3-3f0f2dadaf7b admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:24.973568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1151/2329] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:03:24.977889 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733aeb5-ca25-44d0-8cdb-5b36222f45e6 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:24.987696 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733aeb5-ca25-44d0-8cdb-5b36222f45e6 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:24.992401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9fa5f-0bef-419f-ad45-df6283ee2ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:24.993043 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9fa5f-0bef-419f-ad45-df6283ee2ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:24.993367 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9fa5f-0bef-419f-ad45-df6283ee2ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:24.993649 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9fa5f-0bef-419f-ad45-df6283ee2ed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:24.994322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9fa5f-0bef-419f-ad45-df6283ee2ed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:24.996281 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9fa5f-0bef-419f-ad45-df6283ee2ed7 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:25.128143 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1179/2330] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:03:24 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:03:25.132776 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acfdfa-b094-4780-b2b3-3f0f2dadaf7b admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:25.142934 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acfdfa-b094-4780-b2b3-3f0f2dadaf7b admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:25.187804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:25.201397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998384e2-40b6-4005-93ab-7443b536d8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:25.202046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998384e2-40b6-4005-93ab-7443b536d8b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:25.202334 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998384e2-40b6-4005-93ab-7443b536d8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:25.202619 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998384e2-40b6-4005-93ab-7443b536d8b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:25.203324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998384e2-40b6-4005-93ab-7443b536d8b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:25.205256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998384e2-40b6-4005-93ab-7443b536d8b2 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:25.303278 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1152/2331] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:03:25 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:03:25.307195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9fa5f-0bef-419f-ad45-df6283ee2ed7 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:25.318095 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9fa5f-0bef-419f-ad45-df6283ee2ed7 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:25.322794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4231d-8d38-4e99-aa2d-268b3446e798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:25.323407 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4231d-8d38-4e99-aa2d-268b3446e798 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:25.323698 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4231d-8d38-4e99-aa2d-268b3446e798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:25.324010 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4231d-8d38-4e99-aa2d-268b3446e798 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:25.324722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4231d-8d38-4e99-aa2d-268b3446e798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:25.326327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4231d-8d38-4e99-aa2d-268b3446e798 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:25.336370 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1180/2332] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:03:25.340389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998384e2-40b6-4005-93ab-7443b536d8b2 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:25.350625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998384e2-40b6-4005-93ab-7443b536d8b2 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:25.355322 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93875a76-bbb9-4779-9d6b-b6bfc04728ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:25.355929 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93875a76-bbb9-4779-9d6b-b6bfc04728ad admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:25.356217 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93875a76-bbb9-4779-9d6b-b6bfc04728ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:25.356497 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93875a76-bbb9-4779-9d6b-b6bfc04728ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:25.357279 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93875a76-bbb9-4779-9d6b-b6bfc04728ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:25.359016 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93875a76-bbb9-4779-9d6b-b6bfc04728ad admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:25.369306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1153/2333] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:03:25.373457 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4231d-8d38-4e99-aa2d-268b3446e798 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:25.386605 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4231d-8d38-4e99-aa2d-268b3446e798 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:25.388847 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec643bbc-30d4-40e9-b8e4-87141c5c3468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:25.389514 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec643bbc-30d4-40e9-b8e4-87141c5c3468 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:25.389805 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec643bbc-30d4-40e9-b8e4-87141c5c3468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:25.390122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec643bbc-30d4-40e9-b8e4-87141c5c3468 admin admin] PATH_INFO: `/v3/projects/6943b1b13bb44aacb0181ab970d0b16e/users/941f4e878afe43fa9114af88a459de5f/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:25.404831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec643bbc-30d4-40e9-b8e4-87141c5c3468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6943b1b13bb44aacb0181ab970d0b16e, user_id=941f4e878afe43fa9114af88a459de5f, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:25.407572 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec643bbc-30d4-40e9-b8e4-87141c5c3468 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:25.474596 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1181/2334] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:03:25 2022] PUT /identity/v3/projects/6943b1b13bb44aacb0181ab970d0b16e/users/941f4e878afe43fa9114af88a459de5f/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:03:25.553324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731d293-21a7-44da-811a-c295f308fc3b None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:25.553704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731d293-21a7-44da-811a-c295f308fc3b None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:25.553992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731d293-21a7-44da-811a-c295f308fc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:25.582850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-1731d293-21a7-44da-811a-c295f308fc3b None None] MFA Rules not processed for user `941f4e878afe43fa9114af88a459de5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:25.584082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-1731d293-21a7-44da-811a-c295f308fc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:25.649750 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1154/2335] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:03:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:25.662458 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec643bbc-30d4-40e9-b8e4-87141c5c3468 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:25.663639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ec643bbc-30d4-40e9-b8e4-87141c5c3468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:25.676703 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951227b-35f4-48e3-b9cc-a70c914d886f None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:25.677510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951227b-35f4-48e3-b9cc-a70c914d886f None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:25.677788 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951227b-35f4-48e3-b9cc-a70c914d886f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:25.696905 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-6951227b-35f4-48e3-b9cc-a70c914d886f None None] MFA Rules not processed for user `b9d70abf4f754530a3cf6efa7a782736`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:25.698142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-6951227b-35f4-48e3-b9cc-a70c914d886f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:25.727437 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec643bbc-30d4-40e9-b8e4-87141c5c3468 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:25.731976 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe9ad6-96f2-4c49-a34c-2d5d84f01992 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:25.732876 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe9ad6-96f2-4c49-a34c-2d5d84f01992 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:25.733729 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe9ad6-96f2-4c49-a34c-2d5d84f01992 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:25.734179 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe9ad6-96f2-4c49-a34c-2d5d84f01992 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:25.746853 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe9ad6-96f2-4c49-a34c-2d5d84f01992 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:25.749045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe9ad6-96f2-4c49-a34c-2d5d84f01992 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:25.759675 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1182/2336] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:25.780023 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1155/2337] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 3 13:03:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:03:25.824357 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe9ad6-96f2-4c49-a34c-2d5d84f01992 service cinder] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:25.826036 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-edbe9ad6-96f2-4c49-a34c-2d5d84f01992 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:25.844793 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:25.898324 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe9ad6-96f2-4c49-a34c-2d5d84f01992 service cinder] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:25.903618 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86a754-e399-4a84-8b3c-aee698edde17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5209ec838a4f45d6b746edb27970c93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:25.904477 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86a754-e399-4a84-8b3c-aee698edde17 service swift] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:25.904775 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86a754-e399-4a84-8b3c-aee698edde17 service swift] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:25.905057 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86a754-e399-4a84-8b3c-aee698edde17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:25.913822 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86a754-e399-4a84-8b3c-aee698edde17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:25.915446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86a754-e399-4a84-8b3c-aee698edde17 service swift] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:25.923591 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1183/2338] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 3 13:03:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 03 13:03:26.798272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951227b-35f4-48e3-b9cc-a70c914d886f None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:26.799943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-6951227b-35f4-48e3-b9cc-a70c914d886f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:26.874818 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951227b-35f4-48e3-b9cc-a70c914d886f None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:26.879837 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9886f-dc16-4961-8588-5d8c27959a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:26.880564 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9886f-dc16-4961-8588-5d8c27959a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:26.881673 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9886f-dc16-4961-8588-5d8c27959a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:26.881959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9886f-dc16-4961-8588-5d8c27959a65 admin admin] PATH_INFO: `/v3/users/062fa418f14c4044a09448fe1437cebd` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:26.883192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9886f-dc16-4961-8588-5d8c27959a65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=062fa418f14c4044a09448fe1437cebd)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:26.885185 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9886f-dc16-4961-8588-5d8c27959a65 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:26.886866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:27.054908 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-1ee9886f-dc16-4961-8588-5d8c27959a65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062fa418f14c4044a09448fe1437cebd'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:27.065071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-1ee9886f-dc16-4961-8588-5d8c27959a65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062fa418f14c4044a09448fe1437cebd'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:27.129391 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-1ee9886f-dc16-4961-8588-5d8c27959a65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062fa418f14c4044a09448fe1437cebd'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:27.130960 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-1ee9886f-dc16-4961-8588-5d8c27959a65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062fa418f14c4044a09448fe1437cebd'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:27.155094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-1ee9886f-dc16-4961-8588-5d8c27959a65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062fa418f14c4044a09448fe1437cebd'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:27.166582 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1156/2339] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:03:26 2022] DELETE /identity/v3/users/062fa418f14c4044a09448fe1437cebd => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:03:27.170995 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643395e6-7f8f-4dc3-855b-5a79336a5d02 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:27.172077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643395e6-7f8f-4dc3-855b-5a79336a5d02 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:27.172639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643395e6-7f8f-4dc3-855b-5a79336a5d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:27.195704 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-643395e6-7f8f-4dc3-855b-5a79336a5d02 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:27.197387 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-643395e6-7f8f-4dc3-855b-5a79336a5d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:27.319660 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1184/2340] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:27.437773 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9886f-dc16-4961-8588-5d8c27959a65 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:27.444543 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-1ee9886f-dc16-4961-8588-5d8c27959a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:27.559388 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9886f-dc16-4961-8588-5d8c27959a65 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:27.563838 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0387569-04b8-4170-9112-f042a69a8bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:27.564564 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0387569-04b8-4170-9112-f042a69a8bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:27.564926 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0387569-04b8-4170-9112-f042a69a8bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:27.565281 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0387569-04b8-4170-9112-f042a69a8bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:27.578984 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0387569-04b8-4170-9112-f042a69a8bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:27.582814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0387569-04b8-4170-9112-f042a69a8bc2 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:27.607782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1157/2341] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:28.126899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643395e6-7f8f-4dc3-855b-5a79336a5d02 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:28.131761 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-643395e6-7f8f-4dc3-855b-5a79336a5d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:28.189596 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643395e6-7f8f-4dc3-855b-5a79336a5d02 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:28.194999 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf7dd5-136f-4133-8714-2be687a5a7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:28.195678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf7dd5-136f-4133-8714-2be687a5a7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:28.195965 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf7dd5-136f-4133-8714-2be687a5a7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:28.196257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf7dd5-136f-4133-8714-2be687a5a7c3 admin admin] PATH_INFO: `/v3/projects/a237b4e912e748c09eb3f9eeaf261d13` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:28.197459 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf7dd5-136f-4133-8714-2be687a5a7c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a237b4e912e748c09eb3f9eeaf261d13)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:28.199594 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf7dd5-136f-4133-8714-2be687a5a7c3 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:28.324694 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-07bf7dd5-136f-4133-8714-2be687a5a7c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a237b4e912e748c09eb3f9eeaf261d13', 'request_id': 'req-07bf7dd5-136f-4133-8714-2be687a5a7c3'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:28.343646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-07bf7dd5-136f-4133-8714-2be687a5a7c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a237b4e912e748c09eb3f9eeaf261d13', 'request_id': 'req-07bf7dd5-136f-4133-8714-2be687a5a7c3'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:28.422889 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-07bf7dd5-136f-4133-8714-2be687a5a7c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a237b4e912e748c09eb3f9eeaf261d13', 'request_id': 'req-07bf7dd5-136f-4133-8714-2be687a5a7c3'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:28.436788 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-07bf7dd5-136f-4133-8714-2be687a5a7c3 admin admin] The token cache is being invalidate because project a237b4e912e748c09eb3f9eeaf261d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:03:28.437127 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-07bf7dd5-136f-4133-8714-2be687a5a7c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:28.437765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-07bf7dd5-136f-4133-8714-2be687a5a7c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:28.439576 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1185/2342] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:03:28 2022] DELETE /identity/v3/projects/a237b4e912e748c09eb3f9eeaf261d13 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:03:37.589499 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=52,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:38.433133 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:43.738543 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7ed99-f60c-4e3c-b1fd-7e8cd598ab60 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:43.739055 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7ed99-f60c-4e3c-b1fd-7e8cd598ab60 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:43.739253 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7ed99-f60c-4e3c-b1fd-7e8cd598ab60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:43.758555 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-ddf7ed99-f60c-4e3c-b1fd-7e8cd598ab60 None None] MFA Rules not processed for user `b9d70abf4f754530a3cf6efa7a782736`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:43.759797 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-ddf7ed99-f60c-4e3c-b1fd-7e8cd598ab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:43.815199 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1158/2343] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 3 13:03:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:43.828233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf7dd5-136f-4133-8714-2be687a5a7c3 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:43.829647 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-07bf7dd5-136f-4133-8714-2be687a5a7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:43.899064 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf7dd5-136f-4133-8714-2be687a5a7c3 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:43.904103 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6063963-40a1-420a-8875-1885cea42f56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5209ec838a4f45d6b746edb27970c93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:43.905011 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6063963-40a1-420a-8875-1885cea42f56 service swift] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:43.911198 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6063963-40a1-420a-8875-1885cea42f56 service swift] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:43.911198 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6063963-40a1-420a-8875-1885cea42f56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:43.913728 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6063963-40a1-420a-8875-1885cea42f56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:43.915338 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6063963-40a1-420a-8875-1885cea42f56 service swift] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:43.923427 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1186/2344] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 3 13:03:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:03:47.089739 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7ed99-f60c-4e3c-b1fd-7e8cd598ab60 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:47.091143 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-ddf7ed99-f60c-4e3c-b1fd-7e8cd598ab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:47.158102 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7ed99-f60c-4e3c-b1fd-7e8cd598ab60 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:47.162708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21255820-6a3a-4e66-b920-43a51c92b233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:47.163397 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21255820-6a3a-4e66-b920-43a51c92b233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:47.163641 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21255820-6a3a-4e66-b920-43a51c92b233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:47.163913 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21255820-6a3a-4e66-b920-43a51c92b233 admin admin] PATH_INFO: `/v3/users/79fd9e0292fb4ebab755519ecc20235e` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:47.165228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21255820-6a3a-4e66-b920-43a51c92b233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79fd9e0292fb4ebab755519ecc20235e)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:47.167357 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21255820-6a3a-4e66-b920-43a51c92b233 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:47.368721 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-21255820-6a3a-4e66-b920-43a51c92b233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79fd9e0292fb4ebab755519ecc20235e'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:47.375623 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-21255820-6a3a-4e66-b920-43a51c92b233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79fd9e0292fb4ebab755519ecc20235e'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:47.456904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-21255820-6a3a-4e66-b920-43a51c92b233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79fd9e0292fb4ebab755519ecc20235e'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:47.457551 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-21255820-6a3a-4e66-b920-43a51c92b233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79fd9e0292fb4ebab755519ecc20235e'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:47.470011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-21255820-6a3a-4e66-b920-43a51c92b233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79fd9e0292fb4ebab755519ecc20235e'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:47.476469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1159/2345] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:03:47 2022] DELETE /identity/v3/users/79fd9e0292fb4ebab755519ecc20235e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:03:47.716067 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6063963-40a1-420a-8875-1885cea42f56 service swift] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:47.727386 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6063963-40a1-420a-8875-1885cea42f56 service swift] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:47.784180 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d6279-dc2e-4ddb-99c9-26265862954d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:47.784857 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d6279-dc2e-4ddb-99c9-26265862954d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:47.785142 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d6279-dc2e-4ddb-99c9-26265862954d admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:47.785417 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d6279-dc2e-4ddb-99c9-26265862954d admin admin] PATH_INFO: `/v3/projects/ef1e829edd5a4a5f8c5133cb5e37c284` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:47.787247 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d6279-dc2e-4ddb-99c9-26265862954d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef1e829edd5a4a5f8c5133cb5e37c284)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:47.789147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d6279-dc2e-4ddb-99c9-26265862954d admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:47.891677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8e7d6279-dc2e-4ddb-99c9-26265862954d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'request_id': 'req-8e7d6279-dc2e-4ddb-99c9-26265862954d'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:47.898376 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8e7d6279-dc2e-4ddb-99c9-26265862954d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'request_id': 'req-8e7d6279-dc2e-4ddb-99c9-26265862954d'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:47.988311 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8e7d6279-dc2e-4ddb-99c9-26265862954d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef1e829edd5a4a5f8c5133cb5e37c284', 'request_id': 'req-8e7d6279-dc2e-4ddb-99c9-26265862954d'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:47.999455 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8e7d6279-dc2e-4ddb-99c9-26265862954d admin admin] The token cache is being invalidate because project ef1e829edd5a4a5f8c5133cb5e37c284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:03:48.003870 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8e7d6279-dc2e-4ddb-99c9-26265862954d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:48.003870 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8e7d6279-dc2e-4ddb-99c9-26265862954d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:48.003870 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1187/2346] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:03:47 2022] DELETE /identity/v3/projects/ef1e829edd5a4a5f8c5133cb5e37c284 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:03:48.007034 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69ad10-1247-4bff-8d3b-2e296fd1ff30 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:48.007350 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69ad10-1247-4bff-8d3b-2e296fd1ff30 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:48.007624 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69ad10-1247-4bff-8d3b-2e296fd1ff30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:48.027473 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-ab69ad10-1247-4bff-8d3b-2e296fd1ff30 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:48.028704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-ab69ad10-1247-4bff-8d3b-2e296fd1ff30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:48.047831 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:48.087978 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1160/2347] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:48.095812 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c92af2-b3a5-4d40-8dd4-144afddcfcb2 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:48.096104 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c92af2-b3a5-4d40-8dd4-144afddcfcb2 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:48.096386 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c92af2-b3a5-4d40-8dd4-144afddcfcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:48.116045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-45c92af2-b3a5-4d40-8dd4-144afddcfcb2 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:48.118759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-45c92af2-b3a5-4d40-8dd4-144afddcfcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:48.125327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1188/2348] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:48.129984 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69ad10-1247-4bff-8d3b-2e296fd1ff30 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:48.139850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69ad10-1247-4bff-8d3b-2e296fd1ff30 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:48.144404 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf733b-eb3d-4314-a06b-71dc8f46e4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:48.145012 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf733b-eb3d-4314-a06b-71dc8f46e4dc admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:48.145830 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf733b-eb3d-4314-a06b-71dc8f46e4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:48.146115 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf733b-eb3d-4314-a06b-71dc8f46e4dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:48.146842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf733b-eb3d-4314-a06b-71dc8f46e4dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:03:48.147151 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf733b-eb3d-4314-a06b-71dc8f46e4dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:48.148756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf733b-eb3d-4314-a06b-71dc8f46e4dc admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:48.160688 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1161/2349] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:03:48.165193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c92af2-b3a5-4d40-8dd4-144afddcfcb2 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:48.174462 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c92af2-b3a5-4d40-8dd4-144afddcfcb2 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:48.179171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003d300-c286-4b11-8ad0-715f0cd1f3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:48.179779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003d300-c286-4b11-8ad0-715f0cd1f3a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:48.180063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003d300-c286-4b11-8ad0-715f0cd1f3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:48.180340 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003d300-c286-4b11-8ad0-715f0cd1f3a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:48.181009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003d300-c286-4b11-8ad0-715f0cd1f3a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:48.182930 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003d300-c286-4b11-8ad0-715f0cd1f3a3 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:48.194482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:48.291137 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1189/2350] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:03:48 2022] POST /identity/v3/projects => generated 363 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:03:48.295319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf733b-eb3d-4314-a06b-71dc8f46e4dc admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:48.305866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf733b-eb3d-4314-a06b-71dc8f46e4dc admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:48.363885 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4a5ec-5182-49ef-a7f4-40ea584511ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:48.364500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4a5ec-5182-49ef-a7f4-40ea584511ec admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:48.364783 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4a5ec-5182-49ef-a7f4-40ea584511ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:48.365061 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4a5ec-5182-49ef-a7f4-40ea584511ec admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:48.365721 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4a5ec-5182-49ef-a7f4-40ea584511ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:48.367729 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4a5ec-5182-49ef-a7f4-40ea584511ec admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:48.466707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1162/2351] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:03:48 2022] POST /identity/v3/users => generated 282 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:03:48.471348 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003d300-c286-4b11-8ad0-715f0cd1f3a3 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:48.481778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003d300-c286-4b11-8ad0-715f0cd1f3a3 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:48.486471 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67aee5-5361-4a79-a647-efc0c42f1cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:48.487119 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67aee5-5361-4a79-a647-efc0c42f1cac admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:48.487444 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67aee5-5361-4a79-a647-efc0c42f1cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:48.487729 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67aee5-5361-4a79-a647-efc0c42f1cac admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:48.488435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67aee5-5361-4a79-a647-efc0c42f1cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:48.490511 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67aee5-5361-4a79-a647-efc0c42f1cac admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:48.500781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1190/2352] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:03:48.505281 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4a5ec-5182-49ef-a7f4-40ea584511ec admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:48.515594 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4a5ec-5182-49ef-a7f4-40ea584511ec admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:48.520655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd56af4-5e83-4801-8625-89ea0db3b6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:48.522021 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd56af4-5e83-4801-8625-89ea0db3b6ed admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:48.522021 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd56af4-5e83-4801-8625-89ea0db3b6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:48.522021 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd56af4-5e83-4801-8625-89ea0db3b6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:48.522640 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd56af4-5e83-4801-8625-89ea0db3b6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:48.524277 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd56af4-5e83-4801-8625-89ea0db3b6ed admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:48.535193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1163/2353] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:03:48.539366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67aee5-5361-4a79-a647-efc0c42f1cac admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:48.549461 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67aee5-5361-4a79-a647-efc0c42f1cac admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:48.554785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f5e4f-4984-408b-99c0-03da3246ba3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:48.555460 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f5e4f-4984-408b-99c0-03da3246ba3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:48.555749 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f5e4f-4984-408b-99c0-03da3246ba3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:48.556033 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f5e4f-4984-408b-99c0-03da3246ba3c admin admin] PATH_INFO: `/v3/projects/3248d8d929a845a98c6d4fd18c760351/users/530b82c311c94474bfa7d3ea1eb1bab2/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:48.609723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f5e4f-4984-408b-99c0-03da3246ba3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3248d8d929a845a98c6d4fd18c760351, user_id=530b82c311c94474bfa7d3ea1eb1bab2, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:48.612581 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f5e4f-4984-408b-99c0-03da3246ba3c admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:48.712461 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1191/2354] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:03:48 2022] PUT /identity/v3/projects/3248d8d929a845a98c6d4fd18c760351/users/530b82c311c94474bfa7d3ea1eb1bab2/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:03:48.723684 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9bdc0-5776-49bc-aa80-7e1403ac66f9 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:48.723995 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9bdc0-5776-49bc-aa80-7e1403ac66f9 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:48.724272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9bdc0-5776-49bc-aa80-7e1403ac66f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:48.751782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-acb9bdc0-5776-49bc-aa80-7e1403ac66f9 None None] MFA Rules not processed for user `530b82c311c94474bfa7d3ea1eb1bab2`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:48.752929 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-acb9bdc0-5776-49bc-aa80-7e1403ac66f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:48.816340 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1164/2355] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:03:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:48.828497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f5e4f-4984-408b-99c0-03da3246ba3c admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:48.830321 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b57f5e4f-4984-408b-99c0-03da3246ba3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:48.887183 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f5e4f-4984-408b-99c0-03da3246ba3c admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:48.890754 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8737af-f78e-4057-863a-8c47be98473b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:48.891367 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8737af-f78e-4057-863a-8c47be98473b service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:48.891650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8737af-f78e-4057-863a-8c47be98473b service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:48.891927 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8737af-f78e-4057-863a-8c47be98473b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:48.900073 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8737af-f78e-4057-863a-8c47be98473b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:48.901478 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8737af-f78e-4057-863a-8c47be98473b service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:48.910602 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1192/2356] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:58.813325 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:58.906533 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:59.399634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9bdc0-5776-49bc-aa80-7e1403ac66f9 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:59.401060 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-acb9bdc0-5776-49bc-aa80-7e1403ac66f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:59.470368 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9bdc0-5776-49bc-aa80-7e1403ac66f9 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:59.475512 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcc4c6-9dce-42bd-b73e-db709bb902d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:59.476147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcc4c6-9dce-42bd-b73e-db709bb902d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:59.476431 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcc4c6-9dce-42bd-b73e-db709bb902d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:59.476706 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcc4c6-9dce-42bd-b73e-db709bb902d1 admin admin] PATH_INFO: `/v3/users/941f4e878afe43fa9114af88a459de5f` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:59.477859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bcc4c6-9dce-42bd-b73e-db709bb902d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=941f4e878afe43fa9114af88a459de5f)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:59.479870 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bcc4c6-9dce-42bd-b73e-db709bb902d1 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:59.653479 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-93bcc4c6-9dce-42bd-b73e-db709bb902d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '941f4e878afe43fa9114af88a459de5f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:59.660709 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-93bcc4c6-9dce-42bd-b73e-db709bb902d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '941f4e878afe43fa9114af88a459de5f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:59.714474 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-93bcc4c6-9dce-42bd-b73e-db709bb902d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '941f4e878afe43fa9114af88a459de5f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:59.715121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-93bcc4c6-9dce-42bd-b73e-db709bb902d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '941f4e878afe43fa9114af88a459de5f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:59.730491 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-93bcc4c6-9dce-42bd-b73e-db709bb902d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '941f4e878afe43fa9114af88a459de5f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:03:59.736474 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1165/2357] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:03:59 2022] DELETE /identity/v3/users/941f4e878afe43fa9114af88a459de5f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:03:59.740919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b8bfd-07d1-4aeb-8219-1e98f5f8c33d None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:59.741306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b8bfd-07d1-4aeb-8219-1e98f5f8c33d None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:59.741591 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b8bfd-07d1-4aeb-8219-1e98f5f8c33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:59.761440 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-3c0b8bfd-07d1-4aeb-8219-1e98f5f8c33d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:59.762661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-3c0b8bfd-07d1-4aeb-8219-1e98f5f8c33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:59.821371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1193/2358] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:59.831271 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcc4c6-9dce-42bd-b73e-db709bb902d1 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:59.832680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-93bcc4c6-9dce-42bd-b73e-db709bb902d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:59.889590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcc4c6-9dce-42bd-b73e-db709bb902d1 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:59.893308 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48b79e-2ead-493b-b4f3-f616a211460f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:59.893925 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48b79e-2ead-493b-b4f3-f616a211460f service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:59.894209 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48b79e-2ead-493b-b4f3-f616a211460f service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:59.894485 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48b79e-2ead-493b-b4f3-f616a211460f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:59.904633 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48b79e-2ead-493b-b4f3-f616a211460f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:59.906488 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48b79e-2ead-493b-b4f3-f616a211460f service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:59.917075 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1166/2359] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:00.325026 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b8bfd-07d1-4aeb-8219-1e98f5f8c33d None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:00.326496 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-3c0b8bfd-07d1-4aeb-8219-1e98f5f8c33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:00.339650 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b8bfd-07d1-4aeb-8219-1e98f5f8c33d None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:00.345437 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71991ee-cd50-4e49-abae-8a569b900ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:00.346095 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71991ee-cd50-4e49-abae-8a569b900ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:00.346384 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71991ee-cd50-4e49-abae-8a569b900ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:00.346772 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71991ee-cd50-4e49-abae-8a569b900ff1 admin admin] PATH_INFO: `/v3/projects/6943b1b13bb44aacb0181ab970d0b16e` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:00.347929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71991ee-cd50-4e49-abae-8a569b900ff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6943b1b13bb44aacb0181ab970d0b16e)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:00.350488 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71991ee-cd50-4e49-abae-8a569b900ff1 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:00.450677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d71991ee-cd50-4e49-abae-8a569b900ff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6943b1b13bb44aacb0181ab970d0b16e', 'request_id': 'req-d71991ee-cd50-4e49-abae-8a569b900ff1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:00.457015 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d71991ee-cd50-4e49-abae-8a569b900ff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6943b1b13bb44aacb0181ab970d0b16e', 'request_id': 'req-d71991ee-cd50-4e49-abae-8a569b900ff1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:00.523685 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d71991ee-cd50-4e49-abae-8a569b900ff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6943b1b13bb44aacb0181ab970d0b16e', 'request_id': 'req-d71991ee-cd50-4e49-abae-8a569b900ff1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:00.535060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d71991ee-cd50-4e49-abae-8a569b900ff1 admin admin] The token cache is being invalidate because project 6943b1b13bb44aacb0181ab970d0b16e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:04:00.535358 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d71991ee-cd50-4e49-abae-8a569b900ff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:00.535998 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d71991ee-cd50-4e49-abae-8a569b900ff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:00.537556 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1194/2360] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:04:00 2022] DELETE /identity/v3/projects/6943b1b13bb44aacb0181ab970d0b16e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:04:00.542631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d4b9f-be1b-4952-94d8-1216a5a6f594 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:00.542968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d4b9f-be1b-4952-94d8-1216a5a6f594 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:00.543256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d4b9f-be1b-4952-94d8-1216a5a6f594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:00.562981 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-658d4b9f-be1b-4952-94d8-1216a5a6f594 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:00.564200 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-658d4b9f-be1b-4952-94d8-1216a5a6f594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:00.581352 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:00.622451 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1167/2361] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:00.630152 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6143099-3665-48fa-87e2-29a80a1aa2a1 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:00.631048 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6143099-3665-48fa-87e2-29a80a1aa2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:00.631337 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6143099-3665-48fa-87e2-29a80a1aa2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:00.650584 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-d6143099-3665-48fa-87e2-29a80a1aa2a1 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:00.651828 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d6143099-3665-48fa-87e2-29a80a1aa2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:00.659972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1195/2362] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:00.664392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d4b9f-be1b-4952-94d8-1216a5a6f594 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:00.674202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d4b9f-be1b-4952-94d8-1216a5a6f594 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:00.679489 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30224471-d922-4230-8713-069f83900797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:00.680108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30224471-d922-4230-8713-069f83900797 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:00.680395 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30224471-d922-4230-8713-069f83900797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:00.680678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30224471-d922-4230-8713-069f83900797 admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:00.681382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30224471-d922-4230-8713-069f83900797 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:04:00.681692 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30224471-d922-4230-8713-069f83900797 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:00.683339 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30224471-d922-4230-8713-069f83900797 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:00.696203 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1168/2363] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:04:00.700539 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6143099-3665-48fa-87e2-29a80a1aa2a1 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:00.710388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6143099-3665-48fa-87e2-29a80a1aa2a1 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:00.715353 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccd388-eede-4857-b153-6d29951a78af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:00.715975 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccd388-eede-4857-b153-6d29951a78af admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:00.716268 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccd388-eede-4857-b153-6d29951a78af admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:00.716548 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccd388-eede-4857-b153-6d29951a78af admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:00.717246 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccd388-eede-4857-b153-6d29951a78af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:00.719264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccd388-eede-4857-b153-6d29951a78af admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:00.833720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1196/2364] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:04:00 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:04:00.838058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30224471-d922-4230-8713-069f83900797 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:00.848478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30224471-d922-4230-8713-069f83900797 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:00.904005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e58b66-ac7b-486f-9c21-3814db673133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:00.904640 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e58b66-ac7b-486f-9c21-3814db673133 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:00.904930 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e58b66-ac7b-486f-9c21-3814db673133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:00.905463 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e58b66-ac7b-486f-9c21-3814db673133 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:00.906135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e58b66-ac7b-486f-9c21-3814db673133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:00.908091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e58b66-ac7b-486f-9c21-3814db673133 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:01.011673 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1169/2365] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:04:00 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:04:01.015938 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccd388-eede-4857-b153-6d29951a78af admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:01.027434 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccd388-eede-4857-b153-6d29951a78af admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:01.033283 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bc497-bcb5-499a-b19a-e282f0481a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:01.033916 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bc497-bcb5-499a-b19a-e282f0481a58 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:01.034204 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bc497-bcb5-499a-b19a-e282f0481a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:01.034494 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bc497-bcb5-499a-b19a-e282f0481a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:01.035240 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bc497-bcb5-499a-b19a-e282f0481a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:01.037543 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bc497-bcb5-499a-b19a-e282f0481a58 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:01.048572 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1197/2366] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:04:01.053733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e58b66-ac7b-486f-9c21-3814db673133 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:01.065053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e58b66-ac7b-486f-9c21-3814db673133 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:01.070324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12302094-e5bc-4fea-b8dc-bc22e18c5885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:01.071043 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12302094-e5bc-4fea-b8dc-bc22e18c5885 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:01.071365 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12302094-e5bc-4fea-b8dc-bc22e18c5885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:01.073209 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12302094-e5bc-4fea-b8dc-bc22e18c5885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:01.073209 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12302094-e5bc-4fea-b8dc-bc22e18c5885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:01.074004 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12302094-e5bc-4fea-b8dc-bc22e18c5885 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:01.089280 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1170/2367] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:04:01.090383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bc497-bcb5-499a-b19a-e282f0481a58 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:01.102749 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bc497-bcb5-499a-b19a-e282f0481a58 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:01.106528 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e29350-bf83-481e-8de4-7e13cf59ff39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:01.107247 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e29350-bf83-481e-8de4-7e13cf59ff39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:01.107541 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e29350-bf83-481e-8de4-7e13cf59ff39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:01.107825 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e29350-bf83-481e-8de4-7e13cf59ff39 admin admin] PATH_INFO: `/v3/projects/7e3f84d832794d82b8fe2f26c7641d12/users/26ef40a0a83a4269b7531a69681637f7/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:01.124375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e29350-bf83-481e-8de4-7e13cf59ff39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e3f84d832794d82b8fe2f26c7641d12, user_id=26ef40a0a83a4269b7531a69681637f7, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:01.127472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e29350-bf83-481e-8de4-7e13cf59ff39 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:01.200518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1198/2368] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:04:01 2022] PUT /identity/v3/projects/7e3f84d832794d82b8fe2f26c7641d12/users/26ef40a0a83a4269b7531a69681637f7/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:04:01.213875 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21a2a9-9c5d-478e-8d53-24d81e2a0e8e None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:01.214088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21a2a9-9c5d-478e-8d53-24d81e2a0e8e None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:01.214365 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21a2a9-9c5d-478e-8d53-24d81e2a0e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:01.244502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-0b21a2a9-9c5d-478e-8d53-24d81e2a0e8e None None] MFA Rules not processed for user `26ef40a0a83a4269b7531a69681637f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:01.245768 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-0b21a2a9-9c5d-478e-8d53-24d81e2a0e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:01.313497 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1171/2369] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:04:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:04:01.325506 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e29350-bf83-481e-8de4-7e13cf59ff39 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:01.327281 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-35e29350-bf83-481e-8de4-7e13cf59ff39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:01.350258 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:01.386257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e29350-bf83-481e-8de4-7e13cf59ff39 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:01.390440 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed20c3-a58b-4b4d-94ce-5d19833344b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:01.391104 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed20c3-a58b-4b4d-94ce-5d19833344b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:01.391396 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed20c3-a58b-4b4d-94ce-5d19833344b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:01.391680 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed20c3-a58b-4b4d-94ce-5d19833344b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:01.401791 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed20c3-a58b-4b4d-94ce-5d19833344b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:01.406692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed20c3-a58b-4b4d-94ce-5d19833344b8 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:01.414268 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1199/2370] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:09.723700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21a2a9-9c5d-478e-8d53-24d81e2a0e8e None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:09.743694 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:09.786858 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21a2a9-9c5d-478e-8d53-24d81e2a0e8e None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:09.791405 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982348e-6383-45a5-acdb-1f4e434233e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:09.792035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982348e-6383-45a5-acdb-1f4e434233e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:09.792317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982348e-6383-45a5-acdb-1f4e434233e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:09.792597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982348e-6383-45a5-acdb-1f4e434233e4 admin admin] PATH_INFO: `/v3/users/26ef40a0a83a4269b7531a69681637f7` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:09.793763 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982348e-6383-45a5-acdb-1f4e434233e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ef40a0a83a4269b7531a69681637f7)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:09.795722 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982348e-6383-45a5-acdb-1f4e434233e4 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:09.991729 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-6982348e-6383-45a5-acdb-1f4e434233e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ef40a0a83a4269b7531a69681637f7'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:09.998842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-6982348e-6383-45a5-acdb-1f4e434233e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ef40a0a83a4269b7531a69681637f7'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:10.056917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-6982348e-6383-45a5-acdb-1f4e434233e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ef40a0a83a4269b7531a69681637f7'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:10.061016 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-6982348e-6383-45a5-acdb-1f4e434233e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ef40a0a83a4269b7531a69681637f7'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:10.069812 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-6982348e-6383-45a5-acdb-1f4e434233e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ef40a0a83a4269b7531a69681637f7'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:10.075745 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1172/2371] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:04:09 2022] DELETE /identity/v3/users/26ef40a0a83a4269b7531a69681637f7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:04:10.080497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0274a-d7fc-4091-9e7a-11bc39be18e4 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:10.080967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0274a-d7fc-4091-9e7a-11bc39be18e4 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:10.081084 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0274a-d7fc-4091-9e7a-11bc39be18e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:10.100066 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-e1c0274a-d7fc-4091-9e7a-11bc39be18e4 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:10.101263 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e1c0274a-d7fc-4091-9e7a-11bc39be18e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:10.165378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1200/2372] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:04:10.175344 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982348e-6383-45a5-acdb-1f4e434233e4 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:10.176837 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-6982348e-6383-45a5-acdb-1f4e434233e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:10.234089 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982348e-6383-45a5-acdb-1f4e434233e4 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:10.237979 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cb711-c2e3-4b54-8af4-d173620f8aa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:10.238627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cb711-c2e3-4b54-8af4-d173620f8aa2 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:10.238946 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cb711-c2e3-4b54-8af4-d173620f8aa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:10.239226 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cb711-c2e3-4b54-8af4-d173620f8aa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:10.248654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cb711-c2e3-4b54-8af4-d173620f8aa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:10.250096 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cb711-c2e3-4b54-8af4-d173620f8aa2 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:10.259848 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1173/2373] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:04:10.686566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0274a-d7fc-4091-9e7a-11bc39be18e4 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:10.688039 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e1c0274a-d7fc-4091-9e7a-11bc39be18e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:10.700837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0274a-d7fc-4091-9e7a-11bc39be18e4 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:10.705525 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157c5ee-f043-450b-ab40-9bd851836589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:10.706180 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157c5ee-f043-450b-ab40-9bd851836589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:10.706465 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157c5ee-f043-450b-ab40-9bd851836589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:10.706783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157c5ee-f043-450b-ab40-9bd851836589 admin admin] PATH_INFO: `/v3/projects/7e3f84d832794d82b8fe2f26c7641d12` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:10.707970 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157c5ee-f043-450b-ab40-9bd851836589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e3f84d832794d82b8fe2f26c7641d12)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:10.710448 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157c5ee-f043-450b-ab40-9bd851836589 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:10.811610 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c157c5ee-f043-450b-ab40-9bd851836589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e3f84d832794d82b8fe2f26c7641d12', 'request_id': 'req-c157c5ee-f043-450b-ab40-9bd851836589'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:10.818236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c157c5ee-f043-450b-ab40-9bd851836589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e3f84d832794d82b8fe2f26c7641d12', 'request_id': 'req-c157c5ee-f043-450b-ab40-9bd851836589'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:10.874264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c157c5ee-f043-450b-ab40-9bd851836589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e3f84d832794d82b8fe2f26c7641d12', 'request_id': 'req-c157c5ee-f043-450b-ab40-9bd851836589'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:10.885543 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c157c5ee-f043-450b-ab40-9bd851836589 admin admin] The token cache is being invalidate because project 7e3f84d832794d82b8fe2f26c7641d12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:04:10.885830 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c157c5ee-f043-450b-ab40-9bd851836589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:10.886454 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c157c5ee-f043-450b-ab40-9bd851836589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:10.888005 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1201/2374] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:04:10 2022] DELETE /identity/v3/projects/7e3f84d832794d82b8fe2f26c7641d12 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:04:10.892836 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48836d36-157d-4592-bfc6-32983889041a None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:10.893366 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48836d36-157d-4592-bfc6-32983889041a None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:10.893584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48836d36-157d-4592-bfc6-32983889041a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:10.917225 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-48836d36-157d-4592-bfc6-32983889041a None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:10.918591 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-48836d36-157d-4592-bfc6-32983889041a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:10.957904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:10.982520 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1174/2375] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:10.990949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176486a1-d4c2-4759-baa0-5cf0c1a291f7 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:10.991245 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176486a1-d4c2-4759-baa0-5cf0c1a291f7 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:10.991530 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176486a1-d4c2-4759-baa0-5cf0c1a291f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:11.011639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-176486a1-d4c2-4759-baa0-5cf0c1a291f7 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:11.012920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-176486a1-d4c2-4759-baa0-5cf0c1a291f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:11.021012 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1202/2376] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:11.025188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48836d36-157d-4592-bfc6-32983889041a None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:11.035122 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48836d36-157d-4592-bfc6-32983889041a None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:11.039878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f71b07-991e-4deb-9f17-c64849273c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:11.040483 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f71b07-991e-4deb-9f17-c64849273c67 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:11.040769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f71b07-991e-4deb-9f17-c64849273c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:11.041050 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f71b07-991e-4deb-9f17-c64849273c67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:11.041819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f71b07-991e-4deb-9f17-c64849273c67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:04:11.042132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f71b07-991e-4deb-9f17-c64849273c67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:11.043771 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f71b07-991e-4deb-9f17-c64849273c67 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:11.055928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1175/2377] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:04:11.060242 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176486a1-d4c2-4759-baa0-5cf0c1a291f7 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:11.070029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176486a1-d4c2-4759-baa0-5cf0c1a291f7 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:11.074667 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595aa47-f5c1-4a33-8c57-d8ffbca44ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:11.075315 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595aa47-f5c1-4a33-8c57-d8ffbca44ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:11.075599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595aa47-f5c1-4a33-8c57-d8ffbca44ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:11.075880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595aa47-f5c1-4a33-8c57-d8ffbca44ff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:11.076557 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595aa47-f5c1-4a33-8c57-d8ffbca44ff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:11.078458 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595aa47-f5c1-4a33-8c57-d8ffbca44ff7 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:11.213655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1203/2378] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:04:11 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:04:11.217780 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f71b07-991e-4deb-9f17-c64849273c67 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:11.228177 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f71b07-991e-4deb-9f17-c64849273c67 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:11.284379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb81e65-ed02-4138-9d41-e41196dcaf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:11.284987 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb81e65-ed02-4138-9d41-e41196dcaf72 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:11.285269 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb81e65-ed02-4138-9d41-e41196dcaf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:11.285544 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb81e65-ed02-4138-9d41-e41196dcaf72 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:11.286212 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb81e65-ed02-4138-9d41-e41196dcaf72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:11.288687 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb81e65-ed02-4138-9d41-e41196dcaf72 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:11.380226 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1176/2379] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:04:11 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:04:11.384350 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595aa47-f5c1-4a33-8c57-d8ffbca44ff7 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:11.397938 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595aa47-f5c1-4a33-8c57-d8ffbca44ff7 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:11.399509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5861d-f54b-4ec1-ab0a-54074c640b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:11.400120 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5861d-f54b-4ec1-ab0a-54074c640b8b admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:11.400403 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5861d-f54b-4ec1-ab0a-54074c640b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:11.400677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5861d-f54b-4ec1-ab0a-54074c640b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:11.401367 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5861d-f54b-4ec1-ab0a-54074c640b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:11.402982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5861d-f54b-4ec1-ab0a-54074c640b8b admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:11.413415 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1204/2380] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:04:11.417246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb81e65-ed02-4138-9d41-e41196dcaf72 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:11.427728 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb81e65-ed02-4138-9d41-e41196dcaf72 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:11.432356 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5efb2-6bbe-4eaa-aa2b-131124210995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:11.432961 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5efb2-6bbe-4eaa-aa2b-131124210995 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:11.433250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5efb2-6bbe-4eaa-aa2b-131124210995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:11.433537 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5efb2-6bbe-4eaa-aa2b-131124210995 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:11.434235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5efb2-6bbe-4eaa-aa2b-131124210995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:11.435856 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5efb2-6bbe-4eaa-aa2b-131124210995 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:11.446216 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1177/2381] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:04:11.450142 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5861d-f54b-4ec1-ab0a-54074c640b8b admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:11.459814 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5861d-f54b-4ec1-ab0a-54074c640b8b admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:11.464379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955d3d7-7aa8-4bbf-9ee8-3f3f07536298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:11.464966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955d3d7-7aa8-4bbf-9ee8-3f3f07536298 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:11.465249 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955d3d7-7aa8-4bbf-9ee8-3f3f07536298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:11.465527 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955d3d7-7aa8-4bbf-9ee8-3f3f07536298 admin admin] PATH_INFO: `/v3/projects/13e4cf5597804239bfa60665a4aef3da/users/9e5912a78e824903b42eb3a4392688c8/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:11.467769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:11.481741 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955d3d7-7aa8-4bbf-9ee8-3f3f07536298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e4cf5597804239bfa60665a4aef3da, user_id=9e5912a78e824903b42eb3a4392688c8, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:11.484430 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955d3d7-7aa8-4bbf-9ee8-3f3f07536298 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:11.560105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1205/2382] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:04:11 2022] PUT /identity/v3/projects/13e4cf5597804239bfa60665a4aef3da/users/9e5912a78e824903b42eb3a4392688c8/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:04:11.570872 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46985ccf-3ab4-4e9e-9047-ce0e4d9e8f4c None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:11.571164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46985ccf-3ab4-4e9e-9047-ce0e4d9e8f4c None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:11.571446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46985ccf-3ab4-4e9e-9047-ce0e4d9e8f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:11.598667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-46985ccf-3ab4-4e9e-9047-ce0e4d9e8f4c None None] MFA Rules not processed for user `9e5912a78e824903b42eb3a4392688c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:11.599919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-46985ccf-3ab4-4e9e-9047-ce0e4d9e8f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:11.663325 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1178/2383] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:04:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:11.673988 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955d3d7-7aa8-4bbf-9ee8-3f3f07536298 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:11.675685 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-8955d3d7-7aa8-4bbf-9ee8-3f3f07536298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:11.731486 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955d3d7-7aa8-4bbf-9ee8-3f3f07536298 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:11.735061 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415e9e9-88f1-4d20-9b32-0a73857e40c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:11.735673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415e9e9-88f1-4d20-9b32-0a73857e40c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:11.735960 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415e9e9-88f1-4d20-9b32-0a73857e40c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:11.736241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415e9e9-88f1-4d20-9b32-0a73857e40c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:11.744843 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415e9e9-88f1-4d20-9b32-0a73857e40c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:11.746266 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415e9e9-88f1-4d20-9b32-0a73857e40c4 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:11.754915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1206/2384] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:14.498371 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff631ca6-b5e6-4580-b32d-452f8511b3c8 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:14.498900 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff631ca6-b5e6-4580-b32d-452f8511b3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:14.499333 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff631ca6-b5e6-4580-b32d-452f8511b3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:14.518341 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-ff631ca6-b5e6-4580-b32d-452f8511b3c8 None None] MFA Rules not processed for user `9e5912a78e824903b42eb3a4392688c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:14.519603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-ff631ca6-b5e6-4580-b32d-452f8511b3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:14.527498 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1179/2385] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:04:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:21.751036 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:23.272794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415e9e9-88f1-4d20-9b32-0a73857e40c4 service cinder] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:23.274142 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-0415e9e9-88f1-4d20-9b32-0a73857e40c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:23.334026 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415e9e9-88f1-4d20-9b32-0a73857e40c4 service cinder] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:23.337935 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14489a-ae05-4299-9e03-6cab77ada631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:23.338547 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14489a-ae05-4299-9e03-6cab77ada631 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:23.338874 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14489a-ae05-4299-9e03-6cab77ada631 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:23.339159 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14489a-ae05-4299-9e03-6cab77ada631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:23.341055 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-7c14489a-ae05-4299-9e03-6cab77ada631 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:23.420748 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14489a-ae05-4299-9e03-6cab77ada631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:23.422988 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14489a-ae05-4299-9e03-6cab77ada631 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:23.435864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1207/2386] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:24.513534 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:24.611361 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff631ca6-b5e6-4580-b32d-452f8511b3c8 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:24.622271 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff631ca6-b5e6-4580-b32d-452f8511b3c8 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:24.625857 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e1a03-02b4-4062-98cb-ef8c9ff3b838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:24.626468 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e1a03-02b4-4062-98cb-ef8c9ff3b838 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:24.626772 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e1a03-02b4-4062-98cb-ef8c9ff3b838 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:24.627048 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e1a03-02b4-4062-98cb-ef8c9ff3b838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:24.628794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-d56e1a03-02b4-4062-98cb-ef8c9ff3b838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:24.642410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e1a03-02b4-4062-98cb-ef8c9ff3b838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:24.643859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e1a03-02b4-4062-98cb-ef8c9ff3b838 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:24.654578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1180/2387] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:29.981904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc748bd3-d494-4cb4-a825-5d07413005d3 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:29.989673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc748bd3-d494-4cb4-a825-5d07413005d3 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:29.989673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc748bd3-d494-4cb4-a825-5d07413005d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:30.001953 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-bc748bd3-d494-4cb4-a825-5d07413005d3 None None] MFA Rules not processed for user `36693fa42a7b41279c8d8c59ecafb243`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:30.003217 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-bc748bd3-d494-4cb4-a825-5d07413005d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:30.058617 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1208/2388] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:04:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:34.649848 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=6 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:37.483726 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ea286-b7e9-47d3-b9a6-31aba518556c None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:37.483726 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ea286-b7e9-47d3-b9a6-31aba518556c None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:37.483726 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ea286-b7e9-47d3-b9a6-31aba518556c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:37.499322 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-ed8ea286-b7e9-47d3-b9a6-31aba518556c None None] MFA Rules not processed for user `b9d70abf4f754530a3cf6efa7a782736`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:37.500545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-ed8ea286-b7e9-47d3-b9a6-31aba518556c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:37.568134 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1181/2389] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 3 13:04:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:37.593004 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc748bd3-d494-4cb4-a825-5d07413005d3 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:37.594464 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-bc748bd3-d494-4cb4-a825-5d07413005d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:37.648857 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:37.679565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc748bd3-d494-4cb4-a825-5d07413005d3 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:37.679565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13003709-63d0-4d8d-98eb-8707d5ad92c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5209ec838a4f45d6b746edb27970c93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:37.679565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13003709-63d0-4d8d-98eb-8707d5ad92c6 service swift] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:37.679565 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13003709-63d0-4d8d-98eb-8707d5ad92c6 service swift] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:37.680050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13003709-63d0-4d8d-98eb-8707d5ad92c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:37.686477 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13003709-63d0-4d8d-98eb-8707d5ad92c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:37.688071 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13003709-63d0-4d8d-98eb-8707d5ad92c6 service swift] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:37.695907 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1209/2390] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 3 13:04:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:04:38.627447 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f171b-0bc1-4753-8615-c7679ddbf4ea None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:38.627934 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f171b-0bc1-4753-8615-c7679ddbf4ea None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:38.628042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f171b-0bc1-4753-8615-c7679ddbf4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:38.647316 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-f29f171b-0bc1-4753-8615-c7679ddbf4ea None None] MFA Rules not processed for user `b9d70abf4f754530a3cf6efa7a782736`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:38.648566 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-f29f171b-0bc1-4753-8615-c7679ddbf4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:38.655977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1182/2391] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 3 13:04:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:38.668236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13003709-63d0-4d8d-98eb-8707d5ad92c6 service swift] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:38.679311 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13003709-63d0-4d8d-98eb-8707d5ad92c6 service swift] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:38.684554 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9a31f-b086-4ded-940a-be95349946fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5209ec838a4f45d6b746edb27970c93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:38.685192 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9a31f-b086-4ded-940a-be95349946fc service swift] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:38.685482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9a31f-b086-4ded-940a-be95349946fc service swift] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:38.685762 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9a31f-b086-4ded-940a-be95349946fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:38.700472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9a31f-b086-4ded-940a-be95349946fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:38.702063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9a31f-b086-4ded-940a-be95349946fc service swift] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:38.710546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1210/2392] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 3 13:04:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:04:39.276718 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c328c7f-92e3-4d8d-9a5c-66152daf42f7 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:39.281469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c328c7f-92e3-4d8d-9a5c-66152daf42f7 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:39.281469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c328c7f-92e3-4d8d-9a5c-66152daf42f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:39.297288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-6c328c7f-92e3-4d8d-9a5c-66152daf42f7 None None] MFA Rules not processed for user `b9d70abf4f754530a3cf6efa7a782736`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:39.298398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-6c328c7f-92e3-4d8d-9a5c-66152daf42f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:39.306170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1183/2393] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 3 13:04:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:39.317885 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9a31f-b086-4ded-940a-be95349946fc service swift] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:39.328579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9a31f-b086-4ded-940a-be95349946fc service swift] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:39.333662 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd316304-bc46-42e1-8c4e-65a97c018655 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5209ec838a4f45d6b746edb27970c93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:39.334275 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd316304-bc46-42e1-8c4e-65a97c018655 service swift] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:39.334561 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd316304-bc46-42e1-8c4e-65a97c018655 service swift] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:39.334875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd316304-bc46-42e1-8c4e-65a97c018655 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:39.343192 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd316304-bc46-42e1-8c4e-65a97c018655 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:39.344763 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd316304-bc46-42e1-8c4e-65a97c018655 service swift] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:39.353241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1211/2394] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 3 13:04:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:04:39.996447 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d25cc-c547-4509-a286-e8af4a3e2cb5 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:39.996962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d25cc-c547-4509-a286-e8af4a3e2cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:39.996962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d25cc-c547-4509-a286-e8af4a3e2cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:40.016581 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-776d25cc-c547-4509-a286-e8af4a3e2cb5 None None] MFA Rules not processed for user `b9d70abf4f754530a3cf6efa7a782736`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:40.017778 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-776d25cc-c547-4509-a286-e8af4a3e2cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:40.025660 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1184/2395] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 3 13:04:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:04:40.037884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd316304-bc46-42e1-8c4e-65a97c018655 service swift] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:40.048287 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd316304-bc46-42e1-8c4e-65a97c018655 service swift] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:40.053302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82795aa-a6ec-46ca-bcb6-855729eb3da8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5209ec838a4f45d6b746edb27970c93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:40.053936 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82795aa-a6ec-46ca-bcb6-855729eb3da8 service swift] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:40.054221 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82795aa-a6ec-46ca-bcb6-855729eb3da8 service swift] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:40.054501 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82795aa-a6ec-46ca-bcb6-855729eb3da8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:40.062529 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82795aa-a6ec-46ca-bcb6-855729eb3da8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:40.064171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82795aa-a6ec-46ca-bcb6-855729eb3da8 service swift] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:40.072641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1212/2396] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 3 13:04:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:04:40.294521 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d25cc-c547-4509-a286-e8af4a3e2cb5 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:40.296018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-776d25cc-c547-4509-a286-e8af4a3e2cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:40.312144 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d25cc-c547-4509-a286-e8af4a3e2cb5 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:40.318021 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26988733-0fa5-4e75-9617-c262df68abbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:40.318704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26988733-0fa5-4e75-9617-c262df68abbe service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:40.319013 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26988733-0fa5-4e75-9617-c262df68abbe service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:40.319313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26988733-0fa5-4e75-9617-c262df68abbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:40.321688 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-26988733-0fa5-4e75-9617-c262df68abbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:40.393427 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26988733-0fa5-4e75-9617-c262df68abbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:40.395354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26988733-0fa5-4e75-9617-c262df68abbe service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:40.404651 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1185/2397] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:42.230844 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82795aa-a6ec-46ca-bcb6-855729eb3da8 service swift] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:42.232205 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-c82795aa-a6ec-46ca-bcb6-855729eb3da8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:42.249435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82795aa-a6ec-46ca-bcb6-855729eb3da8 service swift] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:42.255487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a765e-3776-44fe-ac8d-95b29c8ad002 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:42.260316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a765e-3776-44fe-ac8d-95b29c8ad002 service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:42.260316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a765e-3776-44fe-ac8d-95b29c8ad002 service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:42.260316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a765e-3776-44fe-ac8d-95b29c8ad002 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:42.260316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-047a765e-3776-44fe-ac8d-95b29c8ad002 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:42.269780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a765e-3776-44fe-ac8d-95b29c8ad002 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:42.271440 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a765e-3776-44fe-ac8d-95b29c8ad002 service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:42.285449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1213/2398] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:42.893636 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26988733-0fa5-4e75-9617-c262df68abbe service nova] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:42.961480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26988733-0fa5-4e75-9617-c262df68abbe service nova] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:42.966020 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfc842-e04f-4203-84e7-de74ca70d489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:42.966662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfc842-e04f-4203-84e7-de74ca70d489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:42.966985 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfc842-e04f-4203-84e7-de74ca70d489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:42.967265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfc842-e04f-4203-84e7-de74ca70d489 admin admin] PATH_INFO: `/v3/users/9e5912a78e824903b42eb3a4392688c8` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:42.968433 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfc842-e04f-4203-84e7-de74ca70d489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5912a78e824903b42eb3a4392688c8)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:42.970341 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfc842-e04f-4203-84e7-de74ca70d489 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:43.097968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:43.224865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-76bfc842-e04f-4203-84e7-de74ca70d489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5912a78e824903b42eb3a4392688c8'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:43.232019 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-76bfc842-e04f-4203-84e7-de74ca70d489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5912a78e824903b42eb3a4392688c8'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:43.314291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-76bfc842-e04f-4203-84e7-de74ca70d489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5912a78e824903b42eb3a4392688c8'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:43.314905 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-76bfc842-e04f-4203-84e7-de74ca70d489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5912a78e824903b42eb3a4392688c8'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:43.327895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-76bfc842-e04f-4203-84e7-de74ca70d489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5912a78e824903b42eb3a4392688c8'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:43.333827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1186/2399] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:04:42 2022] DELETE /identity/v3/users/9e5912a78e824903b42eb3a4392688c8 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:04:43.338305 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda901ae-4f4d-4b81-a9ab-256e3d38555f None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:43.340414 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda901ae-4f4d-4b81-a9ab-256e3d38555f None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:43.340414 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda901ae-4f4d-4b81-a9ab-256e3d38555f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:43.357699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-cda901ae-4f4d-4b81-a9ab-256e3d38555f None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:43.358935 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-cda901ae-4f4d-4b81-a9ab-256e3d38555f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:43.417235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1214/2400] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:43.426777 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfc842-e04f-4203-84e7-de74ca70d489 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:43.428194 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-76bfc842-e04f-4203-84e7-de74ca70d489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:43.485777 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfc842-e04f-4203-84e7-de74ca70d489 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:43.489369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3ab20-5ff3-4f7e-9bd6-fa175e2b0b1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:43.489992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3ab20-5ff3-4f7e-9bd6-fa175e2b0b1a service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:43.490257 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3ab20-5ff3-4f7e-9bd6-fa175e2b0b1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:43.490529 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3ab20-5ff3-4f7e-9bd6-fa175e2b0b1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:43.500403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3ab20-5ff3-4f7e-9bd6-fa175e2b0b1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:43.501823 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3ab20-5ff3-4f7e-9bd6-fa175e2b0b1a service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:43.511638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1187/2401] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:43.807421 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda901ae-4f4d-4b81-a9ab-256e3d38555f None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:43.808913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-cda901ae-4f4d-4b81-a9ab-256e3d38555f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:43.821588 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda901ae-4f4d-4b81-a9ab-256e3d38555f None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:43.826438 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccacd5-a7f8-4608-9012-d5a11e0ffa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:43.827173 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccacd5-a7f8-4608-9012-d5a11e0ffa5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:43.832872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccacd5-a7f8-4608-9012-d5a11e0ffa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:43.832872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccacd5-a7f8-4608-9012-d5a11e0ffa5f admin admin] PATH_INFO: `/v3/projects/13e4cf5597804239bfa60665a4aef3da` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:43.832872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccacd5-a7f8-4608-9012-d5a11e0ffa5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=13e4cf5597804239bfa60665a4aef3da)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:43.832872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccacd5-a7f8-4608-9012-d5a11e0ffa5f admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:43.961437 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-2fccacd5-a7f8-4608-9012-d5a11e0ffa5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e4cf5597804239bfa60665a4aef3da', 'request_id': 'req-2fccacd5-a7f8-4608-9012-d5a11e0ffa5f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:43.967728 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-2fccacd5-a7f8-4608-9012-d5a11e0ffa5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e4cf5597804239bfa60665a4aef3da', 'request_id': 'req-2fccacd5-a7f8-4608-9012-d5a11e0ffa5f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:44.029344 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-2fccacd5-a7f8-4608-9012-d5a11e0ffa5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e4cf5597804239bfa60665a4aef3da', 'request_id': 'req-2fccacd5-a7f8-4608-9012-d5a11e0ffa5f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:44.042472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-2fccacd5-a7f8-4608-9012-d5a11e0ffa5f admin admin] The token cache is being invalidate because project 13e4cf5597804239bfa60665a4aef3da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:04:44.042870 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-2fccacd5-a7f8-4608-9012-d5a11e0ffa5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:44.043602 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-2fccacd5-a7f8-4608-9012-d5a11e0ffa5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:44.045338 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1215/2402] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:04:43 2022] DELETE /identity/v3/projects/13e4cf5597804239bfa60665a4aef3da => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:04:48.073482 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3ab20-5ff3-4f7e-9bd6-fa175e2b0b1a service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:48.074930 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3aa3ab20-5ff3-4f7e-9bd6-fa175e2b0b1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:48.088107 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3ab20-5ff3-4f7e-9bd6-fa175e2b0b1a service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:48.142403 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35950f67-6e8e-46a9-9859-86c8cbf0dd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:48.143080 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35950f67-6e8e-46a9-9859-86c8cbf0dd93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:48.143369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35950f67-6e8e-46a9-9859-86c8cbf0dd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:48.143647 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35950f67-6e8e-46a9-9859-86c8cbf0dd93 admin admin] PATH_INFO: `/v3/users/530b82c311c94474bfa7d3ea1eb1bab2` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:48.144822 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35950f67-6e8e-46a9-9859-86c8cbf0dd93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=530b82c311c94474bfa7d3ea1eb1bab2)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:48.146763 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35950f67-6e8e-46a9-9859-86c8cbf0dd93 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:48.338447 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-35950f67-6e8e-46a9-9859-86c8cbf0dd93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '530b82c311c94474bfa7d3ea1eb1bab2'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:48.340002 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:48.346483 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-35950f67-6e8e-46a9-9859-86c8cbf0dd93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '530b82c311c94474bfa7d3ea1eb1bab2'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:48.480817 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-35950f67-6e8e-46a9-9859-86c8cbf0dd93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '530b82c311c94474bfa7d3ea1eb1bab2'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:48.481909 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-35950f67-6e8e-46a9-9859-86c8cbf0dd93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '530b82c311c94474bfa7d3ea1eb1bab2'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:48.495176 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-35950f67-6e8e-46a9-9859-86c8cbf0dd93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '530b82c311c94474bfa7d3ea1eb1bab2'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:48.501282 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1188/2403] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:04:48 2022] DELETE /identity/v3/users/530b82c311c94474bfa7d3ea1eb1bab2 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:04:48.505765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed30ee-dbad-481e-a229-51bcd2aebaa9 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:48.506228 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed30ee-dbad-481e-a229-51bcd2aebaa9 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:48.506430 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed30ee-dbad-481e-a229-51bcd2aebaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:48.523419 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:48.528831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-a4ed30ee-dbad-481e-a229-51bcd2aebaa9 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:48.530056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-a4ed30ee-dbad-481e-a229-51bcd2aebaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:48.589279 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1216/2404] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:48.599252 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35950f67-6e8e-46a9-9859-86c8cbf0dd93 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:48.600817 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-35950f67-6e8e-46a9-9859-86c8cbf0dd93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:48.661775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35950f67-6e8e-46a9-9859-86c8cbf0dd93 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:48.665899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3998698-f545-474a-b35e-2a0d23c997f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:48.666531 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3998698-f545-474a-b35e-2a0d23c997f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:48.666849 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3998698-f545-474a-b35e-2a0d23c997f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:48.667133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3998698-f545-474a-b35e-2a0d23c997f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:48.677193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3998698-f545-474a-b35e-2a0d23c997f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:48.679211 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3998698-f545-474a-b35e-2a0d23c997f2 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:48.690899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1189/2405] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:49.134215 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed30ee-dbad-481e-a229-51bcd2aebaa9 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:49.136789 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-a4ed30ee-dbad-481e-a229-51bcd2aebaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:49.156951 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed30ee-dbad-481e-a229-51bcd2aebaa9 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:49.171373 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74940ed-4711-401e-bb8e-b268a40293b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:49.172059 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74940ed-4711-401e-bb8e-b268a40293b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:49.172377 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74940ed-4711-401e-bb8e-b268a40293b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:49.172651 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74940ed-4711-401e-bb8e-b268a40293b3 admin admin] PATH_INFO: `/v3/projects/3248d8d929a845a98c6d4fd18c760351` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:49.173885 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74940ed-4711-401e-bb8e-b268a40293b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3248d8d929a845a98c6d4fd18c760351)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:49.175894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74940ed-4711-401e-bb8e-b268a40293b3 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:49.282424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e74940ed-4711-401e-bb8e-b268a40293b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3248d8d929a845a98c6d4fd18c760351', 'request_id': 'req-e74940ed-4711-401e-bb8e-b268a40293b3'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:49.289374 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e74940ed-4711-401e-bb8e-b268a40293b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3248d8d929a845a98c6d4fd18c760351', 'request_id': 'req-e74940ed-4711-401e-bb8e-b268a40293b3'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:49.354285 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e74940ed-4711-401e-bb8e-b268a40293b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3248d8d929a845a98c6d4fd18c760351', 'request_id': 'req-e74940ed-4711-401e-bb8e-b268a40293b3'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:49.366265 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e74940ed-4711-401e-bb8e-b268a40293b3 admin admin] The token cache is being invalidate because project 3248d8d929a845a98c6d4fd18c760351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:04:49.366564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e74940ed-4711-401e-bb8e-b268a40293b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:49.367255 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e74940ed-4711-401e-bb8e-b268a40293b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:49.368798 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1217/2406] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:04:49 2022] DELETE /identity/v3/projects/3248d8d929a845a98c6d4fd18c760351 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:04:49.374115 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177055c1-a08f-47d6-80f4-17ad4391ea16 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:49.374599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177055c1-a08f-47d6-80f4-17ad4391ea16 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:49.375465 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177055c1-a08f-47d6-80f4-17ad4391ea16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:49.396347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-177055c1-a08f-47d6-80f4-17ad4391ea16 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:49.398159 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-177055c1-a08f-47d6-80f4-17ad4391ea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:49.457737 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1190/2407] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:04:49.467546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232b149-18a8-4b7f-993e-9635539523ec None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:49.467851 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232b149-18a8-4b7f-993e-9635539523ec None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:49.468127 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232b149-18a8-4b7f-993e-9635539523ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:49.488661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-1232b149-18a8-4b7f-993e-9635539523ec None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:49.489910 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-1232b149-18a8-4b7f-993e-9635539523ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:49.498284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1218/2408] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:49.502614 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177055c1-a08f-47d6-80f4-17ad4391ea16 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:49.513297 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177055c1-a08f-47d6-80f4-17ad4391ea16 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:49.517870 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863ac78-8890-4767-be48-929e17ec64e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:49.518479 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863ac78-8890-4767-be48-929e17ec64e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:49.518856 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863ac78-8890-4767-be48-929e17ec64e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:49.519147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863ac78-8890-4767-be48-929e17ec64e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:49.519876 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863ac78-8890-4767-be48-929e17ec64e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:04:49.520185 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863ac78-8890-4767-be48-929e17ec64e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:49.521800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863ac78-8890-4767-be48-929e17ec64e1 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:49.534968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1191/2409] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:04:49.539286 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232b149-18a8-4b7f-993e-9635539523ec None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:49.548828 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232b149-18a8-4b7f-993e-9635539523ec None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:49.553739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0cc72-e8ac-4cfd-aef4-32fca9131bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:49.554470 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0cc72-e8ac-4cfd-aef4-32fca9131bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:49.554860 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0cc72-e8ac-4cfd-aef4-32fca9131bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:49.555211 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0cc72-e8ac-4cfd-aef4-32fca9131bf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:49.555956 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0cc72-e8ac-4cfd-aef4-32fca9131bf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:49.557947 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0cc72-e8ac-4cfd-aef4-32fca9131bf7 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:49.640498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1219/2410] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:04:49 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:04:49.644490 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863ac78-8890-4767-be48-929e17ec64e1 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:49.655080 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863ac78-8890-4767-be48-929e17ec64e1 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:49.711478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:49.716269 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee26fc2-60dc-484b-8fd0-2b1efdc19818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:49.716971 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee26fc2-60dc-484b-8fd0-2b1efdc19818 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:49.717325 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee26fc2-60dc-484b-8fd0-2b1efdc19818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:49.717677 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee26fc2-60dc-484b-8fd0-2b1efdc19818 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:49.718749 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee26fc2-60dc-484b-8fd0-2b1efdc19818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:49.720969 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee26fc2-60dc-484b-8fd0-2b1efdc19818 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:49.814909 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1192/2411] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:04:49 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:04:49.819048 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0cc72-e8ac-4cfd-aef4-32fca9131bf7 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:49.830604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0cc72-e8ac-4cfd-aef4-32fca9131bf7 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:49.836238 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc6a39-26de-49c1-9b24-20bf36790d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:49.836992 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc6a39-26de-49c1-9b24-20bf36790d80 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:49.837273 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc6a39-26de-49c1-9b24-20bf36790d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:49.837626 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc6a39-26de-49c1-9b24-20bf36790d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:49.838291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee26fc2-60dc-484b-8fd0-2b1efdc19818 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:49.838404 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc6a39-26de-49c1-9b24-20bf36790d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:49.840102 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc6a39-26de-49c1-9b24-20bf36790d80 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:49.840291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-bee26fc2-60dc-484b-8fd0-2b1efdc19818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:49.856946 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1220/2412] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:04:49.858144 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc6a39-26de-49c1-9b24-20bf36790d80 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:49.869351 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc6a39-26de-49c1-9b24-20bf36790d80 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:49.874704 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88deb9-d206-4da2-894e-fc6906ac0924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:49.875337 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88deb9-d206-4da2-894e-fc6906ac0924 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:49.875626 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88deb9-d206-4da2-894e-fc6906ac0924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:49.875911 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88deb9-d206-4da2-894e-fc6906ac0924 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:49.876765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88deb9-d206-4da2-894e-fc6906ac0924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:49.878614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88deb9-d206-4da2-894e-fc6906ac0924 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:49.893675 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1221/2413] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:04:49.894999 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88deb9-d206-4da2-894e-fc6906ac0924 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:49.905924 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88deb9-d206-4da2-894e-fc6906ac0924 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:49.911856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d5733-2c2d-4152-ab57-8715d32bd302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:49.913437 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d5733-2c2d-4152-ab57-8715d32bd302 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:49.913437 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d5733-2c2d-4152-ab57-8715d32bd302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:49.913437 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d5733-2c2d-4152-ab57-8715d32bd302 admin admin] PATH_INFO: `/v3/projects/5c182a81a1c64866944f21c4e26725a3/users/b2ccafac03aa420db7f76165f20b0d3b/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:49.913702 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee26fc2-60dc-484b-8fd0-2b1efdc19818 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:49.917556 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9359e1-c6ba-49e4-b8de-848aeeb7b396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:49.918183 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9359e1-c6ba-49e4-b8de-848aeeb7b396 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:49.918470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9359e1-c6ba-49e4-b8de-848aeeb7b396 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:49.918870 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9359e1-c6ba-49e4-b8de-848aeeb7b396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:49.920707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-ac9359e1-c6ba-49e4-b8de-848aeeb7b396 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:49.930120 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d5733-2c2d-4152-ab57-8715d32bd302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c182a81a1c64866944f21c4e26725a3, user_id=b2ccafac03aa420db7f76165f20b0d3b, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:49.932758 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9359e1-c6ba-49e4-b8de-848aeeb7b396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:49.932929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d5733-2c2d-4152-ab57-8715d32bd302 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:49.934204 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9359e1-c6ba-49e4-b8de-848aeeb7b396 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:49.943400 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1193/2414] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:49.999579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1222/2415] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:04:49 2022] PUT /identity/v3/projects/5c182a81a1c64866944f21c4e26725a3/users/b2ccafac03aa420db7f76165f20b0d3b/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:04:50.004633 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113c362-ac4c-48b0-8133-919228321160 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:50.004926 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113c362-ac4c-48b0-8133-919228321160 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:50.005213 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113c362-ac4c-48b0-8133-919228321160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:50.024970 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-7113c362-ac4c-48b0-8133-919228321160 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:50.026209 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-7113c362-ac4c-48b0-8133-919228321160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:50.097595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1194/2416] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:04:50.112773 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d5733-2c2d-4152-ab57-8715d32bd302 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:50.137021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:50.211899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d5733-2c2d-4152-ab57-8715d32bd302 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:50.219274 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c0cef-b950-47ea-86d8-516554fac96f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:50.220409 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c0cef-b950-47ea-86d8-516554fac96f service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:50.225048 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c0cef-b950-47ea-86d8-516554fac96f service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:50.225048 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c0cef-b950-47ea-86d8-516554fac96f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:50.236822 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c0cef-b950-47ea-86d8-516554fac96f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:50.238835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c0cef-b950-47ea-86d8-516554fac96f service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:50.254402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1223/2417] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:52.228669 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2531d4-b434-477a-9db7-284c003bfd60 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:52.229175 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2531d4-b434-477a-9db7-284c003bfd60 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:52.229311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2531d4-b434-477a-9db7-284c003bfd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:52.248720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-ba2531d4-b434-477a-9db7-284c003bfd60 None None] MFA Rules not processed for user `b9d70abf4f754530a3cf6efa7a782736`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:52.249962 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-ba2531d4-b434-477a-9db7-284c003bfd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:52.313928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1195/2418] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 3 13:04:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:52.328332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c0cef-b950-47ea-86d8-516554fac96f service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:52.329841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b75c0cef-b950-47ea-86d8-516554fac96f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:52.400680 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c0cef-b950-47ea-86d8-516554fac96f service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:52.405777 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7e10d-c8fa-480e-a6ba-fd7353580b39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5209ec838a4f45d6b746edb27970c93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:52.406661 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7e10d-c8fa-480e-a6ba-fd7353580b39 service swift] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:52.406980 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7e10d-c8fa-480e-a6ba-fd7353580b39 service swift] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:52.407258 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7e10d-c8fa-480e-a6ba-fd7353580b39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:52.420858 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7e10d-c8fa-480e-a6ba-fd7353580b39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:52.429856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7e10d-c8fa-480e-a6ba-fd7353580b39 service swift] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:52.439595 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1224/2419] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 3 13:04:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:04:56.721142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3429e-f875-427c-934d-7e7088ec4f79 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:56.721142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3429e-f875-427c-934d-7e7088ec4f79 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:56.721142 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3429e-f875-427c-934d-7e7088ec4f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:56.767361 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-36b3429e-f875-427c-934d-7e7088ec4f79 None None] MFA Rules not processed for user `b2ccafac03aa420db7f76165f20b0d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:56.768775 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-36b3429e-f875-427c-934d-7e7088ec4f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:56.829382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:56.901016 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1196/2420] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:04:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:56.905334 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7e10d-c8fa-480e-a6ba-fd7353580b39 service swift] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:56.917404 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7e10d-c8fa-480e-a6ba-fd7353580b39 service swift] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:56.923025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877e57b-7fa1-4136-b242-52e59195169f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:56.923798 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877e57b-7fa1-4136-b242-52e59195169f admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:56.924083 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877e57b-7fa1-4136-b242-52e59195169f admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:56.924357 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877e57b-7fa1-4136-b242-52e59195169f admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:56.925044 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877e57b-7fa1-4136-b242-52e59195169f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:56.927156 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877e57b-7fa1-4136-b242-52e59195169f admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:57.055978 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1225/2421] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:04:56 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:04:57.057821 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3429e-f875-427c-934d-7e7088ec4f79 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:57.072009 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3429e-f875-427c-934d-7e7088ec4f79 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:57.155770 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3626f1e-0b7e-4e45-b2af-f95c4ab1cb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:57.157518 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3626f1e-0b7e-4e45-b2af-f95c4ab1cb43 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:57.157900 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3626f1e-0b7e-4e45-b2af-f95c4ab1cb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:57.158177 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3626f1e-0b7e-4e45-b2af-f95c4ab1cb43 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:57.159810 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3626f1e-0b7e-4e45-b2af-f95c4ab1cb43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:57.163059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3626f1e-0b7e-4e45-b2af-f95c4ab1cb43 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:57.251442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1197/2422] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:04:57 2022] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:04:57.252120 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877e57b-7fa1-4136-b242-52e59195169f admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:57.267440 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877e57b-7fa1-4136-b242-52e59195169f admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:57.273752 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d8120-8ba3-4820-bf56-b43b7b4ebb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:57.275285 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d8120-8ba3-4820-bf56-b43b7b4ebb0a admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:57.278590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d8120-8ba3-4820-bf56-b43b7b4ebb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:57.278590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d8120-8ba3-4820-bf56-b43b7b4ebb0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:57.278590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d8120-8ba3-4820-bf56-b43b7b4ebb0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:57.278882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d8120-8ba3-4820-bf56-b43b7b4ebb0a admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:57.295579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1226/2423] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:04:57.297283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3626f1e-0b7e-4e45-b2af-f95c4ab1cb43 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:57.310180 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3626f1e-0b7e-4e45-b2af-f95c4ab1cb43 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:57.316699 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa5322-9db8-4f3f-bfe4-ae8c9e63b476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:57.318655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa5322-9db8-4f3f-bfe4-ae8c9e63b476 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:57.318655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa5322-9db8-4f3f-bfe4-ae8c9e63b476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:57.318655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa5322-9db8-4f3f-bfe4-ae8c9e63b476 admin admin] PATH_INFO: `/v3/projects/ef5a4f37fa144d23b0b9d4c235d79076/users/1d73ebbe6f644792bbdb475138ceebd1/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:57.340479 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa5322-9db8-4f3f-bfe4-ae8c9e63b476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5a4f37fa144d23b0b9d4c235d79076, user_id=1d73ebbe6f644792bbdb475138ceebd1, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:57.343415 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa5322-9db8-4f3f-bfe4-ae8c9e63b476 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:57.417629 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1198/2424] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:04:57 2022] PUT /identity/v3/projects/ef5a4f37fa144d23b0b9d4c235d79076/users/1d73ebbe6f644792bbdb475138ceebd1/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:04:57.421464 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d8120-8ba3-4820-bf56-b43b7b4ebb0a admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:57.437502 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d8120-8ba3-4820-bf56-b43b7b4ebb0a admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:57.515186 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620aaab1-3b0b-4941-b730-f574868df4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:57.515340 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620aaab1-3b0b-4941-b730-f574868df4fa admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:57.515654 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620aaab1-3b0b-4941-b730-f574868df4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:57.515922 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620aaab1-3b0b-4941-b730-f574868df4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:57.516678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620aaab1-3b0b-4941-b730-f574868df4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:57.518840 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620aaab1-3b0b-4941-b730-f574868df4fa admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:57.539082 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1227/2425] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:04:57.543723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa5322-9db8-4f3f-bfe4-ae8c9e63b476 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:57.556873 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa5322-9db8-4f3f-bfe4-ae8c9e63b476 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:57.571235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63955e91-23c9-42df-9d74-5e607beaaaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:57.571934 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63955e91-23c9-42df-9d74-5e607beaaaa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:57.572216 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63955e91-23c9-42df-9d74-5e607beaaaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:57.572486 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63955e91-23c9-42df-9d74-5e607beaaaa2 admin admin] PATH_INFO: `/v3/projects/ef5a4f37fa144d23b0b9d4c235d79076/users/1d73ebbe6f644792bbdb475138ceebd1/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:57.575234 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63955e91-23c9-42df-9d74-5e607beaaaa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5a4f37fa144d23b0b9d4c235d79076, user_id=1d73ebbe6f644792bbdb475138ceebd1, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:57.577999 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63955e91-23c9-42df-9d74-5e607beaaaa2 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:57.596092 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1199/2426] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:04:57 2022] PUT /identity/v3/projects/ef5a4f37fa144d23b0b9d4c235d79076/users/1d73ebbe6f644792bbdb475138ceebd1/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:05:04.582510 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1ec1c-7a42-457d-a4e1-0ffa9a8e4c44 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:04.583177 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1ec1c-7a42-457d-a4e1-0ffa9a8e4c44 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:04.583418 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1ec1c-7a42-457d-a4e1-0ffa9a8e4c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:04.613448 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:04.629583 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-53e1ec1c-7a42-457d-a4e1-0ffa9a8e4c44 None None] MFA Rules not processed for user `1d73ebbe6f644792bbdb475138ceebd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:05:04.631542 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-53e1ec1c-7a42-457d-a4e1-0ffa9a8e4c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:05:04.803178 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1228/2427] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:05:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:05:04.813829 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63955e91-23c9-42df-9d74-5e607beaaaa2 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:05:04.829200 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-63955e91-23c9-42df-9d74-5e607beaaaa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:05:04.930316 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63955e91-23c9-42df-9d74-5e607beaaaa2 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:05:04.937176 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6056ea8-4ca9-4f38-9f04-ec5026f1adc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:05:04.937938 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6056ea8-4ca9-4f38-9f04-ec5026f1adc6 service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:04.938391 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6056ea8-4ca9-4f38-9f04-ec5026f1adc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:04.938812 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6056ea8-4ca9-4f38-9f04-ec5026f1adc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:04.949343 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:05.013226 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6056ea8-4ca9-4f38-9f04-ec5026f1adc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:05:05.014926 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6056ea8-4ca9-4f38-9f04-ec5026f1adc6 service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:05:05.027918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1200/2428] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:05:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:05:13.099498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1ec1c-7a42-457d-a4e1-0ffa9a8e4c44 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:05:13.101162 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-53e1ec1c-7a42-457d-a4e1-0ffa9a8e4c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:05:13.163974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1ec1c-7a42-457d-a4e1-0ffa9a8e4c44 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:05:13.168031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2845298-1ae9-4830-8967-14b15e191442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:05:13.168657 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2845298-1ae9-4830-8967-14b15e191442 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:13.168943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2845298-1ae9-4830-8967-14b15e191442 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:13.169222 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2845298-1ae9-4830-8967-14b15e191442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:13.171056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-c2845298-1ae9-4830-8967-14b15e191442 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:05:13.181068 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2845298-1ae9-4830-8967-14b15e191442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:05:13.183424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2845298-1ae9-4830-8967-14b15e191442 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:05:13.192818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1229/2429] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:05:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:05:13.556560 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dd256-6156-4b7d-8d06-73ecddf5f83e None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:13.557117 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dd256-6156-4b7d-8d06-73ecddf5f83e None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:13.557117 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dd256-6156-4b7d-8d06-73ecddf5f83e None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:13.558399 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1201/2430] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 3 13:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:05:13.564223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48f417-1294-42b3-a63f-805bdaf97b4f None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:13.564721 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48f417-1294-42b3-a63f-805bdaf97b4f None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:13.565094 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48f417-1294-42b3-a63f-805bdaf97b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:13.586159 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-7b48f417-1294-42b3-a63f-805bdaf97b4f None None] MFA Rules not processed for user `bc939818c9224b0ebe2dbaa1eaaec5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:05:13.587417 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-7b48f417-1294-42b3-a63f-805bdaf97b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:05:13.598134 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1230/2431] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 3 13:05:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:05:13.609932 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dd256-6156-4b7d-8d06-73ecddf5f83e None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:05:13.611802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-d46dd256-6156-4b7d-8d06-73ecddf5f83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:05:13.673592 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dd256-6156-4b7d-8d06-73ecddf5f83e None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:05:13.677466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c09b5b-b18d-45e2-a6cc-f85ee86564a0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74b99f03a7c14a2e89384dcca532dc61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:05:13.678102 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c09b5b-b18d-45e2-a6cc-f85ee86564a0 service glance] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:13.678386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c09b5b-b18d-45e2-a6cc-f85ee86564a0 service glance] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:13.678663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c09b5b-b18d-45e2-a6cc-f85ee86564a0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:13.689998 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c09b5b-b18d-45e2-a6cc-f85ee86564a0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:05:13.691473 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c09b5b-b18d-45e2-a6cc-f85ee86564a0 service glance] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:05:13.702024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1202/2432] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:05:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:05:13.910621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0050f2-a8d7-44c9-b99f-33276a028393 None None] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:13.910964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0050f2-a8d7-44c9-b99f-33276a028393 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:13.911252 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0050f2-a8d7-44c9-b99f-33276a028393 None None] PATH_INFO: `/` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:13.913902 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1231/2433] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 3 13:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:05:13.918046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae8b53-5069-46dd-a48c-78010681ca7a None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:13.918826 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae8b53-5069-46dd-a48c-78010681ca7a None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:13.919115 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae8b53-5069-46dd-a48c-78010681ca7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:13.940662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-60ae8b53-5069-46dd-a48c-78010681ca7a None None] MFA Rules not processed for user `05c4c07ff52c43ebb5056484eac94afa`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:05:13.941906 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-60ae8b53-5069-46dd-a48c-78010681ca7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:05:13.948787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1203/2434] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 3 13:05:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:05:13.960920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0050f2-a8d7-44c9-b99f-33276a028393 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:05:13.973096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0050f2-a8d7-44c9-b99f-33276a028393 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:05:13.976828 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c813e42-5ca4-40e1-a205-7639186dfbc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:05:13.977449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c813e42-5ca4-40e1-a205-7639186dfbc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:13.977738 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c813e42-5ca4-40e1-a205-7639186dfbc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:13.978022 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c813e42-5ca4-40e1-a205-7639186dfbc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:13.986845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c813e42-5ca4-40e1-a205-7639186dfbc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:05:13.988264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c813e42-5ca4-40e1-a205-7639186dfbc2 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:05:13.995892 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1232/2435] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:05:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:05:14.080973 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c0c00-71a6-43f7-a953-6ba678da16c9 None None] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:14.081342 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c0c00-71a6-43f7-a953-6ba678da16c9 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:14.081627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c0c00-71a6-43f7-a953-6ba678da16c9 None None] PATH_INFO: `/` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:14.083027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1204/2436] 10.222.0.64 () {54 vars in 921 bytes} [Wed Aug 3 13:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:05:14.088462 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe7f6c-865a-4b3e-ae87-551570e2282c None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:14.088684 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe7f6c-865a-4b3e-ae87-551570e2282c None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:14.088959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe7f6c-865a-4b3e-ae87-551570e2282c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:14.109712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-dbfe7f6c-865a-4b3e-ae87-551570e2282c None None] MFA Rules not processed for user `bc939818c9224b0ebe2dbaa1eaaec5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:05:14.110945 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-dbfe7f6c-865a-4b3e-ae87-551570e2282c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:05:14.120345 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1233/2437] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Aug 3 13:05:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:05:14.130925 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c0c00-71a6-43f7-a953-6ba678da16c9 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:05:14.145746 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c0c00-71a6-43f7-a953-6ba678da16c9 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:05:14.149383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325658ba-a973-45a7-a315-be8b5617371f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:05:14.150128 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325658ba-a973-45a7-a315-be8b5617371f service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:14.151112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325658ba-a973-45a7-a315-be8b5617371f service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:14.151399 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325658ba-a973-45a7-a315-be8b5617371f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:14.163174 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325658ba-a973-45a7-a315-be8b5617371f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:05:14.164754 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325658ba-a973-45a7-a315-be8b5617371f service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:05:14.176091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1205/2438] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:05:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:05:14.239310 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe7f6c-865a-4b3e-ae87-551570e2282c None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:05:14.240785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-dbfe7f6c-865a-4b3e-ae87-551570e2282c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:05:14.309937 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe7f6c-865a-4b3e-ae87-551570e2282c None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:05:14.315067 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7206012-c88f-44ca-a63f-a8ceb695e162 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de27d25fad634658a1abcb776d9a7b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:05:14.315688 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7206012-c88f-44ca-a63f-a8ceb695e162 service placement] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:14.316074 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7206012-c88f-44ca-a63f-a8ceb695e162 service placement] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:14.316232 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7206012-c88f-44ca-a63f-a8ceb695e162 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:14.318007 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e7206012-c88f-44ca-a63f-a8ceb695e162 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:05:14.330484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7206012-c88f-44ca-a63f-a8ceb695e162 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:05:14.332096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7206012-c88f-44ca-a63f-a8ceb695e162 service placement] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:05:14.342598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1234/2439] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:05:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:05:18.322699 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca596d-4bf2-4161-b70f-2c89b3c0e8f8 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:18.323749 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca596d-4bf2-4161-b70f-2c89b3c0e8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:18.323892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca596d-4bf2-4161-b70f-2c89b3c0e8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:18.343975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-06ca596d-4bf2-4161-b70f-2c89b3c0e8f8 None None] MFA Rules not processed for user `b9d70abf4f754530a3cf6efa7a782736`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:05:18.345477 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-06ca596d-4bf2-4161-b70f-2c89b3c0e8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:05:18.407202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1206/2440] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 3 13:05:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:05:18.427480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7206012-c88f-44ca-a63f-a8ceb695e162 service placement] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:05:18.431888 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:18.498129 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7206012-c88f-44ca-a63f-a8ceb695e162 service placement] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:05:18.503078 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f02cb6-fa42-43b9-b69d-498136bf245b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5209ec838a4f45d6b746edb27970c93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:05:18.503692 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f02cb6-fa42-43b9-b69d-498136bf245b service swift] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:18.503972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f02cb6-fa42-43b9-b69d-498136bf245b service swift] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:18.504246 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f02cb6-fa42-43b9-b69d-498136bf245b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:18.514793 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f02cb6-fa42-43b9-b69d-498136bf245b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:05:18.516903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f02cb6-fa42-43b9-b69d-498136bf245b service swift] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:05:18.529552 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1235/2441] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 3 13:05:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:05:18.620599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca596d-4bf2-4161-b70f-2c89b3c0e8f8 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:05:18.634528 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca596d-4bf2-4161-b70f-2c89b3c0e8f8 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:05:18.641086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c512c-d1b6-42de-ba38-d745d9222d48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:05:18.642936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c512c-d1b6-42de-ba38-d745d9222d48 service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:18.642936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c512c-d1b6-42de-ba38-d745d9222d48 service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:18.642936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c512c-d1b6-42de-ba38-d745d9222d48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:18.644279 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-f27c512c-d1b6-42de-ba38-d745d9222d48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:05:18.692809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:18.716680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c512c-d1b6-42de-ba38-d745d9222d48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:05:18.718861 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c512c-d1b6-42de-ba38-d745d9222d48 service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:05:18.732788 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1207/2442] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:05:18 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:05:28.521227 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=31 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:28.726473 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=10 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:34.296585 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b5e61-76b5-4d8d-a578-dcf42173a658 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:34.297150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b5e61-76b5-4d8d-a578-dcf42173a658 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:34.297150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b5e61-76b5-4d8d-a578-dcf42173a658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:34.317225 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-cd2b5e61-76b5-4d8d-a578-dcf42173a658 None None] MFA Rules not processed for user `b2ccafac03aa420db7f76165f20b0d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:05:34.318434 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-cd2b5e61-76b5-4d8d-a578-dcf42173a658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:05:34.325534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1236/2443] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:05:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:05:34.644053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c512c-d1b6-42de-ba38-d745d9222d48 service nova] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:05:34.654004 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c512c-d1b6-42de-ba38-d745d9222d48 service nova] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:05:34.657895 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63777054-8c8d-4fac-b385-bcb998c468ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:05:34.658506 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63777054-8c8d-4fac-b385-bcb998c468ff service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:34.658824 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63777054-8c8d-4fac-b385-bcb998c468ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:34.659105 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63777054-8c8d-4fac-b385-bcb998c468ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:34.660880 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-63777054-8c8d-4fac-b385-bcb998c468ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:05:34.670417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63777054-8c8d-4fac-b385-bcb998c468ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:05:34.671883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63777054-8c8d-4fac-b385-bcb998c468ff service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:05:34.682177 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1208/2444] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:05:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:05:41.562484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b5e61-76b5-4d8d-a578-dcf42173a658 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:05:41.564110 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-cd2b5e61-76b5-4d8d-a578-dcf42173a658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:05:41.591337 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b5e61-76b5-4d8d-a578-dcf42173a658 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:05:41.597765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df277100-2b92-4cc3-b3a3-6f8c1a3c0564 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:05:41.598519 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df277100-2b92-4cc3-b3a3-6f8c1a3c0564 service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:41.598838 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df277100-2b92-4cc3-b3a3-6f8c1a3c0564 service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:41.599120 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df277100-2b92-4cc3-b3a3-6f8c1a3c0564 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:41.600926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-df277100-2b92-4cc3-b3a3-6f8c1a3c0564 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:05:41.615062 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df277100-2b92-4cc3-b3a3-6f8c1a3c0564 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:05:41.616648 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df277100-2b92-4cc3-b3a3-6f8c1a3c0564 service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:05:41.627871 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1237/2445] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:05:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:05:44.676250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=6 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:47.456531 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63777054-8c8d-4fac-b385-bcb998c468ff service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:05:47.470173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63777054-8c8d-4fac-b385-bcb998c468ff service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:05:47.481386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c3c86-d5bb-4a81-8298-5ecdacf7b93e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:05:47.481386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c3c86-d5bb-4a81-8298-5ecdacf7b93e service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:47.481386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c3c86-d5bb-4a81-8298-5ecdacf7b93e service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:47.481386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c3c86-d5bb-4a81-8298-5ecdacf7b93e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:47.481766 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-fa2c3c86-d5bb-4a81-8298-5ecdacf7b93e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:05:47.491283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c3c86-d5bb-4a81-8298-5ecdacf7b93e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:05:47.492959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c3c86-d5bb-4a81-8298-5ecdacf7b93e service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:05:47.504134 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1209/2446] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:05:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:05:51.414150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d133f4b-9e94-4376-8ca7-96f911f24b4a None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:51.414594 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d133f4b-9e94-4376-8ca7-96f911f24b4a None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:51.414726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d133f4b-9e94-4376-8ca7-96f911f24b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:51.434861 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-9d133f4b-9e94-4376-8ca7-96f911f24b4a None None] MFA Rules not processed for user `b9d70abf4f754530a3cf6efa7a782736`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:05:51.436121 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-9d133f4b-9e94-4376-8ca7-96f911f24b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:05:51.445245 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1238/2447] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 3 13:05:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:05:51.467754 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c3c86-d5bb-4a81-8298-5ecdacf7b93e service nova] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:05:51.479911 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c3c86-d5bb-4a81-8298-5ecdacf7b93e service nova] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:05:51.484848 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada37c33-7fc6-4daa-8d5e-1d260e6a41bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5209ec838a4f45d6b746edb27970c93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:05:51.485458 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada37c33-7fc6-4daa-8d5e-1d260e6a41bd service swift] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:51.485741 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada37c33-7fc6-4daa-8d5e-1d260e6a41bd service swift] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:51.486013 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada37c33-7fc6-4daa-8d5e-1d260e6a41bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:51.494580 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada37c33-7fc6-4daa-8d5e-1d260e6a41bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:05:51.497165 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada37c33-7fc6-4daa-8d5e-1d260e6a41bd service swift] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:05:51.504377 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1210/2448] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 3 13:05:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:05:59.300861 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d133f4b-9e94-4376-8ca7-96f911f24b4a None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:05:59.305450 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=13 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:05:59.310990 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d133f4b-9e94-4376-8ca7-96f911f24b4a None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:05:59.314543 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c3765-e8f8-4fa2-a2c2-abe04754d392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:05:59.315250 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c3765-e8f8-4fa2-a2c2-abe04754d392 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:05:59.315535 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c3765-e8f8-4fa2-a2c2-abe04754d392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:05:59.315810 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c3765-e8f8-4fa2-a2c2-abe04754d392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:05:59.325326 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c3765-e8f8-4fa2-a2c2-abe04754d392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:05:59.326872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c3765-e8f8-4fa2-a2c2-abe04754d392 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:05:59.336383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1239/2449] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:05:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:06:01.501212 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=12 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:06:08.376934 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698ff85-c524-4d8f-ab32-8468dee0a567 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:08.377610 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698ff85-c524-4d8f-ab32-8468dee0a567 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:08.377610 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698ff85-c524-4d8f-ab32-8468dee0a567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:08.395990 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-e698ff85-c524-4d8f-ab32-8468dee0a567 None None] MFA Rules not processed for user `bb5f78a0ee0642c7bbde2ecf34e090d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:06:08.397196 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e698ff85-c524-4d8f-ab32-8468dee0a567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:06:08.404606 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1211/2450] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:06:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:06:09.337289 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=5 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:06:15.863619 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c3765-e8f8-4fa2-a2c2-abe04754d392 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:06:15.877350 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c3765-e8f8-4fa2-a2c2-abe04754d392 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:06:15.882844 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1be6ed-fa4d-45b5-b896-65b6dc75ba74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:06:15.883454 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1be6ed-fa4d-45b5-b896-65b6dc75ba74 service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:15.883740 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1be6ed-fa4d-45b5-b896-65b6dc75ba74 service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:15.884014 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1be6ed-fa4d-45b5-b896-65b6dc75ba74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:15.885748 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-cc1be6ed-fa4d-45b5-b896-65b6dc75ba74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:06:15.899830 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1be6ed-fa4d-45b5-b896-65b6dc75ba74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:06:15.901393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1be6ed-fa4d-45b5-b896-65b6dc75ba74 service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:06:15.912162 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1240/2451] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:06:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:06:18.391429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:06:25.907497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=6 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:06:43.767233 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698ff85-c524-4d8f-ab32-8468dee0a567 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:06:43.781375 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698ff85-c524-4d8f-ab32-8468dee0a567 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:06:43.788283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088c4fe-b287-4651-a6d0-90ecdae57b6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:06:43.788904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088c4fe-b287-4651-a6d0-90ecdae57b6e service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:43.789193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088c4fe-b287-4651-a6d0-90ecdae57b6e service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:43.789474 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088c4fe-b287-4651-a6d0-90ecdae57b6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:43.791459 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-9088c4fe-b287-4651-a6d0-90ecdae57b6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:06:43.855616 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088c4fe-b287-4651-a6d0-90ecdae57b6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:06:43.857358 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088c4fe-b287-4651-a6d0-90ecdae57b6e service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:06:43.866959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1212/2452] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:06:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:06:48.130843 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cf415-5a07-4c8b-ad18-716d0a65fa8e None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:48.132398 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cf415-5a07-4c8b-ad18-716d0a65fa8e None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:48.132398 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cf415-5a07-4c8b-ad18-716d0a65fa8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:48.152112 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-015cf415-5a07-4c8b-ad18-716d0a65fa8e None None] MFA Rules not processed for user `36693fa42a7b41279c8d8c59ecafb243`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:06:48.153359 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-015cf415-5a07-4c8b-ad18-716d0a65fa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:06:48.208732 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1241/2453] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:06:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:06:53.862481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=28 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:06:54.929387 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbbd1c-fea0-4dfd-aff2-5f050575c921 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:54.929965 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbbd1c-fea0-4dfd-aff2-5f050575c921 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:54.930196 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbbd1c-fea0-4dfd-aff2-5f050575c921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:54.949593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-45cbbd1c-fea0-4dfd-aff2-5f050575c921 None None] MFA Rules not processed for user `b9d70abf4f754530a3cf6efa7a782736`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:06:54.950880 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-45cbbd1c-fea0-4dfd-aff2-5f050575c921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:06:54.958305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1213/2454] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 3 13:06:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:06:55.094515 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015cf415-5a07-4c8b-ad18-716d0a65fa8e None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:06:55.107275 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015cf415-5a07-4c8b-ad18-716d0a65fa8e None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:06:55.112394 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a2d27-e5d1-418d-8277-75a9656726e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5209ec838a4f45d6b746edb27970c93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:06:55.113134 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a2d27-e5d1-418d-8277-75a9656726e7 service swift] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:55.113429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a2d27-e5d1-418d-8277-75a9656726e7 service swift] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:55.113709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a2d27-e5d1-418d-8277-75a9656726e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:55.122558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a2d27-e5d1-418d-8277-75a9656726e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:06:55.124309 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a2d27-e5d1-418d-8277-75a9656726e7 service swift] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:06:55.133076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1242/2455] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 3 13:06:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:06:56.177583 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cbbd1c-fea0-4dfd-aff2-5f050575c921 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:06:56.187530 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cbbd1c-fea0-4dfd-aff2-5f050575c921 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:06:56.191137 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb56f7-9f8e-4ddf-8f66-3ffda6474338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:06:56.191742 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb56f7-9f8e-4ddf-8f66-3ffda6474338 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:56.192023 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb56f7-9f8e-4ddf-8f66-3ffda6474338 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:56.192297 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb56f7-9f8e-4ddf-8f66-3ffda6474338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:56.194009 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-aceb56f7-9f8e-4ddf-8f66-3ffda6474338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:06:56.257007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb56f7-9f8e-4ddf-8f66-3ffda6474338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:06:56.258449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb56f7-9f8e-4ddf-8f66-3ffda6474338 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:06:56.268741 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1214/2456] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:06:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:07:00.120669 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a2d27-e5d1-418d-8277-75a9656726e7 service swift] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:00.123145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ed1a2d27-e5d1-418d-8277-75a9656726e7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:00.146589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a2d27-e5d1-418d-8277-75a9656726e7 service swift] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:00.158843 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bb7ac-dc0b-4c22-85fc-6301fd42ef70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de27d25fad634658a1abcb776d9a7b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:00.159491 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bb7ac-dc0b-4c22-85fc-6301fd42ef70 service placement] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:00.159777 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bb7ac-dc0b-4c22-85fc-6301fd42ef70 service placement] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:00.160055 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bb7ac-dc0b-4c22-85fc-6301fd42ef70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:00.161929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ef0bb7ac-dc0b-4c22-85fc-6301fd42ef70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:00.175415 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bb7ac-dc0b-4c22-85fc-6301fd42ef70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:00.176999 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bb7ac-dc0b-4c22-85fc-6301fd42ef70 service placement] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:00.187831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1243/2457] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:07:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:07:04.119613 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb56f7-9f8e-4ddf-8f66-3ffda6474338 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:04.131848 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb56f7-9f8e-4ddf-8f66-3ffda6474338 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:04.138056 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820b554-b5ab-44b7-b6c5-395a58bc9589 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de27d25fad634658a1abcb776d9a7b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:04.138957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820b554-b5ab-44b7-b6c5-395a58bc9589 service placement] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:04.139438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820b554-b5ab-44b7-b6c5-395a58bc9589 service placement] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:04.139882 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820b554-b5ab-44b7-b6c5-395a58bc9589 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:04.146399 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3820b554-b5ab-44b7-b6c5-395a58bc9589 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:04.162031 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820b554-b5ab-44b7-b6c5-395a58bc9589 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:04.162579 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820b554-b5ab-44b7-b6c5-395a58bc9589 service placement] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:04.174457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1215/2458] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:07:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:07:04.299434 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bb7ac-dc0b-4c22-85fc-6301fd42ef70 service placement] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:04.301055 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ef0bb7ac-dc0b-4c22-85fc-6301fd42ef70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:04.316081 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bb7ac-dc0b-4c22-85fc-6301fd42ef70 service placement] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:04.321613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b0fc2-17f8-40e1-8235-23e3ace2ceb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:04.322298 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b0fc2-17f8-40e1-8235-23e3ace2ceb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:04.322613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b0fc2-17f8-40e1-8235-23e3ace2ceb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:04.322908 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b0fc2-17f8-40e1-8235-23e3ace2ceb3 admin admin] PATH_INFO: `/v3/users/8ab708da71f04d2ab83f3f438a8d49d0` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:04.325637 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b0fc2-17f8-40e1-8235-23e3ace2ceb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab708da71f04d2ab83f3f438a8d49d0)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:04.328373 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b0fc2-17f8-40e1-8235-23e3ace2ceb3 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:04.550892 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-091b0fc2-17f8-40e1-8235-23e3ace2ceb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab708da71f04d2ab83f3f438a8d49d0'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:04.557979 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-091b0fc2-17f8-40e1-8235-23e3ace2ceb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab708da71f04d2ab83f3f438a8d49d0'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:04.558683 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-091b0fc2-17f8-40e1-8235-23e3ace2ceb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab708da71f04d2ab83f3f438a8d49d0'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:04.570669 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-091b0fc2-17f8-40e1-8235-23e3ace2ceb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab708da71f04d2ab83f3f438a8d49d0'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:04.571351 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-091b0fc2-17f8-40e1-8235-23e3ace2ceb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab708da71f04d2ab83f3f438a8d49d0'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:04.653308 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1244/2459] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:07:04 2022] DELETE /identity/v3/users/8ab708da71f04d2ab83f3f438a8d49d0 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:07:04.898507 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820b554-b5ab-44b7-b6c5-395a58bc9589 service placement] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:04.911398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820b554-b5ab-44b7-b6c5-395a58bc9589 service placement] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:04.971168 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5cf06-cb67-4745-b643-47e68d72ec99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:04.971812 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5cf06-cb67-4745-b643-47e68d72ec99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:04.972099 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5cf06-cb67-4745-b643-47e68d72ec99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:04.972379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5cf06-cb67-4745-b643-47e68d72ec99 admin admin] PATH_INFO: `/v3/projects/e62db2c6c7d846ff807ac67c8d8d715e` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:04.973548 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5cf06-cb67-4745-b643-47e68d72ec99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e62db2c6c7d846ff807ac67c8d8d715e)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:04.975507 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5cf06-cb67-4745-b643-47e68d72ec99 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:05.084170 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-9dc5cf06-cb67-4745-b643-47e68d72ec99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e62db2c6c7d846ff807ac67c8d8d715e', 'request_id': 'req-9dc5cf06-cb67-4745-b643-47e68d72ec99'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:05.091049 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-9dc5cf06-cb67-4745-b643-47e68d72ec99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e62db2c6c7d846ff807ac67c8d8d715e', 'request_id': 'req-9dc5cf06-cb67-4745-b643-47e68d72ec99'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:05.169089 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-9dc5cf06-cb67-4745-b643-47e68d72ec99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e62db2c6c7d846ff807ac67c8d8d715e', 'request_id': 'req-9dc5cf06-cb67-4745-b643-47e68d72ec99'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:05.180159 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-9dc5cf06-cb67-4745-b643-47e68d72ec99 admin admin] The token cache is being invalidate because project e62db2c6c7d846ff807ac67c8d8d715e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:07:05.180453 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-9dc5cf06-cb67-4745-b643-47e68d72ec99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:05.181105 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-9dc5cf06-cb67-4745-b643-47e68d72ec99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:05.183219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1216/2460] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:07:04 2022] DELETE /identity/v3/projects/e62db2c6c7d846ff807ac67c8d8d715e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:07:05.187335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b0fc2-17f8-40e1-8235-23e3ace2ceb3 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:05.188735 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-091b0fc2-17f8-40e1-8235-23e3ace2ceb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:05.202471 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b0fc2-17f8-40e1-8235-23e3ace2ceb3 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:05.250607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:05.260103 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce92f2-fcd4-40e5-b43e-96c33b6cbe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:05.265739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce92f2-fcd4-40e5-b43e-96c33b6cbe08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:05.265739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce92f2-fcd4-40e5-b43e-96c33b6cbe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:05.265739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce92f2-fcd4-40e5-b43e-96c33b6cbe08 admin admin] PATH_INFO: `/v3/users/d2c02a724d934c878c079287662105d8` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:05.265739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce92f2-fcd4-40e5-b43e-96c33b6cbe08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2c02a724d934c878c079287662105d8)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:05.265739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce92f2-fcd4-40e5-b43e-96c33b6cbe08 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:05.506762 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-bdce92f2-fcd4-40e5-b43e-96c33b6cbe08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2c02a724d934c878c079287662105d8'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:05.514199 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-bdce92f2-fcd4-40e5-b43e-96c33b6cbe08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2c02a724d934c878c079287662105d8'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:05.514931 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-bdce92f2-fcd4-40e5-b43e-96c33b6cbe08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2c02a724d934c878c079287662105d8'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:05.528326 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-bdce92f2-fcd4-40e5-b43e-96c33b6cbe08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2c02a724d934c878c079287662105d8'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:05.529013 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-bdce92f2-fcd4-40e5-b43e-96c33b6cbe08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2c02a724d934c878c079287662105d8'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:05.577255 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1245/2461] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:07:05 2022] DELETE /identity/v3/users/d2c02a724d934c878c079287662105d8 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:07:05.812688 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5cf06-cb67-4745-b643-47e68d72ec99 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:05.814146 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-9dc5cf06-cb67-4745-b643-47e68d72ec99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:05.823460 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:05.827776 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5cf06-cb67-4745-b643-47e68d72ec99 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:05.885726 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83b544-72e7-4c72-8416-fbf5159a3b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:05.886338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83b544-72e7-4c72-8416-fbf5159a3b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:05.886626 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83b544-72e7-4c72-8416-fbf5159a3b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:05.886937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83b544-72e7-4c72-8416-fbf5159a3b92 admin admin] PATH_INFO: `/v3/projects/9f93d5e79ca5423981816c5c149af717` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:05.888111 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83b544-72e7-4c72-8416-fbf5159a3b92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f93d5e79ca5423981816c5c149af717)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:05.890033 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83b544-72e7-4c72-8416-fbf5159a3b92 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:06.046123 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-5b83b544-72e7-4c72-8416-fbf5159a3b92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f93d5e79ca5423981816c5c149af717', 'request_id': 'req-5b83b544-72e7-4c72-8416-fbf5159a3b92'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:06.052441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-5b83b544-72e7-4c72-8416-fbf5159a3b92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f93d5e79ca5423981816c5c149af717', 'request_id': 'req-5b83b544-72e7-4c72-8416-fbf5159a3b92'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:06.148093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-5b83b544-72e7-4c72-8416-fbf5159a3b92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f93d5e79ca5423981816c5c149af717', 'request_id': 'req-5b83b544-72e7-4c72-8416-fbf5159a3b92'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:06.161560 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-5b83b544-72e7-4c72-8416-fbf5159a3b92 admin admin] The token cache is being invalidate because project 9f93d5e79ca5423981816c5c149af717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:07:06.161560 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-5b83b544-72e7-4c72-8416-fbf5159a3b92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:06.161852 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-5b83b544-72e7-4c72-8416-fbf5159a3b92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:06.163294 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1217/2462] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:07:05 2022] DELETE /identity/v3/projects/9f93d5e79ca5423981816c5c149af717 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:07:12.006840 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dca6fb-e65e-4740-91cf-edab69928f88 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:12.007340 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dca6fb-e65e-4740-91cf-edab69928f88 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:12.007467 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dca6fb-e65e-4740-91cf-edab69928f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:12.027196 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-a3dca6fb-e65e-4740-91cf-edab69928f88 None None] MFA Rules not processed for user `6ec4b53cb3a64c3aa9cb6a186a61c1fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:07:12.028401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-a3dca6fb-e65e-4740-91cf-edab69928f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:12.084739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1246/2463] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:07:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:07:16.157415 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=49,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:22.077989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:32.546810 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83b544-72e7-4c72-8416-fbf5159a3b92 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:32.548421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-5b83b544-72e7-4c72-8416-fbf5159a3b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:32.760179 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83b544-72e7-4c72-8416-fbf5159a3b92 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:32.765855 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898368c9-db25-4b5c-8761-8c8dc67432ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de27d25fad634658a1abcb776d9a7b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:32.766482 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898368c9-db25-4b5c-8761-8c8dc67432ae service placement] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:32.766809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898368c9-db25-4b5c-8761-8c8dc67432ae service placement] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:32.767128 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898368c9-db25-4b5c-8761-8c8dc67432ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:32.769013 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-898368c9-db25-4b5c-8761-8c8dc67432ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:32.783103 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898368c9-db25-4b5c-8761-8c8dc67432ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:32.784971 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898368c9-db25-4b5c-8761-8c8dc67432ae service placement] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:32.796658 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1218/2464] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:07:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:07:42.791303 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=63 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:45.067742 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dca6fb-e65e-4740-91cf-edab69928f88 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:45.069155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-a3dca6fb-e65e-4740-91cf-edab69928f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:45.160489 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dca6fb-e65e-4740-91cf-edab69928f88 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:45.164316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e0e84-9148-4ac4-aacc-837bd778f3c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:45.164939 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e0e84-9148-4ac4-aacc-837bd778f3c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:45.165226 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e0e84-9148-4ac4-aacc-837bd778f3c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:45.165506 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e0e84-9148-4ac4-aacc-837bd778f3c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:45.167857 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-097e0e84-9148-4ac4-aacc-837bd778f3c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:45.250751 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e0e84-9148-4ac4-aacc-837bd778f3c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:45.252195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e0e84-9148-4ac4-aacc-837bd778f3c6 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:45.271548 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1247/2465] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:07:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:07:48.897492 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898368c9-db25-4b5c-8761-8c8dc67432ae service placement] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:48.900973 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-898368c9-db25-4b5c-8761-8c8dc67432ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:48.915817 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898368c9-db25-4b5c-8761-8c8dc67432ae service placement] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:48.920929 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf0378-8687-4bc7-80e2-c957ac983ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:48.921599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf0378-8687-4bc7-80e2-c957ac983ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:48.921885 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf0378-8687-4bc7-80e2-c957ac983ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:48.922158 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf0378-8687-4bc7-80e2-c957ac983ed0 admin admin] PATH_INFO: `/v3/users/bb5f78a0ee0642c7bbde2ecf34e090d0` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:48.923357 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf0378-8687-4bc7-80e2-c957ac983ed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb5f78a0ee0642c7bbde2ecf34e090d0)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:48.925270 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf0378-8687-4bc7-80e2-c957ac983ed0 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:49.102012 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-77bf0378-8687-4bc7-80e2-c957ac983ed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb5f78a0ee0642c7bbde2ecf34e090d0'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:49.109563 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-77bf0378-8687-4bc7-80e2-c957ac983ed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb5f78a0ee0642c7bbde2ecf34e090d0'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:49.180215 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-77bf0378-8687-4bc7-80e2-c957ac983ed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb5f78a0ee0642c7bbde2ecf34e090d0'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:49.180896 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-77bf0378-8687-4bc7-80e2-c957ac983ed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb5f78a0ee0642c7bbde2ecf34e090d0'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:49.194084 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-77bf0378-8687-4bc7-80e2-c957ac983ed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb5f78a0ee0642c7bbde2ecf34e090d0'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:49.199959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1219/2466] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:07:48 2022] DELETE /identity/v3/users/bb5f78a0ee0642c7bbde2ecf34e090d0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:07:49.438957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e0e84-9148-4ac4-aacc-837bd778f3c6 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:49.448919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e0e84-9148-4ac4-aacc-837bd778f3c6 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:49.493904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:49.505253 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c954a7-5b75-4b6f-a5fc-45f29082773b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:49.505881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c954a7-5b75-4b6f-a5fc-45f29082773b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:49.506171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c954a7-5b75-4b6f-a5fc-45f29082773b admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:49.506448 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c954a7-5b75-4b6f-a5fc-45f29082773b admin admin] PATH_INFO: `/v3/projects/6be1056fe005471f83a0633c99c0b349` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:49.507628 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c954a7-5b75-4b6f-a5fc-45f29082773b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6be1056fe005471f83a0633c99c0b349)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:49.509548 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c954a7-5b75-4b6f-a5fc-45f29082773b admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:49.627881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e9c954a7-5b75-4b6f-a5fc-45f29082773b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be1056fe005471f83a0633c99c0b349', 'request_id': 'req-e9c954a7-5b75-4b6f-a5fc-45f29082773b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:49.634090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e9c954a7-5b75-4b6f-a5fc-45f29082773b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be1056fe005471f83a0633c99c0b349', 'request_id': 'req-e9c954a7-5b75-4b6f-a5fc-45f29082773b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:49.690432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e9c954a7-5b75-4b6f-a5fc-45f29082773b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be1056fe005471f83a0633c99c0b349', 'request_id': 'req-e9c954a7-5b75-4b6f-a5fc-45f29082773b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:49.702015 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e9c954a7-5b75-4b6f-a5fc-45f29082773b admin admin] The token cache is being invalidate because project 6be1056fe005471f83a0633c99c0b349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:07:49.702249 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e9c954a7-5b75-4b6f-a5fc-45f29082773b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:49.702921 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e9c954a7-5b75-4b6f-a5fc-45f29082773b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:49.704537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1248/2467] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:07:49 2022] DELETE /identity/v3/projects/6be1056fe005471f83a0633c99c0b349 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:07:49.709579 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9113a-cb61-4e13-9e17-9c560bb7a585 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:49.709874 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9113a-cb61-4e13-9e17-9c560bb7a585 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:49.710158 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9113a-cb61-4e13-9e17-9c560bb7a585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:49.769800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-23e9113a-cb61-4e13-9e17-9c560bb7a585 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:07:49.771050 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-23e9113a-cb61-4e13-9e17-9c560bb7a585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:49.828932 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1220/2468] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:07:49.837455 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a8a01-3775-4ce1-b47b-968de9b0c432 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:49.837750 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a8a01-3775-4ce1-b47b-968de9b0c432 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:49.838063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a8a01-3775-4ce1-b47b-968de9b0c432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:49.858317 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-eb0a8a01-3775-4ce1-b47b-968de9b0c432 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:07:49.859573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-eb0a8a01-3775-4ce1-b47b-968de9b0c432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:49.867569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1249/2469] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:07:49.871976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9113a-cb61-4e13-9e17-9c560bb7a585 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:49.881927 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9113a-cb61-4e13-9e17-9c560bb7a585 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:49.887021 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e5820-a88e-46fc-b63e-3df317b1e5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:49.887625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e5820-a88e-46fc-b63e-3df317b1e5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:49.887907 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e5820-a88e-46fc-b63e-3df317b1e5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:49.888183 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e5820-a88e-46fc-b63e-3df317b1e5e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:49.888872 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e5820-a88e-46fc-b63e-3df317b1e5e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:07:49.889177 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e5820-a88e-46fc-b63e-3df317b1e5e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:49.890789 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e5820-a88e-46fc-b63e-3df317b1e5e5 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:49.902943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1221/2470] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:07:49.907271 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a8a01-3775-4ce1-b47b-968de9b0c432 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:49.916759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a8a01-3775-4ce1-b47b-968de9b0c432 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:49.921421 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682d7e2-d8df-44cb-a8b2-3f4a2adccd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:49.922019 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d7e2-d8df-44cb-a8b2-3f4a2adccd3a admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:49.922303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d7e2-d8df-44cb-a8b2-3f4a2adccd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:49.922582 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d7e2-d8df-44cb-a8b2-3f4a2adccd3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:49.923291 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682d7e2-d8df-44cb-a8b2-3f4a2adccd3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:49.925157 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682d7e2-d8df-44cb-a8b2-3f4a2adccd3a admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:50.010038 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1250/2471] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:07:49 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:07:50.014696 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e5820-a88e-46fc-b63e-3df317b1e5e5 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:50.024777 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e5820-a88e-46fc-b63e-3df317b1e5e5 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:50.051338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:50.082620 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5daa6-2f59-41af-bf8e-6fe9e81ce003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:50.083300 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5daa6-2f59-41af-bf8e-6fe9e81ce003 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:50.083798 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5daa6-2f59-41af-bf8e-6fe9e81ce003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:50.084467 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5daa6-2f59-41af-bf8e-6fe9e81ce003 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:50.085215 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5daa6-2f59-41af-bf8e-6fe9e81ce003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:50.087283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5daa6-2f59-41af-bf8e-6fe9e81ce003 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:50.200289 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1222/2472] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:07:50 2022] POST /identity/v3/users => generated 284 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:07:50.204463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682d7e2-d8df-44cb-a8b2-3f4a2adccd3a admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:50.215019 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682d7e2-d8df-44cb-a8b2-3f4a2adccd3a admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:50.219875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19991374-d7c7-4adb-a5ca-d536373b9de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:50.220488 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19991374-d7c7-4adb-a5ca-d536373b9de9 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:50.220774 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19991374-d7c7-4adb-a5ca-d536373b9de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:50.221052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19991374-d7c7-4adb-a5ca-d536373b9de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:50.221747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19991374-d7c7-4adb-a5ca-d536373b9de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:50.223378 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19991374-d7c7-4adb-a5ca-d536373b9de9 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:50.233278 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1251/2473] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:07:50.239875 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5daa6-2f59-41af-bf8e-6fe9e81ce003 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:50.250485 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5daa6-2f59-41af-bf8e-6fe9e81ce003 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:50.255405 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991a5e2-d7f6-4bf6-9333-785a24822eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:50.256011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991a5e2-d7f6-4bf6-9333-785a24822eae admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:50.256300 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991a5e2-d7f6-4bf6-9333-785a24822eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:50.256578 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991a5e2-d7f6-4bf6-9333-785a24822eae admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:50.257274 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991a5e2-d7f6-4bf6-9333-785a24822eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:50.258897 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991a5e2-d7f6-4bf6-9333-785a24822eae admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:50.269293 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1223/2474] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:07:50.273361 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19991374-d7c7-4adb-a5ca-d536373b9de9 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:50.283608 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19991374-d7c7-4adb-a5ca-d536373b9de9 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:50.288513 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8219689-1b1c-4a06-830d-03d19d30b587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:50.289174 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8219689-1b1c-4a06-830d-03d19d30b587 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:50.289460 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8219689-1b1c-4a06-830d-03d19d30b587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:50.289741 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8219689-1b1c-4a06-830d-03d19d30b587 admin admin] PATH_INFO: `/v3/projects/b97bf5ab901748a1a803940ad34826f6/users/de7b4e5bf5cf4a66aaf018ec6eb78963/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:50.304076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8219689-1b1c-4a06-830d-03d19d30b587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97bf5ab901748a1a803940ad34826f6, user_id=de7b4e5bf5cf4a66aaf018ec6eb78963, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:50.306711 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8219689-1b1c-4a06-830d-03d19d30b587 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:50.411016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1252/2475] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:07:50 2022] PUT /identity/v3/projects/b97bf5ab901748a1a803940ad34826f6/users/de7b4e5bf5cf4a66aaf018ec6eb78963/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:07:50.421716 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfa55e-584b-4bcf-acd9-9408396b08a2 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:50.422012 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfa55e-584b-4bcf-acd9-9408396b08a2 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:50.422297 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfa55e-584b-4bcf-acd9-9408396b08a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:50.450799 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-cbdfa55e-584b-4bcf-acd9-9408396b08a2 None None] MFA Rules not processed for user `de7b4e5bf5cf4a66aaf018ec6eb78963`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:07:50.452020 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-cbdfa55e-584b-4bcf-acd9-9408396b08a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:50.520322 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1224/2476] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:07:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:07:50.524786 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8219689-1b1c-4a06-830d-03d19d30b587 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:50.586456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8219689-1b1c-4a06-830d-03d19d30b587 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:50.591168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c7cd5-1e31-48f7-903b-06e141702cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:50.591784 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c7cd5-1e31-48f7-903b-06e141702cfd admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:50.592069 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c7cd5-1e31-48f7-903b-06e141702cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:50.592350 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c7cd5-1e31-48f7-903b-06e141702cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:50.593025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c7cd5-1e31-48f7-903b-06e141702cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:50.594942 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c7cd5-1e31-48f7-903b-06e141702cfd admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:50.701709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:50.709816 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1253/2477] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:07:50 2022] POST /identity/v3/projects => generated 369 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:07:50.712205 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfa55e-584b-4bcf-acd9-9408396b08a2 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:50.723424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfa55e-584b-4bcf-acd9-9408396b08a2 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:50.780367 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de2673-b3b9-4f97-bd0e-ccec95e94148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:50.780918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de2673-b3b9-4f97-bd0e-ccec95e94148 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:50.781207 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de2673-b3b9-4f97-bd0e-ccec95e94148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:50.781485 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de2673-b3b9-4f97-bd0e-ccec95e94148 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:50.782168 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de2673-b3b9-4f97-bd0e-ccec95e94148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:50.784460 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de2673-b3b9-4f97-bd0e-ccec95e94148 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:50.889761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1225/2478] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:07:50 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:07:50.893758 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c7cd5-1e31-48f7-903b-06e141702cfd admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:50.905076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c7cd5-1e31-48f7-903b-06e141702cfd admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:50.909896 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b749f-1686-4af7-b50b-44b3577fd99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:50.910503 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b749f-1686-4af7-b50b-44b3577fd99c admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:50.910822 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b749f-1686-4af7-b50b-44b3577fd99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:50.911103 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b749f-1686-4af7-b50b-44b3577fd99c admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:50.911822 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b749f-1686-4af7-b50b-44b3577fd99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:50.913400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b749f-1686-4af7-b50b-44b3577fd99c admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:50.924578 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1254/2479] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:07:50.928769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de2673-b3b9-4f97-bd0e-ccec95e94148 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:50.939270 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de2673-b3b9-4f97-bd0e-ccec95e94148 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:50.943906 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eeeda7-de36-4adc-af4f-49926fab54ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:50.944558 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eeeda7-de36-4adc-af4f-49926fab54ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:50.944839 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eeeda7-de36-4adc-af4f-49926fab54ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:50.945115 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eeeda7-de36-4adc-af4f-49926fab54ef admin admin] PATH_INFO: `/v3/projects/12ef2082f4804a2190cc98077e6b0239/users/9a2ee410c6e048c8872db7a888eed1bd/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:50.959795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eeeda7-de36-4adc-af4f-49926fab54ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ef2082f4804a2190cc98077e6b0239, user_id=9a2ee410c6e048c8872db7a888eed1bd, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:50.968673 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eeeda7-de36-4adc-af4f-49926fab54ef admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:51.073771 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1226/2480] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:07:50 2022] PUT /identity/v3/projects/12ef2082f4804a2190cc98077e6b0239/users/9a2ee410c6e048c8872db7a888eed1bd/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:07:51.077686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b749f-1686-4af7-b50b-44b3577fd99c admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:51.087867 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b749f-1686-4af7-b50b-44b3577fd99c admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:51.144396 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df6849-a550-4d76-b624-1f3198ed021e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:51.145027 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df6849-a550-4d76-b624-1f3198ed021e admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:51.145309 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df6849-a550-4d76-b624-1f3198ed021e admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:51.145591 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df6849-a550-4d76-b624-1f3198ed021e admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:51.146310 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df6849-a550-4d76-b624-1f3198ed021e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:51.147929 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df6849-a550-4d76-b624-1f3198ed021e admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:51.164725 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1255/2481] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:07:51.169490 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eeeda7-de36-4adc-af4f-49926fab54ef admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:51.175368 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:51.180762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eeeda7-de36-4adc-af4f-49926fab54ef admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:51.185451 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20786d8e-b13d-4937-ba1f-2474f373bd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:51.186128 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20786d8e-b13d-4937-ba1f-2474f373bd06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:51.186542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20786d8e-b13d-4937-ba1f-2474f373bd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:51.186861 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20786d8e-b13d-4937-ba1f-2474f373bd06 admin admin] PATH_INFO: `/v3/projects/12ef2082f4804a2190cc98077e6b0239/users/9a2ee410c6e048c8872db7a888eed1bd/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:51.188848 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20786d8e-b13d-4937-ba1f-2474f373bd06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ef2082f4804a2190cc98077e6b0239, user_id=9a2ee410c6e048c8872db7a888eed1bd, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:51.191545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20786d8e-b13d-4937-ba1f-2474f373bd06 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:51.202242 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1227/2482] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:07:51 2022] PUT /identity/v3/projects/12ef2082f4804a2190cc98077e6b0239/users/9a2ee410c6e048c8872db7a888eed1bd/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:07:51.212579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062f083-47c4-496e-9d43-abfa45eda581 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:51.212875 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062f083-47c4-496e-9d43-abfa45eda581 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:51.213190 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062f083-47c4-496e-9d43-abfa45eda581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:51.242590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-f062f083-47c4-496e-9d43-abfa45eda581 None None] MFA Rules not processed for user `9a2ee410c6e048c8872db7a888eed1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:07:51.243898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-f062f083-47c4-496e-9d43-abfa45eda581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:51.312138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1256/2483] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:07:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:07:51.324025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20786d8e-b13d-4937-ba1f-2474f373bd06 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:51.325697 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-20786d8e-b13d-4937-ba1f-2474f373bd06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:51.403947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20786d8e-b13d-4937-ba1f-2474f373bd06 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:51.407589 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53082ca7-89ab-46e7-bfa5-04544ca82eaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:51.408275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53082ca7-89ab-46e7-bfa5-04544ca82eaf service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:51.408561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53082ca7-89ab-46e7-bfa5-04544ca82eaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:51.408839 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53082ca7-89ab-46e7-bfa5-04544ca82eaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:51.417937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53082ca7-89ab-46e7-bfa5-04544ca82eaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:51.419393 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53082ca7-89ab-46e7-bfa5-04544ca82eaf service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:51.429009 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1228/2484] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:07:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:07:51.562908 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062f083-47c4-496e-9d43-abfa45eda581 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:51.564349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-f062f083-47c4-496e-9d43-abfa45eda581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:51.577066 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062f083-47c4-496e-9d43-abfa45eda581 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:51.580654 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7989b0-28e8-4d49-b3d2-46629c77f8c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:51.581268 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7989b0-28e8-4d49-b3d2-46629c77f8c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:51.581557 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7989b0-28e8-4d49-b3d2-46629c77f8c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:51.581841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7989b0-28e8-4d49-b3d2-46629c77f8c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:51.637076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7989b0-28e8-4d49-b3d2-46629c77f8c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:51.638680 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7989b0-28e8-4d49-b3d2-46629c77f8c2 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:51.647618 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1257/2485] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:07:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:07:56.459495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53082ca7-89ab-46e7-bfa5-04544ca82eaf service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:56.522009 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53082ca7-89ab-46e7-bfa5-04544ca82eaf service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:56.527125 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f61434-7b1b-44da-8093-858bcae3ee15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:56.527771 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f61434-7b1b-44da-8093-858bcae3ee15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:56.528053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f61434-7b1b-44da-8093-858bcae3ee15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:56.528338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f61434-7b1b-44da-8093-858bcae3ee15 admin admin] PATH_INFO: `/v3/users/de7b4e5bf5cf4a66aaf018ec6eb78963` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:56.529553 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f61434-7b1b-44da-8093-858bcae3ee15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de7b4e5bf5cf4a66aaf018ec6eb78963)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:56.531516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f61434-7b1b-44da-8093-858bcae3ee15 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:56.744528 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e1f61434-7b1b-44da-8093-858bcae3ee15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de7b4e5bf5cf4a66aaf018ec6eb78963'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:56.752185 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e1f61434-7b1b-44da-8093-858bcae3ee15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de7b4e5bf5cf4a66aaf018ec6eb78963'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:56.804186 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e1f61434-7b1b-44da-8093-858bcae3ee15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de7b4e5bf5cf4a66aaf018ec6eb78963'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:56.804809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e1f61434-7b1b-44da-8093-858bcae3ee15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de7b4e5bf5cf4a66aaf018ec6eb78963'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:56.813438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:56.818122 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e1f61434-7b1b-44da-8093-858bcae3ee15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de7b4e5bf5cf4a66aaf018ec6eb78963'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:56.823979 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1229/2486] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:07:56 2022] DELETE /identity/v3/users/de7b4e5bf5cf4a66aaf018ec6eb78963 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:07:56.828605 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c5f71-6b9c-4475-aa9b-aeb94c701362 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:56.829071 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c5f71-6b9c-4475-aa9b-aeb94c701362 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:56.829168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c5f71-6b9c-4475-aa9b-aeb94c701362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:56.848736 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-392c5f71-6b9c-4475-aa9b-aeb94c701362 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:07:56.850031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-392c5f71-6b9c-4475-aa9b-aeb94c701362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:56.854228 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:56.910426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1258/2487] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:07:56.920835 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f61434-7b1b-44da-8093-858bcae3ee15 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:56.925719 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e1f61434-7b1b-44da-8093-858bcae3ee15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:56.980749 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f61434-7b1b-44da-8093-858bcae3ee15 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:56.984412 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da93d59-2138-41d8-bdce-152c7580d00b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:56.985063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da93d59-2138-41d8-bdce-152c7580d00b service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:56.985311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da93d59-2138-41d8-bdce-152c7580d00b service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:56.985590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da93d59-2138-41d8-bdce-152c7580d00b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:56.995166 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da93d59-2138-41d8-bdce-152c7580d00b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:56.996601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da93d59-2138-41d8-bdce-152c7580d00b service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:57.006047 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1230/2488] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:07:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:07:57.422161 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c5f71-6b9c-4475-aa9b-aeb94c701362 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:57.423639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-392c5f71-6b9c-4475-aa9b-aeb94c701362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:57.438076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c5f71-6b9c-4475-aa9b-aeb94c701362 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:57.442925 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c839c-9ef1-4ea3-b8f6-522cfb19319b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:57.443574 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c839c-9ef1-4ea3-b8f6-522cfb19319b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:57.443881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c839c-9ef1-4ea3-b8f6-522cfb19319b admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:57.444143 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c839c-9ef1-4ea3-b8f6-522cfb19319b admin admin] PATH_INFO: `/v3/projects/b97bf5ab901748a1a803940ad34826f6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:57.445442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c839c-9ef1-4ea3-b8f6-522cfb19319b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97bf5ab901748a1a803940ad34826f6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:57.447550 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c839c-9ef1-4ea3-b8f6-522cfb19319b admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:57.546797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c62c839c-9ef1-4ea3-b8f6-522cfb19319b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97bf5ab901748a1a803940ad34826f6', 'request_id': 'req-c62c839c-9ef1-4ea3-b8f6-522cfb19319b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:57.553105 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c62c839c-9ef1-4ea3-b8f6-522cfb19319b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97bf5ab901748a1a803940ad34826f6', 'request_id': 'req-c62c839c-9ef1-4ea3-b8f6-522cfb19319b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:57.626044 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c62c839c-9ef1-4ea3-b8f6-522cfb19319b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97bf5ab901748a1a803940ad34826f6', 'request_id': 'req-c62c839c-9ef1-4ea3-b8f6-522cfb19319b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:57.637298 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c62c839c-9ef1-4ea3-b8f6-522cfb19319b admin admin] The token cache is being invalidate because project b97bf5ab901748a1a803940ad34826f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:07:57.637593 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c62c839c-9ef1-4ea3-b8f6-522cfb19319b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:57.638247 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c62c839c-9ef1-4ea3-b8f6-522cfb19319b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:57.639831 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1259/2489] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:07:57 2022] DELETE /identity/v3/projects/b97bf5ab901748a1a803940ad34826f6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:07:57.643881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da93d59-2138-41d8-bdce-152c7580d00b service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:57.653720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da93d59-2138-41d8-bdce-152c7580d00b service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:57.709077 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c98d2-cdbe-454b-b481-952da094ef7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:57.709640 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c98d2-cdbe-454b-b481-952da094ef7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:57.709928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c98d2-cdbe-454b-b481-952da094ef7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:57.710210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c98d2-cdbe-454b-b481-952da094ef7f admin admin] PATH_INFO: `/v3/users/9a2ee410c6e048c8872db7a888eed1bd` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:57.711396 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c98d2-cdbe-454b-b481-952da094ef7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a2ee410c6e048c8872db7a888eed1bd)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:57.713347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c98d2-cdbe-454b-b481-952da094ef7f admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:57.910094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-988c98d2-cdbe-454b-b481-952da094ef7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a2ee410c6e048c8872db7a888eed1bd'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:57.917486 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-988c98d2-cdbe-454b-b481-952da094ef7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a2ee410c6e048c8872db7a888eed1bd'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:57.981671 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-988c98d2-cdbe-454b-b481-952da094ef7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a2ee410c6e048c8872db7a888eed1bd'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:57.982226 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-988c98d2-cdbe-454b-b481-952da094ef7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a2ee410c6e048c8872db7a888eed1bd'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:57.994345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-988c98d2-cdbe-454b-b481-952da094ef7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a2ee410c6e048c8872db7a888eed1bd'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:58.000791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1231/2490] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:07:57 2022] DELETE /identity/v3/users/9a2ee410c6e048c8872db7a888eed1bd => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:07:58.452679 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c839c-9ef1-4ea3-b8f6-522cfb19319b admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:58.454258 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-c62c839c-9ef1-4ea3-b8f6-522cfb19319b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:58.468366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c839c-9ef1-4ea3-b8f6-522cfb19319b admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:58.524900 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d42d6d-a827-43ca-9dfa-7a9b35d85c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:58.525485 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d42d6d-a827-43ca-9dfa-7a9b35d85c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:58.525774 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d42d6d-a827-43ca-9dfa-7a9b35d85c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:58.526056 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d42d6d-a827-43ca-9dfa-7a9b35d85c10 admin admin] PATH_INFO: `/v3/projects/12ef2082f4804a2190cc98077e6b0239` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:58.527809 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d42d6d-a827-43ca-9dfa-7a9b35d85c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ef2082f4804a2190cc98077e6b0239)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:58.529713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d42d6d-a827-43ca-9dfa-7a9b35d85c10 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:58.622667 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:58.631899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-f3d42d6d-a827-43ca-9dfa-7a9b35d85c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ef2082f4804a2190cc98077e6b0239', 'request_id': 'req-f3d42d6d-a827-43ca-9dfa-7a9b35d85c10'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:58.638096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-f3d42d6d-a827-43ca-9dfa-7a9b35d85c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ef2082f4804a2190cc98077e6b0239', 'request_id': 'req-f3d42d6d-a827-43ca-9dfa-7a9b35d85c10'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:58.711564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-f3d42d6d-a827-43ca-9dfa-7a9b35d85c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ef2082f4804a2190cc98077e6b0239', 'request_id': 'req-f3d42d6d-a827-43ca-9dfa-7a9b35d85c10'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:58.722906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-f3d42d6d-a827-43ca-9dfa-7a9b35d85c10 admin admin] The token cache is being invalidate because project 12ef2082f4804a2190cc98077e6b0239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:07:58.723198 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-f3d42d6d-a827-43ca-9dfa-7a9b35d85c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:58.723830 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-f3d42d6d-a827-43ca-9dfa-7a9b35d85c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:07:58.725447 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1260/2491] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:07:58 2022] DELETE /identity/v3/projects/12ef2082f4804a2190cc98077e6b0239 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:07:58.730346 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fb543-9059-43c5-ad0d-cb1c5ac857a2 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:58.730876 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fb543-9059-43c5-ad0d-cb1c5ac857a2 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:58.730975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fb543-9059-43c5-ad0d-cb1c5ac857a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:58.750550 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-c84fb543-9059-43c5-ad0d-cb1c5ac857a2 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:07:58.751841 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-c84fb543-9059-43c5-ad0d-cb1c5ac857a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:58.760244 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:58.810659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1232/2492] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:07:58.818682 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80695a-3468-4c69-8690-9106ce2437bb None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:58.819001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80695a-3468-4c69-8690-9106ce2437bb None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:58.819287 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80695a-3468-4c69-8690-9106ce2437bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:58.839961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-fc80695a-3468-4c69-8690-9106ce2437bb None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:07:58.841176 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-fc80695a-3468-4c69-8690-9106ce2437bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:58.850830 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1261/2493] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:07:58.853934 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fb543-9059-43c5-ad0d-cb1c5ac857a2 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:58.863795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fb543-9059-43c5-ad0d-cb1c5ac857a2 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:58.868537 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda464a2-8f80-4a4e-8e29-56a9d279faf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:58.871750 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda464a2-8f80-4a4e-8e29-56a9d279faf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:58.871750 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda464a2-8f80-4a4e-8e29-56a9d279faf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:58.871750 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda464a2-8f80-4a4e-8e29-56a9d279faf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:58.871750 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda464a2-8f80-4a4e-8e29-56a9d279faf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:07:58.871750 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda464a2-8f80-4a4e-8e29-56a9d279faf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:58.872408 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda464a2-8f80-4a4e-8e29-56a9d279faf4 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:58.883987 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1233/2494] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:07:58.888824 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80695a-3468-4c69-8690-9106ce2437bb None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:58.898328 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80695a-3468-4c69-8690-9106ce2437bb None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:58.903727 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4a675-4c41-4812-9d94-237e1476a9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:58.904335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4a675-4c41-4812-9d94-237e1476a9fb admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:58.904621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4a675-4c41-4812-9d94-237e1476a9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:58.904903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4a675-4c41-4812-9d94-237e1476a9fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:58.905575 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4a675-4c41-4812-9d94-237e1476a9fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:58.907510 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4a675-4c41-4812-9d94-237e1476a9fb admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:58.988559 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1262/2495] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:07:58 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:07:58.992874 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda464a2-8f80-4a4e-8e29-56a9d279faf4 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:59.003513 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda464a2-8f80-4a4e-8e29-56a9d279faf4 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:59.060301 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fccd1-845b-42bc-a648-5a7d6f8a53fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:59.060842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fccd1-845b-42bc-a648-5a7d6f8a53fc admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:59.061124 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fccd1-845b-42bc-a648-5a7d6f8a53fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:59.061400 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fccd1-845b-42bc-a648-5a7d6f8a53fc admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:59.062054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fccd1-845b-42bc-a648-5a7d6f8a53fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:59.063994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fccd1-845b-42bc-a648-5a7d6f8a53fc admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:59.142228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1234/2496] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:07:58 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:07:59.148642 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4a675-4c41-4812-9d94-237e1476a9fb admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:59.159699 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4a675-4c41-4812-9d94-237e1476a9fb admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:59.164366 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310da29-2279-43e5-92ae-ddccc73ab03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:59.168914 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310da29-2279-43e5-92ae-ddccc73ab03d admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:59.168914 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310da29-2279-43e5-92ae-ddccc73ab03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:59.168914 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310da29-2279-43e5-92ae-ddccc73ab03d admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:59.168914 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310da29-2279-43e5-92ae-ddccc73ab03d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:59.168914 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310da29-2279-43e5-92ae-ddccc73ab03d admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:59.178618 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1263/2497] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:07:59.183175 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fccd1-845b-42bc-a648-5a7d6f8a53fc admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:59.193291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fccd1-845b-42bc-a648-5a7d6f8a53fc admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:59.197897 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72384d-09fd-442a-8624-dc27c0598aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:59.199104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72384d-09fd-442a-8624-dc27c0598aaa admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:59.199386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72384d-09fd-442a-8624-dc27c0598aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:59.199664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72384d-09fd-442a-8624-dc27c0598aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:59.200358 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72384d-09fd-442a-8624-dc27c0598aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:59.201955 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72384d-09fd-442a-8624-dc27c0598aaa admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:59.212418 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1235/2498] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:07:59.216548 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310da29-2279-43e5-92ae-ddccc73ab03d admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:59.226400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310da29-2279-43e5-92ae-ddccc73ab03d admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:59.231141 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae5bd6-d09c-482e-95db-1aa1f89c8a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:59.231797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae5bd6-d09c-482e-95db-1aa1f89c8a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:59.232079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae5bd6-d09c-482e-95db-1aa1f89c8a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:59.232355 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae5bd6-d09c-482e-95db-1aa1f89c8a5f admin admin] PATH_INFO: `/v3/projects/ce5799b2636f4580889bde9201bb4df9/users/e69258329f7f4b3d99416a36056dc05c/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:59.246994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae5bd6-d09c-482e-95db-1aa1f89c8a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5799b2636f4580889bde9201bb4df9, user_id=e69258329f7f4b3d99416a36056dc05c, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:59.249660 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae5bd6-d09c-482e-95db-1aa1f89c8a5f admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:59.319860 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1264/2499] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:07:59 2022] PUT /identity/v3/projects/ce5799b2636f4580889bde9201bb4df9/users/e69258329f7f4b3d99416a36056dc05c/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:07:59.330919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390d45d-9163-415c-82b1-abf3bb31bfb4 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:59.331216 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390d45d-9163-415c-82b1-abf3bb31bfb4 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:59.331498 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390d45d-9163-415c-82b1-abf3bb31bfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:59.359055 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-3390d45d-9163-415c-82b1-abf3bb31bfb4 None None] MFA Rules not processed for user `e69258329f7f4b3d99416a36056dc05c`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:07:59.360258 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3390d45d-9163-415c-82b1-abf3bb31bfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:07:59.425679 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1236/2500] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:07:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:07:59.430206 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae5bd6-d09c-482e-95db-1aa1f89c8a5f admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:59.491979 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae5bd6-d09c-482e-95db-1aa1f89c8a5f admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:59.497371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6858ee1-981d-421e-a335-43795467a9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:59.497990 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6858ee1-981d-421e-a335-43795467a9a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:59.498278 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6858ee1-981d-421e-a335-43795467a9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:59.498564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6858ee1-981d-421e-a335-43795467a9a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:59.499265 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6858ee1-981d-421e-a335-43795467a9a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:59.501167 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6858ee1-981d-421e-a335-43795467a9a9 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:59.606419 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1265/2501] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:07:59 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:07:59.610482 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390d45d-9163-415c-82b1-abf3bb31bfb4 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:59.622634 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390d45d-9163-415c-82b1-abf3bb31bfb4 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:59.627650 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:07:59.678626 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb482270-3413-4802-8572-5946177de20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:59.679272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb482270-3413-4802-8572-5946177de20a admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:59.679557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb482270-3413-4802-8572-5946177de20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:59.679835 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb482270-3413-4802-8572-5946177de20a admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:59.680507 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb482270-3413-4802-8572-5946177de20a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:59.683156 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb482270-3413-4802-8572-5946177de20a admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:59.753482 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1237/2502] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:07:59 2022] POST /identity/v3/users => generated 300 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:07:59.757531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6858ee1-981d-421e-a335-43795467a9a9 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:59.768194 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6858ee1-981d-421e-a335-43795467a9a9 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:59.772902 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fcf79-ed9a-495e-a98e-e9a9605cdc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:59.773548 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fcf79-ed9a-495e-a98e-e9a9605cdc54 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:59.773833 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fcf79-ed9a-495e-a98e-e9a9605cdc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:59.774217 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fcf79-ed9a-495e-a98e-e9a9605cdc54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:59.774981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fcf79-ed9a-495e-a98e-e9a9605cdc54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:59.776583 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fcf79-ed9a-495e-a98e-e9a9605cdc54 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:59.788339 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1266/2503] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:07:59.792770 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb482270-3413-4802-8572-5946177de20a admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:59.802579 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb482270-3413-4802-8572-5946177de20a admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:07:59.807131 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a0bbf-c828-40fb-8f22-fee6321f6e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:07:59.808445 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a0bbf-c828-40fb-8f22-fee6321f6e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:07:59.808724 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a0bbf-c828-40fb-8f22-fee6321f6e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:07:59.808999 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a0bbf-c828-40fb-8f22-fee6321f6e60 admin admin] PATH_INFO: `/v3/projects/5ba0f8ae2ece4313ad5c62f9285ac7ab/users/3b1c6148c59e40de9b8a56d5480f020c/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:07:59.824135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a0bbf-c828-40fb-8f22-fee6321f6e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ba0f8ae2ece4313ad5c62f9285ac7ab, user_id=3b1c6148c59e40de9b8a56d5480f020c, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:07:59.826819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a0bbf-c828-40fb-8f22-fee6321f6e60 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:07:59.873393 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1238/2504] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:07:59 2022] PUT /identity/v3/projects/5ba0f8ae2ece4313ad5c62f9285ac7ab/users/3b1c6148c59e40de9b8a56d5480f020c/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:07:59.877279 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fcf79-ed9a-495e-a98e-e9a9605cdc54 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:07:59.887500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fcf79-ed9a-495e-a98e-e9a9605cdc54 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:00.040541 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:00.067257 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700fd32-c0d9-4b7f-8abf-91280d828c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:00.067877 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700fd32-c0d9-4b7f-8abf-91280d828c64 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:00.068160 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700fd32-c0d9-4b7f-8abf-91280d828c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:00.068515 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700fd32-c0d9-4b7f-8abf-91280d828c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:00.069214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700fd32-c0d9-4b7f-8abf-91280d828c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:00.070813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700fd32-c0d9-4b7f-8abf-91280d828c64 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:00.080885 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1267/2505] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:08:00.085212 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a0bbf-c828-40fb-8f22-fee6321f6e60 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:00.096254 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a0bbf-c828-40fb-8f22-fee6321f6e60 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:00.100939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb310a8b-1a34-4e6e-b3fd-5e4e11685de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:00.101917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb310a8b-1a34-4e6e-b3fd-5e4e11685de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:00.101917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb310a8b-1a34-4e6e-b3fd-5e4e11685de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:00.102133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb310a8b-1a34-4e6e-b3fd-5e4e11685de1 admin admin] PATH_INFO: `/v3/projects/5ba0f8ae2ece4313ad5c62f9285ac7ab/users/3b1c6148c59e40de9b8a56d5480f020c/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:00.104130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb310a8b-1a34-4e6e-b3fd-5e4e11685de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ba0f8ae2ece4313ad5c62f9285ac7ab, user_id=3b1c6148c59e40de9b8a56d5480f020c, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:00.107430 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb310a8b-1a34-4e6e-b3fd-5e4e11685de1 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:00.117607 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1239/2506] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:08:00 2022] PUT /identity/v3/projects/5ba0f8ae2ece4313ad5c62f9285ac7ab/users/3b1c6148c59e40de9b8a56d5480f020c/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:08:00.128710 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651b69d-a5ec-47a6-844b-3a441e6b69c5 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:00.128941 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651b69d-a5ec-47a6-844b-3a441e6b69c5 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:00.129261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651b69d-a5ec-47a6-844b-3a441e6b69c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:00.157476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-f651b69d-a5ec-47a6-844b-3a441e6b69c5 None None] MFA Rules not processed for user `3b1c6148c59e40de9b8a56d5480f020c`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:00.158722 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-f651b69d-a5ec-47a6-844b-3a441e6b69c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:00.225294 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1268/2507] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:08:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:00.236433 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb310a8b-1a34-4e6e-b3fd-5e4e11685de1 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:00.238126 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-fb310a8b-1a34-4e6e-b3fd-5e4e11685de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:00.296458 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb310a8b-1a34-4e6e-b3fd-5e4e11685de1 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:00.300072 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98536b73-e757-4d5b-a5ea-ecc5613415a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:00.300686 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98536b73-e757-4d5b-a5ea-ecc5613415a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:00.300971 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98536b73-e757-4d5b-a5ea-ecc5613415a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:00.301249 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98536b73-e757-4d5b-a5ea-ecc5613415a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:00.310391 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98536b73-e757-4d5b-a5ea-ecc5613415a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:00.311907 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98536b73-e757-4d5b-a5ea-ecc5613415a4 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:00.321358 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1240/2508] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:08:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:08:01.372086 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651b69d-a5ec-47a6-844b-3a441e6b69c5 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:01.433517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651b69d-a5ec-47a6-844b-3a441e6b69c5 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:01.437987 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e6ec5-dfcf-4f7c-9a67-756bacbb6f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:01.454009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e6ec5-dfcf-4f7c-9a67-756bacbb6f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:01.454009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e6ec5-dfcf-4f7c-9a67-756bacbb6f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:01.454009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e6ec5-dfcf-4f7c-9a67-756bacbb6f81 admin admin] PATH_INFO: `/v3/users/e69258329f7f4b3d99416a36056dc05c` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:01.454009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e6ec5-dfcf-4f7c-9a67-756bacbb6f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e69258329f7f4b3d99416a36056dc05c)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:01.454009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e6ec5-dfcf-4f7c-9a67-756bacbb6f81 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:01.589332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-764e6ec5-dfcf-4f7c-9a67-756bacbb6f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e69258329f7f4b3d99416a36056dc05c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:01.596062 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-764e6ec5-dfcf-4f7c-9a67-756bacbb6f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e69258329f7f4b3d99416a36056dc05c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:01.596731 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-764e6ec5-dfcf-4f7c-9a67-756bacbb6f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e69258329f7f4b3d99416a36056dc05c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:01.597913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:01.608894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-764e6ec5-dfcf-4f7c-9a67-756bacbb6f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e69258329f7f4b3d99416a36056dc05c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:01.609593 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-764e6ec5-dfcf-4f7c-9a67-756bacbb6f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e69258329f7f4b3d99416a36056dc05c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:01.684860 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1269/2509] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:08:01 2022] DELETE /identity/v3/users/e69258329f7f4b3d99416a36056dc05c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:08:01.689485 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13e512-fb49-4001-9ad3-41d02291cfd9 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:01.689979 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13e512-fb49-4001-9ad3-41d02291cfd9 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:01.690077 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13e512-fb49-4001-9ad3-41d02291cfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:01.708873 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-4f13e512-fb49-4001-9ad3-41d02291cfd9 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:01.710124 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-4f13e512-fb49-4001-9ad3-41d02291cfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:01.769303 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1241/2510] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:01.779067 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e6ec5-dfcf-4f7c-9a67-756bacbb6f81 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:01.780486 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-764e6ec5-dfcf-4f7c-9a67-756bacbb6f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:01.836669 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e6ec5-dfcf-4f7c-9a67-756bacbb6f81 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:01.840290 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a429a-10b1-475d-96dc-313fa57637d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:01.840837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a429a-10b1-475d-96dc-313fa57637d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:01.841116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a429a-10b1-475d-96dc-313fa57637d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:01.841391 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a429a-10b1-475d-96dc-313fa57637d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:01.850292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a429a-10b1-475d-96dc-313fa57637d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:01.851726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a429a-10b1-475d-96dc-313fa57637d1 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:01.861498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1270/2511] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:08:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:08:02.250622 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13e512-fb49-4001-9ad3-41d02291cfd9 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:02.252204 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-4f13e512-fb49-4001-9ad3-41d02291cfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:02.260990 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:02.265007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13e512-fb49-4001-9ad3-41d02291cfd9 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:02.269651 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ef186-e8d1-45f7-8367-9bb24ee49bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:02.270302 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ef186-e8d1-45f7-8367-9bb24ee49bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:02.270595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ef186-e8d1-45f7-8367-9bb24ee49bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:02.270899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ef186-e8d1-45f7-8367-9bb24ee49bbe admin admin] PATH_INFO: `/v3/projects/ce5799b2636f4580889bde9201bb4df9` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:02.272124 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ef186-e8d1-45f7-8367-9bb24ee49bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce5799b2636f4580889bde9201bb4df9)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:02.274052 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ef186-e8d1-45f7-8367-9bb24ee49bbe admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:02.405341 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-cc1ef186-e8d1-45f7-8367-9bb24ee49bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce5799b2636f4580889bde9201bb4df9', 'request_id': 'req-cc1ef186-e8d1-45f7-8367-9bb24ee49bbe'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:02.412040 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-cc1ef186-e8d1-45f7-8367-9bb24ee49bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce5799b2636f4580889bde9201bb4df9', 'request_id': 'req-cc1ef186-e8d1-45f7-8367-9bb24ee49bbe'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:02.495807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-cc1ef186-e8d1-45f7-8367-9bb24ee49bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce5799b2636f4580889bde9201bb4df9', 'request_id': 'req-cc1ef186-e8d1-45f7-8367-9bb24ee49bbe'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:02.506414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-cc1ef186-e8d1-45f7-8367-9bb24ee49bbe admin admin] The token cache is being invalidate because project ce5799b2636f4580889bde9201bb4df9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:08:02.506706 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-cc1ef186-e8d1-45f7-8367-9bb24ee49bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:02.507427 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-cc1ef186-e8d1-45f7-8367-9bb24ee49bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:02.508944 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1242/2512] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:08:02 2022] DELETE /identity/v3/projects/ce5799b2636f4580889bde9201bb4df9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:08:02.513460 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a429a-10b1-475d-96dc-313fa57637d1 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:02.523014 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a429a-10b1-475d-96dc-313fa57637d1 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:02.583078 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae4530-2690-476f-ad0c-bd90cc26c208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:02.583728 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae4530-2690-476f-ad0c-bd90cc26c208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:02.584012 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae4530-2690-476f-ad0c-bd90cc26c208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:02.584316 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae4530-2690-476f-ad0c-bd90cc26c208 admin admin] PATH_INFO: `/v3/users/3b1c6148c59e40de9b8a56d5480f020c` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:02.585515 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae4530-2690-476f-ad0c-bd90cc26c208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b1c6148c59e40de9b8a56d5480f020c)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:02.587470 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae4530-2690-476f-ad0c-bd90cc26c208 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:02.767047 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e6ae4530-2690-476f-ad0c-bd90cc26c208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b1c6148c59e40de9b8a56d5480f020c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:02.773974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e6ae4530-2690-476f-ad0c-bd90cc26c208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b1c6148c59e40de9b8a56d5480f020c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:02.774652 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e6ae4530-2690-476f-ad0c-bd90cc26c208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b1c6148c59e40de9b8a56d5480f020c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:02.787265 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e6ae4530-2690-476f-ad0c-bd90cc26c208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b1c6148c59e40de9b8a56d5480f020c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:02.787931 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e6ae4530-2690-476f-ad0c-bd90cc26c208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b1c6148c59e40de9b8a56d5480f020c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:02.791693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:02.906696 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1271/2513] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:08:02 2022] DELETE /identity/v3/users/3b1c6148c59e40de9b8a56d5480f020c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:08:03.318888 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ef186-e8d1-45f7-8367-9bb24ee49bbe admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:03.324121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-cc1ef186-e8d1-45f7-8367-9bb24ee49bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:03.333713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ef186-e8d1-45f7-8367-9bb24ee49bbe admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:03.394192 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867430e-e066-4228-a8d6-666a8e9ba2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:03.394878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867430e-e066-4228-a8d6-666a8e9ba2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:03.395168 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867430e-e066-4228-a8d6-666a8e9ba2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:03.395448 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867430e-e066-4228-a8d6-666a8e9ba2ca admin admin] PATH_INFO: `/v3/projects/5ba0f8ae2ece4313ad5c62f9285ac7ab` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:03.396708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867430e-e066-4228-a8d6-666a8e9ba2ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ba0f8ae2ece4313ad5c62f9285ac7ab)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:03.398626 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867430e-e066-4228-a8d6-666a8e9ba2ca admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:03.599678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b867430e-e066-4228-a8d6-666a8e9ba2ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ba0f8ae2ece4313ad5c62f9285ac7ab', 'request_id': 'req-b867430e-e066-4228-a8d6-666a8e9ba2ca'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:03.606485 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b867430e-e066-4228-a8d6-666a8e9ba2ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ba0f8ae2ece4313ad5c62f9285ac7ab', 'request_id': 'req-b867430e-e066-4228-a8d6-666a8e9ba2ca'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:03.694175 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b867430e-e066-4228-a8d6-666a8e9ba2ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ba0f8ae2ece4313ad5c62f9285ac7ab', 'request_id': 'req-b867430e-e066-4228-a8d6-666a8e9ba2ca'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:03.705138 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b867430e-e066-4228-a8d6-666a8e9ba2ca admin admin] The token cache is being invalidate because project 5ba0f8ae2ece4313ad5c62f9285ac7ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:08:03.707770 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b867430e-e066-4228-a8d6-666a8e9ba2ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:03.707770 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b867430e-e066-4228-a8d6-666a8e9ba2ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:03.707770 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1243/2514] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:08:03 2022] DELETE /identity/v3/projects/5ba0f8ae2ece4313ad5c62f9285ac7ab => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:08:03.714759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9270f0-f6d2-4f7b-b6db-506f743cb538 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:03.715242 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9270f0-f6d2-4f7b-b6db-506f743cb538 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:03.715353 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9270f0-f6d2-4f7b-b6db-506f743cb538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:03.735308 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-7b9270f0-f6d2-4f7b-b6db-506f743cb538 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:03.736534 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-7b9270f0-f6d2-4f7b-b6db-506f743cb538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:03.795989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1272/2515] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:03.804010 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ec47d-0105-4beb-afa4-12c3f6eab223 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:03.804313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ec47d-0105-4beb-afa4-12c3f6eab223 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:03.804595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ec47d-0105-4beb-afa4-12c3f6eab223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:03.824023 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-617ec47d-0105-4beb-afa4-12c3f6eab223 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:03.825238 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-617ec47d-0105-4beb-afa4-12c3f6eab223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:03.833132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1244/2516] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:03.837319 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9270f0-f6d2-4f7b-b6db-506f743cb538 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:03.847350 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9270f0-f6d2-4f7b-b6db-506f743cb538 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:03.852003 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bba79-f73b-46d3-8bff-6f8ae5369e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:03.852555 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bba79-f73b-46d3-8bff-6f8ae5369e14 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:03.852845 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bba79-f73b-46d3-8bff-6f8ae5369e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:03.853122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bba79-f73b-46d3-8bff-6f8ae5369e14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:03.853825 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bba79-f73b-46d3-8bff-6f8ae5369e14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:08:03.854769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bba79-f73b-46d3-8bff-6f8ae5369e14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:03.856409 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bba79-f73b-46d3-8bff-6f8ae5369e14 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:03.867991 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1273/2517] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:08:03.872441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ec47d-0105-4beb-afa4-12c3f6eab223 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:03.881936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ec47d-0105-4beb-afa4-12c3f6eab223 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:03.886694 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036433b-d49f-4ef3-aff1-e32e07b60cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:03.887357 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036433b-d49f-4ef3-aff1-e32e07b60cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:03.887640 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036433b-d49f-4ef3-aff1-e32e07b60cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:03.887920 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036433b-d49f-4ef3-aff1-e32e07b60cf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:03.888622 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036433b-d49f-4ef3-aff1-e32e07b60cf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:03.890569 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036433b-d49f-4ef3-aff1-e32e07b60cf8 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:03.900357 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:04.005215 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1245/2518] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:08:03 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:08:04.009242 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bba79-f73b-46d3-8bff-6f8ae5369e14 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:04.019744 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bba79-f73b-46d3-8bff-6f8ae5369e14 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:04.079807 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6bcce-31c4-4e67-8532-c9f2b27f6019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:04.080427 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6bcce-31c4-4e67-8532-c9f2b27f6019 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:04.080711 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6bcce-31c4-4e67-8532-c9f2b27f6019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:04.080989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6bcce-31c4-4e67-8532-c9f2b27f6019 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:04.081686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6bcce-31c4-4e67-8532-c9f2b27f6019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:04.083618 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6bcce-31c4-4e67-8532-c9f2b27f6019 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:04.188004 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1274/2519] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:08:04 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:08:04.192182 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036433b-d49f-4ef3-aff1-e32e07b60cf8 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:04.203060 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036433b-d49f-4ef3-aff1-e32e07b60cf8 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:04.207699 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e217a-6556-40e1-b4d7-795be2028940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:04.208311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e217a-6556-40e1-b4d7-795be2028940 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:04.208596 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e217a-6556-40e1-b4d7-795be2028940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:04.208872 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e217a-6556-40e1-b4d7-795be2028940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:04.209565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e217a-6556-40e1-b4d7-795be2028940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:04.211214 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e217a-6556-40e1-b4d7-795be2028940 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:04.221819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1246/2520] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:08:04.225766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6bcce-31c4-4e67-8532-c9f2b27f6019 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:04.235936 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6bcce-31c4-4e67-8532-c9f2b27f6019 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:04.240564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57abc2-6c48-4d07-867c-99f34cf8651b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:04.241170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57abc2-6c48-4d07-867c-99f34cf8651b admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:04.241454 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57abc2-6c48-4d07-867c-99f34cf8651b admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:04.241729 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57abc2-6c48-4d07-867c-99f34cf8651b admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:04.242419 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57abc2-6c48-4d07-867c-99f34cf8651b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:04.244049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57abc2-6c48-4d07-867c-99f34cf8651b admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:04.254486 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1275/2521] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:08:04.258680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e217a-6556-40e1-b4d7-795be2028940 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:04.269293 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e217a-6556-40e1-b4d7-795be2028940 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:04.273997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ef5a8-d0bc-43a3-af75-50c55ddd51da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:04.274661 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ef5a8-d0bc-43a3-af75-50c55ddd51da admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:04.274978 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ef5a8-d0bc-43a3-af75-50c55ddd51da admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:04.275255 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ef5a8-d0bc-43a3-af75-50c55ddd51da admin admin] PATH_INFO: `/v3/projects/457cbe7dc4494ba9ac93d99b98625105/users/4cebf34a4c4244a29b7565ef739ecb4f/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:04.290932 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ef5a8-d0bc-43a3-af75-50c55ddd51da admin admin] RBAC: Authorizing `identity:create_grant(project_id=457cbe7dc4494ba9ac93d99b98625105, user_id=4cebf34a4c4244a29b7565ef739ecb4f, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:04.293626 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ef5a8-d0bc-43a3-af75-50c55ddd51da admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:04.365115 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1247/2522] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:08:04 2022] PUT /identity/v3/projects/457cbe7dc4494ba9ac93d99b98625105/users/4cebf34a4c4244a29b7565ef739ecb4f/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:08:04.376060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24ccd5-1384-4c08-9c88-b9290cb07e60 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:04.376369 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24ccd5-1384-4c08-9c88-b9290cb07e60 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:04.376633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24ccd5-1384-4c08-9c88-b9290cb07e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:04.405322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-1e24ccd5-1384-4c08-9c88-b9290cb07e60 None None] MFA Rules not processed for user `4cebf34a4c4244a29b7565ef739ecb4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:04.406553 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-1e24ccd5-1384-4c08-9c88-b9290cb07e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:04.458039 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:04.474419 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1276/2523] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:08:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:08:04.485207 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ef5a8-d0bc-43a3-af75-50c55ddd51da admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:04.486944 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3f4ef5a8-d0bc-43a3-af75-50c55ddd51da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:04.545622 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ef5a8-d0bc-43a3-af75-50c55ddd51da admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:04.549389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bcf73-2b14-4396-b0f5-601bdbf42dc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:04.550008 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bcf73-2b14-4396-b0f5-601bdbf42dc7 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:04.550291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bcf73-2b14-4396-b0f5-601bdbf42dc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:04.550569 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bcf73-2b14-4396-b0f5-601bdbf42dc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:04.559577 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bcf73-2b14-4396-b0f5-601bdbf42dc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:04.561013 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bcf73-2b14-4396-b0f5-601bdbf42dc7 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:04.570035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1248/2524] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:08:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:08:14.565802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=45,keystone:INSERT=2 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:14.631544 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=4 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:16.817016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24ccd5-1384-4c08-9c88-b9290cb07e60 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:16.879259 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24ccd5-1384-4c08-9c88-b9290cb07e60 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:16.883917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc29e3c-6fc8-41db-89a8-53cb1a568681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:16.884615 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc29e3c-6fc8-41db-89a8-53cb1a568681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:16.884903 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc29e3c-6fc8-41db-89a8-53cb1a568681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:16.885705 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc29e3c-6fc8-41db-89a8-53cb1a568681 admin admin] PATH_INFO: `/v3/users/4cebf34a4c4244a29b7565ef739ecb4f` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:16.887065 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc29e3c-6fc8-41db-89a8-53cb1a568681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cebf34a4c4244a29b7565ef739ecb4f)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:16.889081 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc29e3c-6fc8-41db-89a8-53cb1a568681 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:17.018206 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8cc29e3c-6fc8-41db-89a8-53cb1a568681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cebf34a4c4244a29b7565ef739ecb4f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:17.025015 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8cc29e3c-6fc8-41db-89a8-53cb1a568681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cebf34a4c4244a29b7565ef739ecb4f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:17.026294 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8cc29e3c-6fc8-41db-89a8-53cb1a568681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cebf34a4c4244a29b7565ef739ecb4f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:17.038232 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8cc29e3c-6fc8-41db-89a8-53cb1a568681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cebf34a4c4244a29b7565ef739ecb4f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:17.038892 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8cc29e3c-6fc8-41db-89a8-53cb1a568681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cebf34a4c4244a29b7565ef739ecb4f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:17.089591 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1277/2525] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:08:16 2022] DELETE /identity/v3/users/4cebf34a4c4244a29b7565ef739ecb4f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:08:17.094398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fa551-3cc1-41ce-8539-354902901046 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:17.094912 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fa551-3cc1-41ce-8539-354902901046 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:17.095025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fa551-3cc1-41ce-8539-354902901046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:17.113616 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-1c3fa551-3cc1-41ce-8539-354902901046 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:17.114853 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-1c3fa551-3cc1-41ce-8539-354902901046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:17.173081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1249/2526] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:17.183244 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc29e3c-6fc8-41db-89a8-53cb1a568681 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:17.184684 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-8cc29e3c-6fc8-41db-89a8-53cb1a568681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:17.239968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc29e3c-6fc8-41db-89a8-53cb1a568681 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:17.243630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3915251-2beb-4edc-a16a-88fdc2d64f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:17.244244 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3915251-2beb-4edc-a16a-88fdc2d64f5b service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:17.245015 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3915251-2beb-4edc-a16a-88fdc2d64f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:17.245294 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3915251-2beb-4edc-a16a-88fdc2d64f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:17.254146 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3915251-2beb-4edc-a16a-88fdc2d64f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:17.255634 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3915251-2beb-4edc-a16a-88fdc2d64f5b service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:17.265578 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1278/2527] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:08:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:08:17.646220 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fa551-3cc1-41ce-8539-354902901046 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:17.648646 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-1c3fa551-3cc1-41ce-8539-354902901046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:17.660350 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fa551-3cc1-41ce-8539-354902901046 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:17.665063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae66a00-276e-40f3-9e5d-dedfc35e7c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:17.665731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae66a00-276e-40f3-9e5d-dedfc35e7c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:17.666031 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae66a00-276e-40f3-9e5d-dedfc35e7c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:17.670599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae66a00-276e-40f3-9e5d-dedfc35e7c83 admin admin] PATH_INFO: `/v3/projects/457cbe7dc4494ba9ac93d99b98625105` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:17.670599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae66a00-276e-40f3-9e5d-dedfc35e7c83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=457cbe7dc4494ba9ac93d99b98625105)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:17.670599 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae66a00-276e-40f3-9e5d-dedfc35e7c83 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:17.781467 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-8ae66a00-276e-40f3-9e5d-dedfc35e7c83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '457cbe7dc4494ba9ac93d99b98625105', 'request_id': 'req-8ae66a00-276e-40f3-9e5d-dedfc35e7c83'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:17.787784 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-8ae66a00-276e-40f3-9e5d-dedfc35e7c83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '457cbe7dc4494ba9ac93d99b98625105', 'request_id': 'req-8ae66a00-276e-40f3-9e5d-dedfc35e7c83'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:17.844213 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-8ae66a00-276e-40f3-9e5d-dedfc35e7c83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '457cbe7dc4494ba9ac93d99b98625105', 'request_id': 'req-8ae66a00-276e-40f3-9e5d-dedfc35e7c83'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:17.856025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-8ae66a00-276e-40f3-9e5d-dedfc35e7c83 admin admin] The token cache is being invalidate because project 457cbe7dc4494ba9ac93d99b98625105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:08:17.856318 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-8ae66a00-276e-40f3-9e5d-dedfc35e7c83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:17.856975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-8ae66a00-276e-40f3-9e5d-dedfc35e7c83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:17.858513 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1250/2528] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:08:17 2022] DELETE /identity/v3/projects/457cbe7dc4494ba9ac93d99b98625105 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:08:17.863492 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d5c7e-a87b-4c2f-9ac0-3072f2c438b4 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:17.864054 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d5c7e-a87b-4c2f-9ac0-3072f2c438b4 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:17.864054 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d5c7e-a87b-4c2f-9ac0-3072f2c438b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:17.885389 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-793d5c7e-a87b-4c2f-9ac0-3072f2c438b4 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:17.887037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-793d5c7e-a87b-4c2f-9ac0-3072f2c438b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:17.904313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:17.947413 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1279/2529] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:17.955597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45ce85-bf56-46c1-8f9c-e4695dcdeb8b None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:17.955877 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45ce85-bf56-46c1-8f9c-e4695dcdeb8b None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:17.956161 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45ce85-bf56-46c1-8f9c-e4695dcdeb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:17.976760 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-fe45ce85-bf56-46c1-8f9c-e4695dcdeb8b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:17.978027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-fe45ce85-bf56-46c1-8f9c-e4695dcdeb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:17.986714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1251/2530] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:17.991156 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d5c7e-a87b-4c2f-9ac0-3072f2c438b4 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:18.000907 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d5c7e-a87b-4c2f-9ac0-3072f2c438b4 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:18.005529 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd9b60-3519-42c6-bd52-fe12ac343cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:18.006143 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd9b60-3519-42c6-bd52-fe12ac343cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:18.006428 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd9b60-3519-42c6-bd52-fe12ac343cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:18.006708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd9b60-3519-42c6-bd52-fe12ac343cf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:18.007466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd9b60-3519-42c6-bd52-fe12ac343cf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:08:18.007775 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd9b60-3519-42c6-bd52-fe12ac343cf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:18.009420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd9b60-3519-42c6-bd52-fe12ac343cf8 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:18.021487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1280/2531] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:08:18.026173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45ce85-bf56-46c1-8f9c-e4695dcdeb8b None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:18.035828 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45ce85-bf56-46c1-8f9c-e4695dcdeb8b None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:18.040511 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894d22a-858a-462f-a895-112f87f5ea96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:18.041113 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894d22a-858a-462f-a895-112f87f5ea96 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:18.042046 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894d22a-858a-462f-a895-112f87f5ea96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:18.042325 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894d22a-858a-462f-a895-112f87f5ea96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:18.043039 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894d22a-858a-462f-a895-112f87f5ea96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:18.044936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894d22a-858a-462f-a895-112f87f5ea96 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:18.125496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1252/2532] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:08:18 2022] POST /identity/v3/projects => generated 389 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:08:18.129836 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd9b60-3519-42c6-bd52-fe12ac343cf8 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:18.139563 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd9b60-3519-42c6-bd52-fe12ac343cf8 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:18.195100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe724e-0e7b-4146-8830-5ec85b1e8383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:18.195717 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe724e-0e7b-4146-8830-5ec85b1e8383 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:18.196004 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe724e-0e7b-4146-8830-5ec85b1e8383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:18.196281 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe724e-0e7b-4146-8830-5ec85b1e8383 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:18.196952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe724e-0e7b-4146-8830-5ec85b1e8383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:18.199397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe724e-0e7b-4146-8830-5ec85b1e8383 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:18.283184 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1281/2533] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:08:18 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:08:18.287702 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894d22a-858a-462f-a895-112f87f5ea96 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:18.298252 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894d22a-858a-462f-a895-112f87f5ea96 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:18.302946 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada0c23-5dc9-4a04-8472-e2bdd593e059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:18.303551 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada0c23-5dc9-4a04-8472-e2bdd593e059 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:18.303834 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada0c23-5dc9-4a04-8472-e2bdd593e059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:18.304106 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada0c23-5dc9-4a04-8472-e2bdd593e059 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:18.304797 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada0c23-5dc9-4a04-8472-e2bdd593e059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:18.306409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada0c23-5dc9-4a04-8472-e2bdd593e059 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:18.316232 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1253/2534] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:08:18.320124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe724e-0e7b-4146-8830-5ec85b1e8383 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:18.331132 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe724e-0e7b-4146-8830-5ec85b1e8383 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:18.335822 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80235341-fc93-4103-8125-1f062600bf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:18.336432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80235341-fc93-4103-8125-1f062600bf20 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:18.336721 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80235341-fc93-4103-8125-1f062600bf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:18.337004 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80235341-fc93-4103-8125-1f062600bf20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:18.337702 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80235341-fc93-4103-8125-1f062600bf20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:18.339981 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80235341-fc93-4103-8125-1f062600bf20 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:18.350571 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1282/2535] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:08:18.354811 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada0c23-5dc9-4a04-8472-e2bdd593e059 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:18.364724 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada0c23-5dc9-4a04-8472-e2bdd593e059 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:18.369323 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e821c-e2a0-4029-8b5f-602aa5376719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:18.369975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e821c-e2a0-4029-8b5f-602aa5376719 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:18.370258 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e821c-e2a0-4029-8b5f-602aa5376719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:18.370536 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e821c-e2a0-4029-8b5f-602aa5376719 admin admin] PATH_INFO: `/v3/projects/bd6bda57e3854ab8a0ebcfc10e3e220c/users/39d9d418bf874b8cbdc011d20b6d94ac/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:18.385546 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e821c-e2a0-4029-8b5f-602aa5376719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd6bda57e3854ab8a0ebcfc10e3e220c, user_id=39d9d418bf874b8cbdc011d20b6d94ac, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:18.388271 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e821c-e2a0-4029-8b5f-602aa5376719 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:18.461188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1254/2536] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:08:18 2022] PUT /identity/v3/projects/bd6bda57e3854ab8a0ebcfc10e3e220c/users/39d9d418bf874b8cbdc011d20b6d94ac/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:08:18.472052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f2238-4f2f-429d-93fc-972de972f280 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:18.472344 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f2238-4f2f-429d-93fc-972de972f280 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:18.472623 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f2238-4f2f-429d-93fc-972de972f280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:18.499796 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-a27f2238-4f2f-429d-93fc-972de972f280 None None] MFA Rules not processed for user `39d9d418bf874b8cbdc011d20b6d94ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:18.501025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-a27f2238-4f2f-429d-93fc-972de972f280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:18.565214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1283/2537] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:08:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:18.576483 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e821c-e2a0-4029-8b5f-602aa5376719 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:18.578186 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-749e821c-e2a0-4029-8b5f-602aa5376719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:18.599899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:18.634684 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e821c-e2a0-4029-8b5f-602aa5376719 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:18.638988 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdea1f-30ee-4ad4-9f50-fffecb34d8ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:18.639596 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdea1f-30ee-4ad4-9f50-fffecb34d8ca service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:18.642199 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdea1f-30ee-4ad4-9f50-fffecb34d8ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:18.642199 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdea1f-30ee-4ad4-9f50-fffecb34d8ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:18.648309 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afdea1f-30ee-4ad4-9f50-fffecb34d8ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:18.649763 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afdea1f-30ee-4ad4-9f50-fffecb34d8ca service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:18.658375 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1255/2538] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:08:18 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:08:28.562320 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:28.690194 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=17 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:39.457074 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6a271-67e2-4821-8861-ab7a6e3ebde6 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:39.457552 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6a271-67e2-4821-8861-ab7a6e3ebde6 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:39.457653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6a271-67e2-4821-8861-ab7a6e3ebde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:39.476291 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-baf6a271-67e2-4821-8861-ab7a6e3ebde6 None None] MFA Rules not processed for user `b2ccafac03aa420db7f76165f20b0d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:39.477563 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-baf6a271-67e2-4821-8861-ab7a6e3ebde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:39.531678 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1284/2539] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:08:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:43.322530 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdea1f-30ee-4ad4-9f50-fffecb34d8ca service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:43.399132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdea1f-30ee-4ad4-9f50-fffecb34d8ca service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:43.403975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4243d0a-df2d-461d-abba-36bdd8eba2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:43.404684 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4243d0a-df2d-461d-abba-36bdd8eba2a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:43.405703 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4243d0a-df2d-461d-abba-36bdd8eba2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:43.405703 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4243d0a-df2d-461d-abba-36bdd8eba2a6 admin admin] PATH_INFO: `/v3/users/39d9d418bf874b8cbdc011d20b6d94ac` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:43.406638 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4243d0a-df2d-461d-abba-36bdd8eba2a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d9d418bf874b8cbdc011d20b6d94ac)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:43.408748 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4243d0a-df2d-461d-abba-36bdd8eba2a6 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:43.589019 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b4243d0a-df2d-461d-abba-36bdd8eba2a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d9d418bf874b8cbdc011d20b6d94ac'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:43.596194 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b4243d0a-df2d-461d-abba-36bdd8eba2a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d9d418bf874b8cbdc011d20b6d94ac'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:43.677220 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b4243d0a-df2d-461d-abba-36bdd8eba2a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d9d418bf874b8cbdc011d20b6d94ac'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:43.678151 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b4243d0a-df2d-461d-abba-36bdd8eba2a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d9d418bf874b8cbdc011d20b6d94ac'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:43.693132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-b4243d0a-df2d-461d-abba-36bdd8eba2a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d9d418bf874b8cbdc011d20b6d94ac'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:43.699745 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1256/2540] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:08:43 2022] DELETE /identity/v3/users/39d9d418bf874b8cbdc011d20b6d94ac => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:08:43.704261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b9b34-8802-4945-90a8-4b1997d9647d None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:43.704729 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b9b34-8802-4945-90a8-4b1997d9647d None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:43.710972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b9b34-8802-4945-90a8-4b1997d9647d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:43.723789 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-867b9b34-8802-4945-90a8-4b1997d9647d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:43.725016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-867b9b34-8802-4945-90a8-4b1997d9647d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:43.820322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1285/2541] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:43.831773 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4243d0a-df2d-461d-abba-36bdd8eba2a6 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:43.833392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b4243d0a-df2d-461d-abba-36bdd8eba2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:43.901497 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4243d0a-df2d-461d-abba-36bdd8eba2a6 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:43.905497 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48564359-dfb6-41bc-9191-6b034cc0d52d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:43.906122 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48564359-dfb6-41bc-9191-6b034cc0d52d service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:43.906461 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48564359-dfb6-41bc-9191-6b034cc0d52d service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:43.906769 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48564359-dfb6-41bc-9191-6b034cc0d52d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:43.918097 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48564359-dfb6-41bc-9191-6b034cc0d52d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:43.923293 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48564359-dfb6-41bc-9191-6b034cc0d52d service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:43.931542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1257/2542] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:08:44.469388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b9b34-8802-4945-90a8-4b1997d9647d None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:44.471125 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-867b9b34-8802-4945-90a8-4b1997d9647d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:44.495767 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b9b34-8802-4945-90a8-4b1997d9647d None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:44.503714 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24296422-1a4a-4731-b6f1-f52d3b1cbb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:44.504892 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24296422-1a4a-4731-b6f1-f52d3b1cbb10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:44.504892 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24296422-1a4a-4731-b6f1-f52d3b1cbb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:44.505110 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24296422-1a4a-4731-b6f1-f52d3b1cbb10 admin admin] PATH_INFO: `/v3/projects/bd6bda57e3854ab8a0ebcfc10e3e220c` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:44.506368 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24296422-1a4a-4731-b6f1-f52d3b1cbb10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd6bda57e3854ab8a0ebcfc10e3e220c)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:44.509604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24296422-1a4a-4731-b6f1-f52d3b1cbb10 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:44.673644 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-24296422-1a4a-4731-b6f1-f52d3b1cbb10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd6bda57e3854ab8a0ebcfc10e3e220c', 'request_id': 'req-24296422-1a4a-4731-b6f1-f52d3b1cbb10'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:44.679835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-24296422-1a4a-4731-b6f1-f52d3b1cbb10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd6bda57e3854ab8a0ebcfc10e3e220c', 'request_id': 'req-24296422-1a4a-4731-b6f1-f52d3b1cbb10'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:44.771093 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-24296422-1a4a-4731-b6f1-f52d3b1cbb10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd6bda57e3854ab8a0ebcfc10e3e220c', 'request_id': 'req-24296422-1a4a-4731-b6f1-f52d3b1cbb10'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:44.790357 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-24296422-1a4a-4731-b6f1-f52d3b1cbb10 admin admin] The token cache is being invalidate because project bd6bda57e3854ab8a0ebcfc10e3e220c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:08:44.790357 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-24296422-1a4a-4731-b6f1-f52d3b1cbb10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:44.790958 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-24296422-1a4a-4731-b6f1-f52d3b1cbb10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:44.792718 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1286/2543] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:08:44 2022] DELETE /identity/v3/projects/bd6bda57e3854ab8a0ebcfc10e3e220c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:08:44.799103 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dd56b-63f5-42a2-94bd-3427f7d4646b None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:44.799565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dd56b-63f5-42a2-94bd-3427f7d4646b None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:44.800030 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dd56b-63f5-42a2-94bd-3427f7d4646b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:44.825017 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-a31dd56b-63f5-42a2-94bd-3427f7d4646b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:44.826258 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a31dd56b-63f5-42a2-94bd-3427f7d4646b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:44.849485 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:44.904375 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1258/2544] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:44.971066 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48add166-78d5-4a78-9e60-3f1f2aea7560 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:44.971362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48add166-78d5-4a78-9e60-3f1f2aea7560 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:44.971637 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48add166-78d5-4a78-9e60-3f1f2aea7560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:45.001941 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-48add166-78d5-4a78-9e60-3f1f2aea7560 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:45.003361 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-48add166-78d5-4a78-9e60-3f1f2aea7560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:45.012234 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1287/2545] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:45.016502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dd56b-63f5-42a2-94bd-3427f7d4646b None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:45.026033 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dd56b-63f5-42a2-94bd-3427f7d4646b None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:45.030623 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecd8ba-3f69-47ff-bcf2-0a3e59cdafe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:45.031347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecd8ba-3f69-47ff-bcf2-0a3e59cdafe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:45.031619 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecd8ba-3f69-47ff-bcf2-0a3e59cdafe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:45.032141 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecd8ba-3f69-47ff-bcf2-0a3e59cdafe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:45.032995 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ecd8ba-3f69-47ff-bcf2-0a3e59cdafe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:08:45.033762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ecd8ba-3f69-47ff-bcf2-0a3e59cdafe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:45.035770 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ecd8ba-3f69-47ff-bcf2-0a3e59cdafe7 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:45.047417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1259/2546] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:08:45.052087 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48add166-78d5-4a78-9e60-3f1f2aea7560 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:45.068732 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48add166-78d5-4a78-9e60-3f1f2aea7560 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:45.075233 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d24df-ab81-4964-be70-96a1d91355b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:45.076185 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d24df-ab81-4964-be70-96a1d91355b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:45.076541 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d24df-ab81-4964-be70-96a1d91355b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:45.076886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d24df-ab81-4964-be70-96a1d91355b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:45.077758 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d24df-ab81-4964-be70-96a1d91355b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:45.080194 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d24df-ab81-4964-be70-96a1d91355b3 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:45.206524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:45.216913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1288/2547] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:08:45 2022] POST /identity/v3/projects => generated 397 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:08:45.218181 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecd8ba-3f69-47ff-bcf2-0a3e59cdafe7 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:45.238385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecd8ba-3f69-47ff-bcf2-0a3e59cdafe7 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:45.313094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be910f-7019-4473-990e-4970d120c9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:45.313720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be910f-7019-4473-990e-4970d120c9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:45.314001 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be910f-7019-4473-990e-4970d120c9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:45.314279 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be910f-7019-4473-990e-4970d120c9d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:45.315026 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be910f-7019-4473-990e-4970d120c9d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:45.317321 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be910f-7019-4473-990e-4970d120c9d4 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:45.393183 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1260/2548] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:08:45 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:08:45.397107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d24df-ab81-4964-be70-96a1d91355b3 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:45.407458 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d24df-ab81-4964-be70-96a1d91355b3 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:45.412353 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f469f4a-390b-42d3-b261-5e39756ed696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:45.412941 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f469f4a-390b-42d3-b261-5e39756ed696 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:45.413226 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f469f4a-390b-42d3-b261-5e39756ed696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:45.413509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f469f4a-390b-42d3-b261-5e39756ed696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:45.414200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f469f4a-390b-42d3-b261-5e39756ed696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:45.415818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f469f4a-390b-42d3-b261-5e39756ed696 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:45.426199 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1289/2549] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:08:45.430002 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be910f-7019-4473-990e-4970d120c9d4 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:45.442715 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be910f-7019-4473-990e-4970d120c9d4 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:45.447540 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04155a-6423-4bc5-86d4-523cb85b9644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:45.448154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04155a-6423-4bc5-86d4-523cb85b9644 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:45.448443 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04155a-6423-4bc5-86d4-523cb85b9644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:45.448725 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04155a-6423-4bc5-86d4-523cb85b9644 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:45.449422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04155a-6423-4bc5-86d4-523cb85b9644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:45.451064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04155a-6423-4bc5-86d4-523cb85b9644 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:45.460972 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1261/2550] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:08:45.465138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f469f4a-390b-42d3-b261-5e39756ed696 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:45.475166 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f469f4a-390b-42d3-b261-5e39756ed696 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:45.480495 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3506f-dbb6-4a56-bed7-02e75840b67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:45.481247 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3506f-dbb6-4a56-bed7-02e75840b67d admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:45.481535 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3506f-dbb6-4a56-bed7-02e75840b67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:45.481933 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3506f-dbb6-4a56-bed7-02e75840b67d admin admin] PATH_INFO: `/v3/projects/07309004c02947db8151f40fa0afcaf7/users/52b443eaac454e0eb53331b4c86bc2e6/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:45.497535 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3506f-dbb6-4a56-bed7-02e75840b67d admin admin] RBAC: Authorizing `identity:create_grant(project_id=07309004c02947db8151f40fa0afcaf7, user_id=52b443eaac454e0eb53331b4c86bc2e6, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:45.500169 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3506f-dbb6-4a56-bed7-02e75840b67d admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:45.569348 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1290/2551] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:08:45 2022] PUT /identity/v3/projects/07309004c02947db8151f40fa0afcaf7/users/52b443eaac454e0eb53331b4c86bc2e6/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:08:45.579223 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5302a4-ef2e-4e74-990e-c6084b4186cf None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:45.579602 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5302a4-ef2e-4e74-990e-c6084b4186cf None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:45.579914 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5302a4-ef2e-4e74-990e-c6084b4186cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:45.610517 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-ed5302a4-ef2e-4e74-990e-c6084b4186cf None None] MFA Rules not processed for user `52b443eaac454e0eb53331b4c86bc2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:45.611759 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-ed5302a4-ef2e-4e74-990e-c6084b4186cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:45.677967 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1262/2552] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:08:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:45.689456 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3506f-dbb6-4a56-bed7-02e75840b67d admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:45.691264 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-98e3506f-dbb6-4a56-bed7-02e75840b67d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:45.749085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3506f-dbb6-4a56-bed7-02e75840b67d admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:45.752684 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc6e1f-08e7-4707-948e-3868306e2003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:45.753307 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc6e1f-08e7-4707-948e-3868306e2003 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:45.753594 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc6e1f-08e7-4707-948e-3868306e2003 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:45.753872 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc6e1f-08e7-4707-948e-3868306e2003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:45.763493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc6e1f-08e7-4707-948e-3868306e2003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:45.765227 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc6e1f-08e7-4707-948e-3868306e2003 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:45.774753 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1291/2553] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:08:45 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:08:55.675070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:55.770462 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:55.821945 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5302a4-ef2e-4e74-990e-c6084b4186cf None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:55.897460 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5302a4-ef2e-4e74-990e-c6084b4186cf None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:55.903371 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511597b-2879-4fc6-916c-f58beb2ea2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:55.904327 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511597b-2879-4fc6-916c-f58beb2ea2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:55.904615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511597b-2879-4fc6-916c-f58beb2ea2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:55.905306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511597b-2879-4fc6-916c-f58beb2ea2fa admin admin] PATH_INFO: `/v3/users/52b443eaac454e0eb53331b4c86bc2e6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:55.906149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511597b-2879-4fc6-916c-f58beb2ea2fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=52b443eaac454e0eb53331b4c86bc2e6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:55.908295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511597b-2879-4fc6-916c-f58beb2ea2fa admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:56.103022 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-4511597b-2879-4fc6-916c-f58beb2ea2fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52b443eaac454e0eb53331b4c86bc2e6'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:56.109975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-4511597b-2879-4fc6-916c-f58beb2ea2fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52b443eaac454e0eb53331b4c86bc2e6'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:56.175718 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-4511597b-2879-4fc6-916c-f58beb2ea2fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52b443eaac454e0eb53331b4c86bc2e6'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:56.176357 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-4511597b-2879-4fc6-916c-f58beb2ea2fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52b443eaac454e0eb53331b4c86bc2e6'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:56.190090 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-4511597b-2879-4fc6-916c-f58beb2ea2fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52b443eaac454e0eb53331b4c86bc2e6'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:56.196239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1263/2554] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:08:55 2022] DELETE /identity/v3/users/52b443eaac454e0eb53331b4c86bc2e6 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:08:56.201586 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21d878-24cc-4991-a31f-d43b2b2004f4 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:56.201959 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21d878-24cc-4991-a31f-d43b2b2004f4 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:56.202306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21d878-24cc-4991-a31f-d43b2b2004f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:56.221939 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-dc21d878-24cc-4991-a31f-d43b2b2004f4 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:56.223205 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-dc21d878-24cc-4991-a31f-d43b2b2004f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:56.284298 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1292/2555] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:56.296000 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511597b-2879-4fc6-916c-f58beb2ea2fa admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:56.297930 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-4511597b-2879-4fc6-916c-f58beb2ea2fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:56.357139 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511597b-2879-4fc6-916c-f58beb2ea2fa admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:56.360738 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68555b6f-d04a-49b5-8973-31d3902df71d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:56.361362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68555b6f-d04a-49b5-8973-31d3902df71d service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:56.361649 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68555b6f-d04a-49b5-8973-31d3902df71d service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:56.361930 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68555b6f-d04a-49b5-8973-31d3902df71d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:56.371620 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68555b6f-d04a-49b5-8973-31d3902df71d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:56.373792 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68555b6f-d04a-49b5-8973-31d3902df71d service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:56.382726 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1264/2556] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:08:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:08:56.811013 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21d878-24cc-4991-a31f-d43b2b2004f4 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:56.812599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-dc21d878-24cc-4991-a31f-d43b2b2004f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:56.824912 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21d878-24cc-4991-a31f-d43b2b2004f4 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:56.830569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43d10a-200c-4a55-a2ea-05832b19ad17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:56.831260 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43d10a-200c-4a55-a2ea-05832b19ad17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:56.831599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43d10a-200c-4a55-a2ea-05832b19ad17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:56.831880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43d10a-200c-4a55-a2ea-05832b19ad17 admin admin] PATH_INFO: `/v3/projects/07309004c02947db8151f40fa0afcaf7` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:56.833097 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43d10a-200c-4a55-a2ea-05832b19ad17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07309004c02947db8151f40fa0afcaf7)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:56.835050 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43d10a-200c-4a55-a2ea-05832b19ad17 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:56.975974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9d43d10a-200c-4a55-a2ea-05832b19ad17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07309004c02947db8151f40fa0afcaf7', 'request_id': 'req-9d43d10a-200c-4a55-a2ea-05832b19ad17'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:56.984128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9d43d10a-200c-4a55-a2ea-05832b19ad17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07309004c02947db8151f40fa0afcaf7', 'request_id': 'req-9d43d10a-200c-4a55-a2ea-05832b19ad17'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:57.082758 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9d43d10a-200c-4a55-a2ea-05832b19ad17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07309004c02947db8151f40fa0afcaf7', 'request_id': 'req-9d43d10a-200c-4a55-a2ea-05832b19ad17'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:57.094462 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9d43d10a-200c-4a55-a2ea-05832b19ad17 admin admin] The token cache is being invalidate because project 07309004c02947db8151f40fa0afcaf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:08:57.094784 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9d43d10a-200c-4a55-a2ea-05832b19ad17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:57.095425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9d43d10a-200c-4a55-a2ea-05832b19ad17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:08:57.096976 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1293/2557] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:08:56 2022] DELETE /identity/v3/projects/07309004c02947db8151f40fa0afcaf7 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:08:57.102051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27031f04-cdaa-4168-8232-b7b83d95bfff None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:57.102537 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27031f04-cdaa-4168-8232-b7b83d95bfff None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:57.102633 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27031f04-cdaa-4168-8232-b7b83d95bfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:57.123544 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-27031f04-cdaa-4168-8232-b7b83d95bfff None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:57.124726 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-27031f04-cdaa-4168-8232-b7b83d95bfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:57.142181 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:57.205240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1265/2558] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:57.207480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70455e8-377f-4630-a16e-13063f8b9591 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:57.211120 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70455e8-377f-4630-a16e-13063f8b9591 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:57.219389 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70455e8-377f-4630-a16e-13063f8b9591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:57.231882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-c70455e8-377f-4630-a16e-13063f8b9591 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:57.233115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-c70455e8-377f-4630-a16e-13063f8b9591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:57.242241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1294/2559] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:57.256432 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27031f04-cdaa-4168-8232-b7b83d95bfff None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:57.266975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27031f04-cdaa-4168-8232-b7b83d95bfff None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:57.272805 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb3478-9d2f-4a16-99cd-7bedc8e94c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:57.273437 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb3478-9d2f-4a16-99cd-7bedc8e94c8c admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:57.273720 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb3478-9d2f-4a16-99cd-7bedc8e94c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:57.273997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb3478-9d2f-4a16-99cd-7bedc8e94c8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:57.274701 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb3478-9d2f-4a16-99cd-7bedc8e94c8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:08:57.275043 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb3478-9d2f-4a16-99cd-7bedc8e94c8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:57.277259 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb3478-9d2f-4a16-99cd-7bedc8e94c8c admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:57.295077 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1266/2560] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:08:57.299613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70455e8-377f-4630-a16e-13063f8b9591 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:57.309237 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70455e8-377f-4630-a16e-13063f8b9591 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:57.314150 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26693f-9fee-403f-a170-2d978779ff03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:57.318797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26693f-9fee-403f-a170-2d978779ff03 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:57.318797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26693f-9fee-403f-a170-2d978779ff03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:57.318797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26693f-9fee-403f-a170-2d978779ff03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:57.318797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26693f-9fee-403f-a170-2d978779ff03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:57.318797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26693f-9fee-403f-a170-2d978779ff03 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:57.458766 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1295/2561] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:08:57 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:08:57.463018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb3478-9d2f-4a16-99cd-7bedc8e94c8c admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:57.473742 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb3478-9d2f-4a16-99cd-7bedc8e94c8c admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:57.536701 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c290359-08d0-4d5f-bde9-d79de9a64aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:57.537323 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c290359-08d0-4d5f-bde9-d79de9a64aac admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:57.537606 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c290359-08d0-4d5f-bde9-d79de9a64aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:57.537999 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c290359-08d0-4d5f-bde9-d79de9a64aac admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:57.538670 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c290359-08d0-4d5f-bde9-d79de9a64aac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:57.540630 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c290359-08d0-4d5f-bde9-d79de9a64aac admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:57.619203 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1267/2562] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:08:57 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:08:57.621029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26693f-9fee-403f-a170-2d978779ff03 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:57.631696 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26693f-9fee-403f-a170-2d978779ff03 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:57.636945 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41918d4e-bf72-4053-85de-bd56e64d284a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:57.637559 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41918d4e-bf72-4053-85de-bd56e64d284a admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:57.637851 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41918d4e-bf72-4053-85de-bd56e64d284a admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:57.643310 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41918d4e-bf72-4053-85de-bd56e64d284a admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:57.643310 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41918d4e-bf72-4053-85de-bd56e64d284a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:57.643310 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41918d4e-bf72-4053-85de-bd56e64d284a admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:57.650830 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1296/2563] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:08:57.654608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c290359-08d0-4d5f-bde9-d79de9a64aac admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:57.664956 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c290359-08d0-4d5f-bde9-d79de9a64aac admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:57.669577 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e05bc-9102-481c-8bf4-517719986e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:57.670184 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e05bc-9102-481c-8bf4-517719986e7e admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:57.670465 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e05bc-9102-481c-8bf4-517719986e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:57.670887 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e05bc-9102-481c-8bf4-517719986e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:57.671458 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e05bc-9102-481c-8bf4-517719986e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:57.673056 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e05bc-9102-481c-8bf4-517719986e7e admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:57.684188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1268/2564] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:08:57.690403 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41918d4e-bf72-4053-85de-bd56e64d284a admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:57.701240 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41918d4e-bf72-4053-85de-bd56e64d284a admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:57.706036 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9d856-5870-4481-8f49-83da42b50c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:57.706789 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9d856-5870-4481-8f49-83da42b50c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:57.707146 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9d856-5870-4481-8f49-83da42b50c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:57.707492 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9d856-5870-4481-8f49-83da42b50c5c admin admin] PATH_INFO: `/v3/projects/8d0b838da49141f99cb5073f13024892/users/5094778e88de495d96981c16da9ee916/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:57.722375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9d856-5870-4481-8f49-83da42b50c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d0b838da49141f99cb5073f13024892, user_id=5094778e88de495d96981c16da9ee916, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:57.725181 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9d856-5870-4481-8f49-83da42b50c5c admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:57.810258 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1297/2565] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:08:57 2022] PUT /identity/v3/projects/8d0b838da49141f99cb5073f13024892/users/5094778e88de495d96981c16da9ee916/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:08:57.815418 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf6257-e2a8-4705-9df7-5150cae51a6b None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:57.815741 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf6257-e2a8-4705-9df7-5150cae51a6b None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:57.816022 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf6257-e2a8-4705-9df7-5150cae51a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:57.835220 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-d9cf6257-e2a8-4705-9df7-5150cae51a6b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:57.836439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-d9cf6257-e2a8-4705-9df7-5150cae51a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:57.898049 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1269/2566] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:57.908426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9d856-5870-4481-8f49-83da42b50c5c admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:57.910498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-30d9d856-5870-4481-8f49-83da42b50c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:57.935601 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:57.978519 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9d856-5870-4481-8f49-83da42b50c5c admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:57.982753 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a03ca4-8cea-4d79-addb-149f726a6ca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:57.983399 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a03ca4-8cea-4d79-addb-149f726a6ca4 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:57.983686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a03ca4-8cea-4d79-addb-149f726a6ca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:57.983967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a03ca4-8cea-4d79-addb-149f726a6ca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:57.993507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a03ca4-8cea-4d79-addb-149f726a6ca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:57.994975 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a03ca4-8cea-4d79-addb-149f726a6ca4 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:58.005635 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1298/2567] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:09:00.831357 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c524ba-6559-4669-8b28-46b4bf929de9 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:09:00.831867 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c524ba-6559-4669-8b28-46b4bf929de9 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:09:00.831953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c524ba-6559-4669-8b28-46b4bf929de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:09:00.854133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-35c524ba-6559-4669-8b28-46b4bf929de9 None None] MFA Rules not processed for user `36693fa42a7b41279c8d8c59ecafb243`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:09:00.854133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-35c524ba-6559-4669-8b28-46b4bf929de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:09:00.891114 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:00.942891 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1270/2568] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:09:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:09:04.586254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a58f6-95a1-4ace-9ef3-cffab1f5abad None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:09:04.586653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a58f6-95a1-4ace-9ef3-cffab1f5abad None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:09:04.586910 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a58f6-95a1-4ace-9ef3-cffab1f5abad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:09:04.657490 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-ee6a58f6-95a1-4ace-9ef3-cffab1f5abad None None] MFA Rules not processed for user `5094778e88de495d96981c16da9ee916`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:09:04.668260 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ee6a58f6-95a1-4ace-9ef3-cffab1f5abad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:09:04.768723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1299/2569] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:09:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:09:04.769712 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c524ba-6559-4669-8b28-46b4bf929de9 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:09:04.783062 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c524ba-6559-4669-8b28-46b4bf929de9 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:09:04.792168 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e482473-579c-436f-b496-739d2b531957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:09:04.793087 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e482473-579c-436f-b496-739d2b531957 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:09:04.796322 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e482473-579c-436f-b496-739d2b531957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:09:04.796322 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e482473-579c-436f-b496-739d2b531957 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:09:04.796322 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e482473-579c-436f-b496-739d2b531957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:09:04.796322 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e482473-579c-436f-b496-739d2b531957 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:09:05.066684 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1271/2570] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:09:04 2022] POST /identity/v3/projects => generated 369 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:09:05.067822 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a58f6-95a1-4ace-9ef3-cffab1f5abad None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:09:05.079924 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a58f6-95a1-4ace-9ef3-cffab1f5abad None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:09:05.166439 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41391772-c9d0-48db-9d99-81538acb7590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:09:05.167276 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41391772-c9d0-48db-9d99-81538acb7590 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:09:05.167547 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41391772-c9d0-48db-9d99-81538acb7590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:09:05.167825 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41391772-c9d0-48db-9d99-81538acb7590 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:09:05.168988 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41391772-c9d0-48db-9d99-81538acb7590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:09:05.171609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41391772-c9d0-48db-9d99-81538acb7590 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:09:05.297648 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1300/2571] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:09:05 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:09:05.301774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e482473-579c-436f-b496-739d2b531957 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:09:05.320291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e482473-579c-436f-b496-739d2b531957 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:09:05.324045 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e15b8d-974b-46fa-92cc-37908c384000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:09:05.325008 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e15b8d-974b-46fa-92cc-37908c384000 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:09:05.325230 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e15b8d-974b-46fa-92cc-37908c384000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:09:05.325733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e15b8d-974b-46fa-92cc-37908c384000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:09:05.326518 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e15b8d-974b-46fa-92cc-37908c384000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:09:05.328373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e15b8d-974b-46fa-92cc-37908c384000 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:09:05.340294 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1272/2572] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:09:05.344427 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41391772-c9d0-48db-9d99-81538acb7590 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:09:05.361881 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41391772-c9d0-48db-9d99-81538acb7590 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:09:05.369404 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2902c-3318-41dc-9560-af24ea5f4ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:09:05.370795 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2902c-3318-41dc-9560-af24ea5f4ace admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:09:05.371160 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2902c-3318-41dc-9560-af24ea5f4ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:09:05.371544 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2902c-3318-41dc-9560-af24ea5f4ace admin admin] PATH_INFO: `/v3/projects/686c4b066ad44a6fa1ba2265870cdcab/users/d4228f04dfbf4b17b3b076c87782b58f/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:09:05.388372 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2902c-3318-41dc-9560-af24ea5f4ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=686c4b066ad44a6fa1ba2265870cdcab, user_id=d4228f04dfbf4b17b3b076c87782b58f, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:09:05.402415 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2902c-3318-41dc-9560-af24ea5f4ace admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:09:05.503624 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1301/2573] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:09:05 2022] PUT /identity/v3/projects/686c4b066ad44a6fa1ba2265870cdcab/users/d4228f04dfbf4b17b3b076c87782b58f/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:09:05.505623 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e15b8d-974b-46fa-92cc-37908c384000 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:09:05.516438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e15b8d-974b-46fa-92cc-37908c384000 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:09:05.581202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889174a5-5a2f-4888-9fd8-4a4f1bf1bed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:09:05.581832 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889174a5-5a2f-4888-9fd8-4a4f1bf1bed0 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:09:05.582116 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889174a5-5a2f-4888-9fd8-4a4f1bf1bed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:09:05.582496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889174a5-5a2f-4888-9fd8-4a4f1bf1bed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:09:05.583127 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889174a5-5a2f-4888-9fd8-4a4f1bf1bed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:09:05.584770 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889174a5-5a2f-4888-9fd8-4a4f1bf1bed0 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:09:05.600999 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1273/2574] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:09:05.602790 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2902c-3318-41dc-9560-af24ea5f4ace admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:09:05.614507 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2902c-3318-41dc-9560-af24ea5f4ace admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:09:05.619939 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ae64d-dc0a-4ba9-9f99-3329d830ac97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:09:05.621182 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ae64d-dc0a-4ba9-9f99-3329d830ac97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:09:05.621469 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ae64d-dc0a-4ba9-9f99-3329d830ac97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:09:05.621754 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ae64d-dc0a-4ba9-9f99-3329d830ac97 admin admin] PATH_INFO: `/v3/projects/686c4b066ad44a6fa1ba2265870cdcab/users/d4228f04dfbf4b17b3b076c87782b58f/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:09:05.623825 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ae64d-dc0a-4ba9-9f99-3329d830ac97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=686c4b066ad44a6fa1ba2265870cdcab, user_id=d4228f04dfbf4b17b3b076c87782b58f, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:09:05.626555 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ae64d-dc0a-4ba9-9f99-3329d830ac97 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:09:05.639006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1302/2575] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:09:05 2022] PUT /identity/v3/projects/686c4b066ad44a6fa1ba2265870cdcab/users/d4228f04dfbf4b17b3b076c87782b58f/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:09:11.953145 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920884c-75f0-4dc6-842a-73751dedca03 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:09:11.953667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920884c-75f0-4dc6-842a-73751dedca03 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:09:11.953751 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920884c-75f0-4dc6-842a-73751dedca03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:09:11.983037 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-9920884c-75f0-4dc6-842a-73751dedca03 None None] MFA Rules not processed for user `d4228f04dfbf4b17b3b076c87782b58f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:09:11.988737 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-9920884c-75f0-4dc6-842a-73751dedca03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:09:12.056924 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1274/2576] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:09:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:09:12.072809 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ae64d-dc0a-4ba9-9f99-3329d830ac97 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:09:12.076228 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-585ae64d-dc0a-4ba9-9f99-3329d830ac97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:09:12.081814 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:12.186801 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ae64d-dc0a-4ba9-9f99-3329d830ac97 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:09:12.192625 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e17ac6-1542-400b-b5b5-7eed2219278d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:09:12.193260 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e17ac6-1542-400b-b5b5-7eed2219278d service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:09:12.193551 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e17ac6-1542-400b-b5b5-7eed2219278d service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:09:12.193837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e17ac6-1542-400b-b5b5-7eed2219278d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:09:12.255417 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e17ac6-1542-400b-b5b5-7eed2219278d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:09:12.257308 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e17ac6-1542-400b-b5b5-7eed2219278d service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:09:12.266498 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1303/2577] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:09:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:09:14.633859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44445648-e034-4ce1-8054-4e5831014fd7 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:09:14.634382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44445648-e034-4ce1-8054-4e5831014fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:09:14.634500 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44445648-e034-4ce1-8054-4e5831014fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:09:14.655428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-44445648-e034-4ce1-8054-4e5831014fd7 None None] MFA Rules not processed for user `5094778e88de495d96981c16da9ee916`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:09:14.656670 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-44445648-e034-4ce1-8054-4e5831014fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:09:14.665015 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1275/2578] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:09:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:09:20.362115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47296df0-1a08-4e70-a0ed-47e256a2a877 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:09:20.362631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47296df0-1a08-4e70-a0ed-47e256a2a877 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:09:20.362927 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47296df0-1a08-4e70-a0ed-47e256a2a877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:09:20.397360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-47296df0-1a08-4e70-a0ed-47e256a2a877 None None] MFA Rules not processed for user `b9d70abf4f754530a3cf6efa7a782736`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:09:20.398590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-47296df0-1a08-4e70-a0ed-47e256a2a877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:09:20.473009 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1304/2579] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 3 13:09:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:09:20.661024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44445648-e034-4ce1-8054-4e5831014fd7 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:09:20.662557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-44445648-e034-4ce1-8054-4e5831014fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:09:20.697246 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:20.754622 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44445648-e034-4ce1-8054-4e5831014fd7 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:09:20.770765 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1ccc0-d68b-45a4-af57-9884264216d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5209ec838a4f45d6b746edb27970c93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:09:20.771575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1ccc0-d68b-45a4-af57-9884264216d8 service swift] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:09:20.771865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1ccc0-d68b-45a4-af57-9884264216d8 service swift] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:09:20.772220 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1ccc0-d68b-45a4-af57-9884264216d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:09:20.784190 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1ccc0-d68b-45a4-af57-9884264216d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:09:20.786312 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1ccc0-d68b-45a4-af57-9884264216d8 service swift] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:09:20.798656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1276/2580] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 3 13:09:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:09:24.491065 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47296df0-1a08-4e70-a0ed-47e256a2a877 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:09:24.492879 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-47296df0-1a08-4e70-a0ed-47e256a2a877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:09:24.515605 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:24.569631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47296df0-1a08-4e70-a0ed-47e256a2a877 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:09:24.573296 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab92aa-1cc3-4e54-ba96-c8114efead63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:09:24.573945 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab92aa-1cc3-4e54-ba96-c8114efead63 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:09:24.574228 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab92aa-1cc3-4e54-ba96-c8114efead63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:09:24.574538 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab92aa-1cc3-4e54-ba96-c8114efead63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:09:24.576360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-acab92aa-1cc3-4e54-ba96-c8114efead63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:09:24.592466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab92aa-1cc3-4e54-ba96-c8114efead63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:09:24.593942 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab92aa-1cc3-4e54-ba96-c8114efead63 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:09:24.608144 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1305/2581] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:09:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:09:25.834839 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1ccc0-d68b-45a4-af57-9884264216d8 service swift] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:09:25.844729 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1ccc0-d68b-45a4-af57-9884264216d8 service swift] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:09:25.848700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d839823-7dcf-4e2a-9e6d-8542110a77c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:09:25.849315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d839823-7dcf-4e2a-9e6d-8542110a77c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:09:25.849597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d839823-7dcf-4e2a-9e6d-8542110a77c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:09:25.849871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d839823-7dcf-4e2a-9e6d-8542110a77c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:09:25.851808 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-0d839823-7dcf-4e2a-9e6d-8542110a77c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:09:25.866767 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d839823-7dcf-4e2a-9e6d-8542110a77c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:09:25.868395 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d839823-7dcf-4e2a-9e6d-8542110a77c2 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:09:25.882421 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1277/2582] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:09:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:09:34.603508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=21 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:35.876745 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=31 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:40.974904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab92aa-1cc3-4e54-ba96-c8114efead63 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:09:40.976812 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-acab92aa-1cc3-4e54-ba96-c8114efead63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:09:40.992932 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab92aa-1cc3-4e54-ba96-c8114efead63 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:09:41.000898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64233298-6c82-4a78-a4d5-9fca9f21bc9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:09:41.001536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64233298-6c82-4a78-a4d5-9fca9f21bc9b service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:09:41.001819 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64233298-6c82-4a78-a4d5-9fca9f21bc9b service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:09:41.002428 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64233298-6c82-4a78-a4d5-9fca9f21bc9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:09:41.003895 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-64233298-6c82-4a78-a4d5-9fca9f21bc9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:09:41.092300 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64233298-6c82-4a78-a4d5-9fca9f21bc9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:09:41.094071 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64233298-6c82-4a78-a4d5-9fca9f21bc9b service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:09:41.113504 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1306/2583] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:09:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:09:42.881308 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb281f-958e-4ab1-9ee8-fd5c9ca50cbd None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:09:42.881762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb281f-958e-4ab1-9ee8-fd5c9ca50cbd None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:09:42.881866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb281f-958e-4ab1-9ee8-fd5c9ca50cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:09:42.911672 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-aacb281f-958e-4ab1-9ee8-fd5c9ca50cbd None None] MFA Rules not processed for user `b9d70abf4f754530a3cf6efa7a782736`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:09:42.913033 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-aacb281f-958e-4ab1-9ee8-fd5c9ca50cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:09:42.921586 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1278/2584] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Aug 3 13:09:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:09:42.935708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64233298-6c82-4a78-a4d5-9fca9f21bc9b service nova] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:09:42.948073 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64233298-6c82-4a78-a4d5-9fca9f21bc9b service nova] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:09:42.953765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c58e02-8ee5-4879-b009-3e076273490b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5209ec838a4f45d6b746edb27970c93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:09:42.954387 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c58e02-8ee5-4879-b009-3e076273490b service swift] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:09:42.954676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c58e02-8ee5-4879-b009-3e076273490b service swift] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:09:42.954982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c58e02-8ee5-4879-b009-3e076273490b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:09:42.963476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c58e02-8ee5-4879-b009-3e076273490b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:09:42.965098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c58e02-8ee5-4879-b009-3e076273490b service swift] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:09:42.973437 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1307/2585] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 3 13:09:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:09:52.900242 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:52.970047 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=47 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:09:56.921954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb281f-958e-4ab1-9ee8-fd5c9ca50cbd None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:09:56.931554 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb281f-958e-4ab1-9ee8-fd5c9ca50cbd None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:09:56.935375 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168c91a-4b1d-4ff0-96c8-13908a1a71b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:09:56.935996 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168c91a-4b1d-4ff0-96c8-13908a1a71b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:09:56.936281 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168c91a-4b1d-4ff0-96c8-13908a1a71b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:09:56.936557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168c91a-4b1d-4ff0-96c8-13908a1a71b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:09:56.938349 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-d168c91a-4b1d-4ff0-96c8-13908a1a71b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:09:56.948717 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168c91a-4b1d-4ff0-96c8-13908a1a71b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:09:56.950193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168c91a-4b1d-4ff0-96c8-13908a1a71b6 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:09:56.958656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1279/2586] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:09:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:03.638206 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a0200-de76-4fc5-a931-94cf4f3d2e28 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:03.638716 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a0200-de76-4fc5-a931-94cf4f3d2e28 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:03.638859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a0200-de76-4fc5-a931-94cf4f3d2e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:03.689139 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-0b7a0200-de76-4fc5-a931-94cf4f3d2e28 None None] MFA Rules not processed for user `b9d70abf4f754530a3cf6efa7a782736`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:03.690585 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-0b7a0200-de76-4fc5-a931-94cf4f3d2e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:03.708801 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1308/2587] 10.222.0.64 () {58 vars in 967 bytes} [Wed Aug 3 13:10:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:03.721354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168c91a-4b1d-4ff0-96c8-13908a1a71b6 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:03.743288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168c91a-4b1d-4ff0-96c8-13908a1a71b6 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:03.748252 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71e57e-8754-4c2b-a110-b897fb81ffe3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5209ec838a4f45d6b746edb27970c93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:03.748859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71e57e-8754-4c2b-a110-b897fb81ffe3 service swift] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:03.749138 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71e57e-8754-4c2b-a110-b897fb81ffe3 service swift] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:03.749409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71e57e-8754-4c2b-a110-b897fb81ffe3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:03.757438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71e57e-8754-4c2b-a110-b897fb81ffe3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:03.759032 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71e57e-8754-4c2b-a110-b897fb81ffe3 service swift] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:03.767151 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1280/2588] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Aug 3 13:10:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:10:12.210258 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a0200-de76-4fc5-a931-94cf4f3d2e28 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:12.219446 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a0200-de76-4fc5-a931-94cf4f3d2e28 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:12.223018 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72edbcc-b175-4212-aad5-5e0302b57f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:12.223619 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72edbcc-b175-4212-aad5-5e0302b57f43 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:12.223899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72edbcc-b175-4212-aad5-5e0302b57f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:12.224174 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72edbcc-b175-4212-aad5-5e0302b57f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:12.233408 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72edbcc-b175-4212-aad5-5e0302b57f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:12.234847 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72edbcc-b175-4212-aad5-5e0302b57f43 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:12.244022 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1309/2589] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:13.763912 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=16 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:22.239984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=24 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:49.366855 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71e57e-8754-4c2b-a110-b897fb81ffe3 service swift] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:49.380495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71e57e-8754-4c2b-a110-b897fb81ffe3 service swift] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:49.388227 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b44c84-d816-4424-89d7-4986859b24f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:49.388849 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b44c84-d816-4424-89d7-4986859b24f3 service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:49.389134 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b44c84-d816-4424-89d7-4986859b24f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:49.389409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b44c84-d816-4424-89d7-4986859b24f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:49.391252 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-34b44c84-d816-4424-89d7-4986859b24f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:49.469496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b44c84-d816-4424-89d7-4986859b24f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:49.471122 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b44c84-d816-4424-89d7-4986859b24f3 service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:49.489467 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1281/2590] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:59.487009 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=41 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:06.309509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72edbcc-b175-4212-aad5-5e0302b57f43 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:06.322646 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72edbcc-b175-4212-aad5-5e0302b57f43 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:06.328380 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8311c-275a-4be3-9c2c-10179c9be60b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:06.329031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8311c-275a-4be3-9c2c-10179c9be60b service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:06.329315 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8311c-275a-4be3-9c2c-10179c9be60b service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:06.329590 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8311c-275a-4be3-9c2c-10179c9be60b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:06.331406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-1bb8311c-275a-4be3-9c2c-10179c9be60b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:06.344961 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8311c-275a-4be3-9c2c-10179c9be60b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:06.348496 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8311c-275a-4be3-9c2c-10179c9be60b service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:06.359145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1310/2591] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:06.798164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b44c84-d816-4424-89d7-4986859b24f3 service nova] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:06.800661 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-34b44c84-d816-4424-89d7-4986859b24f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:06.868184 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b44c84-d816-4424-89d7-4986859b24f3 service nova] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:06.872267 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92c4f9-a373-467c-a853-3ba322a29917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:06.877013 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92c4f9-a373-467c-a853-3ba322a29917 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:06.877013 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92c4f9-a373-467c-a853-3ba322a29917 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:06.877013 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92c4f9-a373-467c-a853-3ba322a29917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:06.877013 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-db92c4f9-a373-467c-a853-3ba322a29917 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:06.939545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92c4f9-a373-467c-a853-3ba322a29917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:06.941016 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92c4f9-a373-467c-a853-3ba322a29917 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:06.952523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1282/2592] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:16.353481 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=6 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:16.946468 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=48 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:19.681724 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135189ba-78c9-4b29-bfea-b084a447ffb7 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:19.682254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135189ba-78c9-4b29-bfea-b084a447ffb7 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:19.682362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135189ba-78c9-4b29-bfea-b084a447ffb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:19.701669 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-135189ba-78c9-4b29-bfea-b084a447ffb7 None None] MFA Rules not processed for user `b2ccafac03aa420db7f76165f20b0d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:19.703002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-135189ba-78c9-4b29-bfea-b084a447ffb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:19.710015 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1311/2593] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:11:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:20.027443 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92c4f9-a373-467c-a853-3ba322a29917 service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:20.037525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92c4f9-a373-467c-a853-3ba322a29917 service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:20.041099 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7721431-d542-4c73-968f-7bad43535813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:20.041708 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7721431-d542-4c73-968f-7bad43535813 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:20.041992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7721431-d542-4c73-968f-7bad43535813 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:20.042274 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7721431-d542-4c73-968f-7bad43535813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:20.044048 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-f7721431-d542-4c73-968f-7bad43535813 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:20.054076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7721431-d542-4c73-968f-7bad43535813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:20.055530 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7721431-d542-4c73-968f-7bad43535813 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:20.063412 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1283/2594] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:20.260556 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135189ba-78c9-4b29-bfea-b084a447ffb7 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:20.271023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135189ba-78c9-4b29-bfea-b084a447ffb7 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:20.274631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be827d-ff4a-4565-a6c5-c6c0a40c2c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:20.275275 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be827d-ff4a-4565-a6c5-c6c0a40c2c4d service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:20.275554 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be827d-ff4a-4565-a6c5-c6c0a40c2c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:20.275914 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be827d-ff4a-4565-a6c5-c6c0a40c2c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:20.277582 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-f2be827d-ff4a-4565-a6c5-c6c0a40c2c4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:20.341682 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be827d-ff4a-4565-a6c5-c6c0a40c2c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:20.343167 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be827d-ff4a-4565-a6c5-c6c0a40c2c4d service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:20.353711 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1312/2595] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:20.843341 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7721431-d542-4c73-968f-7bad43535813 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:20.845819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-f7721431-d542-4c73-968f-7bad43535813 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:20.920482 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7721431-d542-4c73-968f-7bad43535813 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:20.926270 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfffd82-2369-4bd6-956b-1a76041d5f8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de27d25fad634658a1abcb776d9a7b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:20.926866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfffd82-2369-4bd6-956b-1a76041d5f8b service placement] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:20.927153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfffd82-2369-4bd6-956b-1a76041d5f8b service placement] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:20.927575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfffd82-2369-4bd6-956b-1a76041d5f8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:20.929398 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-0dfffd82-2369-4bd6-956b-1a76041d5f8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:20.942137 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfffd82-2369-4bd6-956b-1a76041d5f8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:20.943819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfffd82-2369-4bd6-956b-1a76041d5f8b service placement] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:20.954614 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1284/2596] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:21.867313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be827d-ff4a-4565-a6c5-c6c0a40c2c4d service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:21.876277 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be827d-ff4a-4565-a6c5-c6c0a40c2c4d service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:21.879933 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3430fb6-1683-4c74-b9fd-9ed28e29df6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:21.880554 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3430fb6-1683-4c74-b9fd-9ed28e29df6e service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:21.880865 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3430fb6-1683-4c74-b9fd-9ed28e29df6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:21.882511 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3430fb6-1683-4c74-b9fd-9ed28e29df6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:21.882956 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-c3430fb6-1683-4c74-b9fd-9ed28e29df6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:21.897723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3430fb6-1683-4c74-b9fd-9ed28e29df6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:21.899486 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3430fb6-1683-4c74-b9fd-9ed28e29df6e service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:21.918544 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1313/2597] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:25.465163 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfffd82-2369-4bd6-956b-1a76041d5f8b service placement] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:25.466778 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-0dfffd82-2369-4bd6-956b-1a76041d5f8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:25.482529 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfffd82-2369-4bd6-956b-1a76041d5f8b service placement] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:25.490851 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef599988-3f6e-41b2-b695-1ee270eddbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:25.491601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef599988-3f6e-41b2-b695-1ee270eddbc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:25.492488 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef599988-3f6e-41b2-b695-1ee270eddbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:25.492850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef599988-3f6e-41b2-b695-1ee270eddbc7 admin admin] PATH_INFO: `/v3/users/36693fa42a7b41279c8d8c59ecafb243` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:25.494806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef599988-3f6e-41b2-b695-1ee270eddbc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36693fa42a7b41279c8d8c59ecafb243)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:25.497229 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef599988-3f6e-41b2-b695-1ee270eddbc7 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:25.691110 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ef599988-3f6e-41b2-b695-1ee270eddbc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36693fa42a7b41279c8d8c59ecafb243'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:25.700163 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ef599988-3f6e-41b2-b695-1ee270eddbc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36693fa42a7b41279c8d8c59ecafb243'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:25.773665 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ef599988-3f6e-41b2-b695-1ee270eddbc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36693fa42a7b41279c8d8c59ecafb243'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:25.774311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ef599988-3f6e-41b2-b695-1ee270eddbc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36693fa42a7b41279c8d8c59ecafb243'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:25.788025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ef599988-3f6e-41b2-b695-1ee270eddbc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36693fa42a7b41279c8d8c59ecafb243'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:25.794407 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1285/2598] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:25 2022] DELETE /identity/v3/users/36693fa42a7b41279c8d8c59ecafb243 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:26.257745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3430fb6-1683-4c74-b9fd-9ed28e29df6e service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:26.263865 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3430fb6-1683-4c74-b9fd-9ed28e29df6e service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:26.366865 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a42bae-f783-4019-a709-c464d877fca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:26.376473 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a42bae-f783-4019-a709-c464d877fca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:26.376473 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a42bae-f783-4019-a709-c464d877fca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:26.376473 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a42bae-f783-4019-a709-c464d877fca5 admin admin] PATH_INFO: `/v3/projects/23cfcb8de5e448b8af185376a035263b` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:26.376473 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a42bae-f783-4019-a709-c464d877fca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23cfcb8de5e448b8af185376a035263b)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:26.376473 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a42bae-f783-4019-a709-c464d877fca5 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:26.491302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-83a42bae-f783-4019-a709-c464d877fca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23cfcb8de5e448b8af185376a035263b', 'request_id': 'req-83a42bae-f783-4019-a709-c464d877fca5'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:26.497888 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-83a42bae-f783-4019-a709-c464d877fca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23cfcb8de5e448b8af185376a035263b', 'request_id': 'req-83a42bae-f783-4019-a709-c464d877fca5'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:26.550522 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-83a42bae-f783-4019-a709-c464d877fca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23cfcb8de5e448b8af185376a035263b', 'request_id': 'req-83a42bae-f783-4019-a709-c464d877fca5'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:26.566344 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-83a42bae-f783-4019-a709-c464d877fca5 admin admin] The token cache is being invalidate because project 23cfcb8de5e448b8af185376a035263b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:26.566925 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-83a42bae-f783-4019-a709-c464d877fca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:26.567749 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-83a42bae-f783-4019-a709-c464d877fca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:26.569847 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1314/2599] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:26 2022] DELETE /identity/v3/projects/23cfcb8de5e448b8af185376a035263b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:26.575534 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6e281-3aeb-4c2e-a25d-dad47a074a33 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:26.576737 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6e281-3aeb-4c2e-a25d-dad47a074a33 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:26.577501 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6e281-3aeb-4c2e-a25d-dad47a074a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:26.623875 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-fea6e281-3aeb-4c2e-a25d-dad47a074a33 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:26.625341 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-fea6e281-3aeb-4c2e-a25d-dad47a074a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:26.682273 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:26.703755 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1286/2600] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:26.711649 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20cc8e-3509-44e0-afde-c02c06882126 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:26.712120 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20cc8e-3509-44e0-afde-c02c06882126 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:26.716070 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20cc8e-3509-44e0-afde-c02c06882126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:26.733090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:26.747357 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-3a20cc8e-3509-44e0-afde-c02c06882126 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:26.749051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-3a20cc8e-3509-44e0-afde-c02c06882126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:26.761627 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1315/2601] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:26.765633 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6e281-3aeb-4c2e-a25d-dad47a074a33 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:26.778299 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6e281-3aeb-4c2e-a25d-dad47a074a33 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:26.786535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65ed90-f98e-4be0-b97f-34221bab8b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:26.787385 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65ed90-f98e-4be0-b97f-34221bab8b1a admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:26.787735 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65ed90-f98e-4be0-b97f-34221bab8b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:26.788108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65ed90-f98e-4be0-b97f-34221bab8b1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:26.788889 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65ed90-f98e-4be0-b97f-34221bab8b1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:11:26.789253 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65ed90-f98e-4be0-b97f-34221bab8b1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:26.791151 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65ed90-f98e-4be0-b97f-34221bab8b1a admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:26.806116 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1287/2602] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:11:26.810859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20cc8e-3509-44e0-afde-c02c06882126 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:26.821348 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20cc8e-3509-44e0-afde-c02c06882126 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:26.828867 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a809f4-4f19-4118-8388-41126cab5914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:26.829724 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a809f4-4f19-4118-8388-41126cab5914 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:26.830211 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a809f4-4f19-4118-8388-41126cab5914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:26.831169 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a809f4-4f19-4118-8388-41126cab5914 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:26.833202 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a809f4-4f19-4118-8388-41126cab5914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:26.834278 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a809f4-4f19-4118-8388-41126cab5914 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:26.945000 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1316/2603] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:26 2022] POST /identity/v3/projects => generated 405 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:11:26.946617 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65ed90-f98e-4be0-b97f-34221bab8b1a admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:26.965407 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65ed90-f98e-4be0-b97f-34221bab8b1a admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:27.051420 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593aa03-7b0c-489f-8c4f-b90d25b7b6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:27.051998 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593aa03-7b0c-489f-8c4f-b90d25b7b6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:27.052256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593aa03-7b0c-489f-8c4f-b90d25b7b6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:27.052536 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593aa03-7b0c-489f-8c4f-b90d25b7b6d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:27.053221 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593aa03-7b0c-489f-8c4f-b90d25b7b6d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:27.055233 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593aa03-7b0c-489f-8c4f-b90d25b7b6d0 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:27.174827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1288/2604] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:26 2022] POST /identity/v3/users => generated 303 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:27.175698 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a809f4-4f19-4118-8388-41126cab5914 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:27.188333 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a809f4-4f19-4118-8388-41126cab5914 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:27.192167 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421171e1-6e4a-4432-9b07-72dfcb59347a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:27.192789 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421171e1-6e4a-4432-9b07-72dfcb59347a admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:27.193072 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421171e1-6e4a-4432-9b07-72dfcb59347a admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:27.193350 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421171e1-6e4a-4432-9b07-72dfcb59347a admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:27.194098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421171e1-6e4a-4432-9b07-72dfcb59347a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:27.195747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421171e1-6e4a-4432-9b07-72dfcb59347a admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:27.206228 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1317/2605] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:27.210549 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593aa03-7b0c-489f-8c4f-b90d25b7b6d0 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:27.221164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593aa03-7b0c-489f-8c4f-b90d25b7b6d0 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:27.226030 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1cbbe-dea2-4ed9-9618-8eb1060abbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:27.226649 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1cbbe-dea2-4ed9-9618-8eb1060abbcb admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:27.226959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1cbbe-dea2-4ed9-9618-8eb1060abbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:27.227272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1cbbe-dea2-4ed9-9618-8eb1060abbcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:27.227977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1cbbe-dea2-4ed9-9618-8eb1060abbcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:27.229593 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1cbbe-dea2-4ed9-9618-8eb1060abbcb admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:27.243579 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1289/2606] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:27.245240 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421171e1-6e4a-4432-9b07-72dfcb59347a admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:27.255721 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421171e1-6e4a-4432-9b07-72dfcb59347a admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:27.260511 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5843f-7aa8-40fb-8535-695c7f17c4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:27.261242 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5843f-7aa8-40fb-8535-695c7f17c4b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:27.261599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5843f-7aa8-40fb-8535-695c7f17c4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:27.261939 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5843f-7aa8-40fb-8535-695c7f17c4b2 admin admin] PATH_INFO: `/v3/projects/f1e9ae5f6039446c8459e7a30336b789/users/8c8ad76c44544876843b2ba1dd938d59/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:27.277457 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5843f-7aa8-40fb-8535-695c7f17c4b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1e9ae5f6039446c8459e7a30336b789, user_id=8c8ad76c44544876843b2ba1dd938d59, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:27.280218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5843f-7aa8-40fb-8535-695c7f17c4b2 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:27.379001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1318/2607] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:27 2022] PUT /identity/v3/projects/f1e9ae5f6039446c8459e7a30336b789/users/8c8ad76c44544876843b2ba1dd938d59/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:27.384139 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bf5ec-b3ea-4c2b-8248-fe6aef7f7cce None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:27.384435 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bf5ec-b3ea-4c2b-8248-fe6aef7f7cce None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:27.384718 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bf5ec-b3ea-4c2b-8248-fe6aef7f7cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:27.404923 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-df4bf5ec-b3ea-4c2b-8248-fe6aef7f7cce None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:27.407777 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-df4bf5ec-b3ea-4c2b-8248-fe6aef7f7cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:27.415849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5843f-7aa8-40fb-8535-695c7f17c4b2 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:27.417839 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-32b5843f-7aa8-40fb-8535-695c7f17c4b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:27.479585 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1290/2608] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:27.490413 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bf5ec-b3ea-4c2b-8248-fe6aef7f7cce None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:27.492345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-df4bf5ec-b3ea-4c2b-8248-fe6aef7f7cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:27.501791 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5843f-7aa8-40fb-8535-695c7f17c4b2 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:27.506711 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e66387-624c-4daf-9a52-481c0e77d9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:27.510655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e66387-624c-4daf-9a52-481c0e77d9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:27.510655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e66387-624c-4daf-9a52-481c0e77d9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:27.510655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e66387-624c-4daf-9a52-481c0e77d9da admin admin] PATH_INFO: `/v3/users/6ec4b53cb3a64c3aa9cb6a186a61c1fe` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:27.510655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e66387-624c-4daf-9a52-481c0e77d9da admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec4b53cb3a64c3aa9cb6a186a61c1fe)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:27.511076 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e66387-624c-4daf-9a52-481c0e77d9da admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:27.553702 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bf5ec-b3ea-4c2b-8248-fe6aef7f7cce None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:27.557380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36744bc-6339-4631-a9a7-b5f249783daa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:27.558000 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36744bc-6339-4631-a9a7-b5f249783daa service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:27.558287 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36744bc-6339-4631-a9a7-b5f249783daa service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:27.558565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36744bc-6339-4631-a9a7-b5f249783daa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:27.567606 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36744bc-6339-4631-a9a7-b5f249783daa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:27.568991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36744bc-6339-4631-a9a7-b5f249783daa service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:27.572936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:27.578972 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1291/2609] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:11:27.661913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-a1e66387-624c-4daf-9a52-481c0e77d9da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec4b53cb3a64c3aa9cb6a186a61c1fe'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:27.668912 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-a1e66387-624c-4daf-9a52-481c0e77d9da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec4b53cb3a64c3aa9cb6a186a61c1fe'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:27.669603 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-a1e66387-624c-4daf-9a52-481c0e77d9da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec4b53cb3a64c3aa9cb6a186a61c1fe'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:27.682810 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-a1e66387-624c-4daf-9a52-481c0e77d9da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec4b53cb3a64c3aa9cb6a186a61c1fe'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:27.683558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-a1e66387-624c-4daf-9a52-481c0e77d9da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec4b53cb3a64c3aa9cb6a186a61c1fe'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:27.744963 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1319/2610] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:27 2022] DELETE /identity/v3/users/6ec4b53cb3a64c3aa9cb6a186a61c1fe => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:27.975759 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36744bc-6339-4631-a9a7-b5f249783daa service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:27.995780 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36744bc-6339-4631-a9a7-b5f249783daa service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:28.063719 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72306a91-cc22-49e5-bc2b-a8a1d55cd3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:28.064373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72306a91-cc22-49e5-bc2b-a8a1d55cd3e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.064656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72306a91-cc22-49e5-bc2b-a8a1d55cd3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.065007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72306a91-cc22-49e5-bc2b-a8a1d55cd3e0 admin admin] PATH_INFO: `/v3/projects/3a420d95334148b68d78a6497e0d95f5` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.066200 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72306a91-cc22-49e5-bc2b-a8a1d55cd3e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a420d95334148b68d78a6497e0d95f5)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:28.068827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72306a91-cc22-49e5-bc2b-a8a1d55cd3e0 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:28.187347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-72306a91-cc22-49e5-bc2b-a8a1d55cd3e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a420d95334148b68d78a6497e0d95f5', 'request_id': 'req-72306a91-cc22-49e5-bc2b-a8a1d55cd3e0'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:28.193875 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-72306a91-cc22-49e5-bc2b-a8a1d55cd3e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a420d95334148b68d78a6497e0d95f5', 'request_id': 'req-72306a91-cc22-49e5-bc2b-a8a1d55cd3e0'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:28.258630 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-72306a91-cc22-49e5-bc2b-a8a1d55cd3e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a420d95334148b68d78a6497e0d95f5', 'request_id': 'req-72306a91-cc22-49e5-bc2b-a8a1d55cd3e0'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:28.269972 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-72306a91-cc22-49e5-bc2b-a8a1d55cd3e0 admin admin] The token cache is being invalidate because project 3a420d95334148b68d78a6497e0d95f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:28.270261 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-72306a91-cc22-49e5-bc2b-a8a1d55cd3e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:28.270963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-72306a91-cc22-49e5-bc2b-a8a1d55cd3e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:28.272496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1292/2611] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:27 2022] DELETE /identity/v3/projects/3a420d95334148b68d78a6497e0d95f5 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:28.277574 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757eedd0-9066-4072-8254-9f9221efd383 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.278057 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757eedd0-9066-4072-8254-9f9221efd383 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.278225 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757eedd0-9066-4072-8254-9f9221efd383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.299971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-757eedd0-9066-4072-8254-9f9221efd383 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:28.301195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-757eedd0-9066-4072-8254-9f9221efd383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:28.306913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:28.363425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1320/2612] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:28.371821 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a083bf2-b3cf-4415-95d9-f90b63cd7dba None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.372118 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a083bf2-b3cf-4415-95d9-f90b63cd7dba None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.372429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a083bf2-b3cf-4415-95d9-f90b63cd7dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.393939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-0a083bf2-b3cf-4415-95d9-f90b63cd7dba None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:28.395209 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-0a083bf2-b3cf-4415-95d9-f90b63cd7dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:28.403881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1293/2613] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:28.408753 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757eedd0-9066-4072-8254-9f9221efd383 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:28.419004 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757eedd0-9066-4072-8254-9f9221efd383 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:28.424873 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce4385-15ce-4024-9b24-3a6e132318e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:28.425487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce4385-15ce-4024-9b24-3a6e132318e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.427921 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce4385-15ce-4024-9b24-3a6e132318e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.427921 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce4385-15ce-4024-9b24-3a6e132318e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.427921 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce4385-15ce-4024-9b24-3a6e132318e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:11:28.427921 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce4385-15ce-4024-9b24-3a6e132318e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:28.428774 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce4385-15ce-4024-9b24-3a6e132318e7 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:28.440308 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1321/2614] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:11:28.444843 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a083bf2-b3cf-4415-95d9-f90b63cd7dba None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:28.454651 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a083bf2-b3cf-4415-95d9-f90b63cd7dba None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:28.459335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85257f6b-be47-4b51-9c83-a8db18ba39aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:28.459938 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85257f6b-be47-4b51-9c83-a8db18ba39aa admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.460221 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85257f6b-be47-4b51-9c83-a8db18ba39aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.460496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85257f6b-be47-4b51-9c83-a8db18ba39aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.461220 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85257f6b-be47-4b51-9c83-a8db18ba39aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:28.463132 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85257f6b-be47-4b51-9c83-a8db18ba39aa admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:28.554859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1294/2615] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:28 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:28.556292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce4385-15ce-4024-9b24-3a6e132318e7 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:28.567020 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce4385-15ce-4024-9b24-3a6e132318e7 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:28.622358 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d54d7-c2bc-47ce-9c9b-1717e32f9c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:28.623155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d54d7-c2bc-47ce-9c9b-1717e32f9c27 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.623444 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d54d7-c2bc-47ce-9c9b-1717e32f9c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.623725 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d54d7-c2bc-47ce-9c9b-1717e32f9c27 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.624415 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d54d7-c2bc-47ce-9c9b-1717e32f9c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:28.626431 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d54d7-c2bc-47ce-9c9b-1717e32f9c27 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:28.733288 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1322/2616] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:28 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:28.739690 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85257f6b-be47-4b51-9c83-a8db18ba39aa admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:28.750467 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85257f6b-be47-4b51-9c83-a8db18ba39aa admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:28.755165 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2954e5d-2f2a-4d39-bbe0-8996574b22d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:28.759878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2954e5d-2f2a-4d39-bbe0-8996574b22d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.759878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2954e5d-2f2a-4d39-bbe0-8996574b22d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.759878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2954e5d-2f2a-4d39-bbe0-8996574b22d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.759878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2954e5d-2f2a-4d39-bbe0-8996574b22d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:28.759878 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2954e5d-2f2a-4d39-bbe0-8996574b22d4 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:28.770804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1295/2617] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:28.774664 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d54d7-c2bc-47ce-9c9b-1717e32f9c27 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:28.792206 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d54d7-c2bc-47ce-9c9b-1717e32f9c27 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:28.797092 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2de85-f346-43be-802a-6d3e9135c98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:28.797719 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2de85-f346-43be-802a-6d3e9135c98b admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.798005 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2de85-f346-43be-802a-6d3e9135c98b admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.798282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2de85-f346-43be-802a-6d3e9135c98b admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.799014 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2de85-f346-43be-802a-6d3e9135c98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:28.800667 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2de85-f346-43be-802a-6d3e9135c98b admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:28.811675 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1323/2618] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:28.815931 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2954e5d-2f2a-4d39-bbe0-8996574b22d4 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:28.825949 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2954e5d-2f2a-4d39-bbe0-8996574b22d4 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:28.831266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5917416-5b5a-473d-be75-1bb15f078cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:28.831936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5917416-5b5a-473d-be75-1bb15f078cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.832222 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5917416-5b5a-473d-be75-1bb15f078cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.832504 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5917416-5b5a-473d-be75-1bb15f078cdc admin admin] PATH_INFO: `/v3/projects/965502bfffde4ee19c6bd7ea81f08672/users/90109591e9cd43b9aab0fe5b1593e9dd/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.849594 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5917416-5b5a-473d-be75-1bb15f078cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=965502bfffde4ee19c6bd7ea81f08672, user_id=90109591e9cd43b9aab0fe5b1593e9dd, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:28.852449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5917416-5b5a-473d-be75-1bb15f078cdc admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:28.879633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893ed24-8d91-4f5f-abd0-3fd658a8b8a1 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.880371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893ed24-8d91-4f5f-abd0-3fd658a8b8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.881168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893ed24-8d91-4f5f-abd0-3fd658a8b8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.913973 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-4893ed24-8d91-4f5f-abd0-3fd658a8b8a1 None None] MFA Rules not processed for user `8c8ad76c44544876843b2ba1dd938d59`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:28.915384 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-4893ed24-8d91-4f5f-abd0-3fd658a8b8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:28.941615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1296/2619] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:28 2022] PUT /identity/v3/projects/965502bfffde4ee19c6bd7ea81f08672/users/90109591e9cd43b9aab0fe5b1593e9dd/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:28.946470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba7d3e-d428-4247-a0a5-27570b76c7ab None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.947214 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba7d3e-d428-4247-a0a5-27570b76c7ab None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.947508 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba7d3e-d428-4247-a0a5-27570b76c7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.981073 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-6bba7d3e-d428-4247-a0a5-27570b76c7ab None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:28.982391 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-6bba7d3e-d428-4247-a0a5-27570b76c7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:28.993484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1324/2620] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:28.997888 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893ed24-8d91-4f5f-abd0-3fd658a8b8a1 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:28.999230 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-4893ed24-8d91-4f5f-abd0-3fd658a8b8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:29.004173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:29.013072 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893ed24-8d91-4f5f-abd0-3fd658a8b8a1 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:29.018774 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:29.045543 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1297/2621] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:29.055304 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba7d3e-d428-4247-a0a5-27570b76c7ab None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:29.056798 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-6bba7d3e-d428-4247-a0a5-27570b76c7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:29.070622 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553429d-91ad-4b65-9da9-fdd537a9cc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:29.073675 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553429d-91ad-4b65-9da9-fdd537a9cc7f admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:29.073969 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553429d-91ad-4b65-9da9-fdd537a9cc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:29.074260 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553429d-91ad-4b65-9da9-fdd537a9cc7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:29.074970 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553429d-91ad-4b65-9da9-fdd537a9cc7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:29.077393 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553429d-91ad-4b65-9da9-fdd537a9cc7f admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:29.113576 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba7d3e-d428-4247-a0a5-27570b76c7ab None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:29.117225 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a3131-12de-4bfd-9d03-06a226479caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:29.117838 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a3131-12de-4bfd-9d03-06a226479caa service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:29.118121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a3131-12de-4bfd-9d03-06a226479caa service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:29.118426 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a3131-12de-4bfd-9d03-06a226479caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:29.127869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a3131-12de-4bfd-9d03-06a226479caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:29.129284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a3131-12de-4bfd-9d03-06a226479caa service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:29.138609 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1298/2622] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:11:29.186283 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1325/2623] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:28 2022] POST /identity/v3/projects => generated 405 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:11:29.191086 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a3131-12de-4bfd-9d03-06a226479caa service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:29.201266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a3131-12de-4bfd-9d03-06a226479caa service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:29.260503 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f1c8f-2b24-48c1-8ecf-04cc7fe7e75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:29.261168 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f1c8f-2b24-48c1-8ecf-04cc7fe7e75f admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:29.261427 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f1c8f-2b24-48c1-8ecf-04cc7fe7e75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:29.261703 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f1c8f-2b24-48c1-8ecf-04cc7fe7e75f admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:29.262369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f1c8f-2b24-48c1-8ecf-04cc7fe7e75f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:29.265173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f1c8f-2b24-48c1-8ecf-04cc7fe7e75f admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:29.408077 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1299/2624] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:29 2022] POST /identity/v3/users => generated 309 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:11:29.412603 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553429d-91ad-4b65-9da9-fdd537a9cc7f admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:29.423345 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553429d-91ad-4b65-9da9-fdd537a9cc7f admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:29.427894 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15829dab-9f56-460e-9b8c-69366f6e55c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:29.428505 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15829dab-9f56-460e-9b8c-69366f6e55c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:29.428817 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15829dab-9f56-460e-9b8c-69366f6e55c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:29.429071 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15829dab-9f56-460e-9b8c-69366f6e55c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:29.429776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15829dab-9f56-460e-9b8c-69366f6e55c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:29.431424 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15829dab-9f56-460e-9b8c-69366f6e55c0 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:29.442665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1326/2625] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:29.446964 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f1c8f-2b24-48c1-8ecf-04cc7fe7e75f admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:29.457900 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f1c8f-2b24-48c1-8ecf-04cc7fe7e75f admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:29.462857 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e6991-ec15-4c2d-a532-2519847d5892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:29.463529 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e6991-ec15-4c2d-a532-2519847d5892 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:29.463814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e6991-ec15-4c2d-a532-2519847d5892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:29.464095 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e6991-ec15-4c2d-a532-2519847d5892 admin admin] PATH_INFO: `/v3/projects/48be1b684c5a4f6397cd3640f5922b59/users/316e2c7dd5d3496e99e55209a9992f5e/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:29.481442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e6991-ec15-4c2d-a532-2519847d5892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48be1b684c5a4f6397cd3640f5922b59, user_id=316e2c7dd5d3496e99e55209a9992f5e, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:29.484842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e6991-ec15-4c2d-a532-2519847d5892 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:29.568411 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1300/2626] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:29 2022] PUT /identity/v3/projects/48be1b684c5a4f6397cd3640f5922b59/users/316e2c7dd5d3496e99e55209a9992f5e/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:29.572583 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15829dab-9f56-460e-9b8c-69366f6e55c0 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:29.582755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15829dab-9f56-460e-9b8c-69366f6e55c0 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:29.641079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88a52c-509d-4182-9ce3-39f772460558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:29.641706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88a52c-509d-4182-9ce3-39f772460558 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:29.641994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88a52c-509d-4182-9ce3-39f772460558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:29.642274 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88a52c-509d-4182-9ce3-39f772460558 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:29.642982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88a52c-509d-4182-9ce3-39f772460558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:29.644572 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88a52c-509d-4182-9ce3-39f772460558 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:29.656372 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1327/2627] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:29.660941 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e6991-ec15-4c2d-a532-2519847d5892 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:29.672198 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e6991-ec15-4c2d-a532-2519847d5892 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:29.677019 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c9e34-70f4-4464-9cfa-f2425fd8f569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:29.677692 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c9e34-70f4-4464-9cfa-f2425fd8f569 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:29.678051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c9e34-70f4-4464-9cfa-f2425fd8f569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:29.678278 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c9e34-70f4-4464-9cfa-f2425fd8f569 admin admin] PATH_INFO: `/v3/projects/48be1b684c5a4f6397cd3640f5922b59/users/316e2c7dd5d3496e99e55209a9992f5e/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:29.680298 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c9e34-70f4-4464-9cfa-f2425fd8f569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48be1b684c5a4f6397cd3640f5922b59, user_id=316e2c7dd5d3496e99e55209a9992f5e, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:29.682937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c9e34-70f4-4464-9cfa-f2425fd8f569 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:29.694076 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1301/2628] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:29 2022] PUT /identity/v3/projects/48be1b684c5a4f6397cd3640f5922b59/users/316e2c7dd5d3496e99e55209a9992f5e/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:31.011528 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7b90f-8daf-43c0-a82d-be4ee8ee53e4 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:31.012066 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7b90f-8daf-43c0-a82d-be4ee8ee53e4 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:31.012066 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7b90f-8daf-43c0-a82d-be4ee8ee53e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:31.042161 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-ddc7b90f-8daf-43c0-a82d-be4ee8ee53e4 None None] MFA Rules not processed for user `316e2c7dd5d3496e99e55209a9992f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:31.044292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ddc7b90f-8daf-43c0-a82d-be4ee8ee53e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:31.125401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1328/2629] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:11:31 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:32.903549 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c9e34-70f4-4464-9cfa-f2425fd8f569 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:32.937614 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:33.006862 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c9e34-70f4-4464-9cfa-f2425fd8f569 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:33.011564 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce399d-8417-46af-927d-41ae3d2102f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:33.012256 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce399d-8417-46af-927d-41ae3d2102f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:33.012547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce399d-8417-46af-927d-41ae3d2102f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:33.012826 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce399d-8417-46af-927d-41ae3d2102f7 admin admin] PATH_INFO: `/v3/users/8c8ad76c44544876843b2ba1dd938d59` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:33.014039 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce399d-8417-46af-927d-41ae3d2102f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c8ad76c44544876843b2ba1dd938d59)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:33.016736 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce399d-8417-46af-927d-41ae3d2102f7 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:33.200126 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-07ce399d-8417-46af-927d-41ae3d2102f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c8ad76c44544876843b2ba1dd938d59'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:33.217470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-07ce399d-8417-46af-927d-41ae3d2102f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c8ad76c44544876843b2ba1dd938d59'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:33.299146 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-07ce399d-8417-46af-927d-41ae3d2102f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c8ad76c44544876843b2ba1dd938d59'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:33.300539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-07ce399d-8417-46af-927d-41ae3d2102f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c8ad76c44544876843b2ba1dd938d59'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:33.323106 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-07ce399d-8417-46af-927d-41ae3d2102f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c8ad76c44544876843b2ba1dd938d59'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:33.340768 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1302/2630] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:32 2022] DELETE /identity/v3/users/8c8ad76c44544876843b2ba1dd938d59 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:33.672044 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7b90f-8daf-43c0-a82d-be4ee8ee53e4 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:33.677580 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:33.686052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7b90f-8daf-43c0-a82d-be4ee8ee53e4 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:33.769168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509283fe-2e38-4d1e-b8f7-d71b30921547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:33.770200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509283fe-2e38-4d1e-b8f7-d71b30921547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:33.770762 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509283fe-2e38-4d1e-b8f7-d71b30921547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:33.771241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509283fe-2e38-4d1e-b8f7-d71b30921547 admin admin] PATH_INFO: `/v3/projects/f1e9ae5f6039446c8459e7a30336b789` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:33.772726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509283fe-2e38-4d1e-b8f7-d71b30921547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1e9ae5f6039446c8459e7a30336b789)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:33.774857 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509283fe-2e38-4d1e-b8f7-d71b30921547 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:33.912913 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-509283fe-2e38-4d1e-b8f7-d71b30921547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1e9ae5f6039446c8459e7a30336b789', 'request_id': 'req-509283fe-2e38-4d1e-b8f7-d71b30921547'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:33.919425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-509283fe-2e38-4d1e-b8f7-d71b30921547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1e9ae5f6039446c8459e7a30336b789', 'request_id': 'req-509283fe-2e38-4d1e-b8f7-d71b30921547'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:34.037904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-509283fe-2e38-4d1e-b8f7-d71b30921547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1e9ae5f6039446c8459e7a30336b789', 'request_id': 'req-509283fe-2e38-4d1e-b8f7-d71b30921547'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:34.058891 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-509283fe-2e38-4d1e-b8f7-d71b30921547 admin admin] The token cache is being invalidate because project f1e9ae5f6039446c8459e7a30336b789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:34.059243 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-509283fe-2e38-4d1e-b8f7-d71b30921547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:34.060365 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-509283fe-2e38-4d1e-b8f7-d71b30921547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:34.065896 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1329/2631] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:33 2022] DELETE /identity/v3/projects/f1e9ae5f6039446c8459e7a30336b789 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:34.068054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce399d-8417-46af-927d-41ae3d2102f7 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:34.069843 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-07ce399d-8417-46af-927d-41ae3d2102f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:34.090917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce399d-8417-46af-927d-41ae3d2102f7 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:34.203147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06360259-45fb-4433-a48c-2c889e2c895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:34.203823 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06360259-45fb-4433-a48c-2c889e2c895d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:34.204182 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06360259-45fb-4433-a48c-2c889e2c895d admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:34.204575 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06360259-45fb-4433-a48c-2c889e2c895d admin admin] PATH_INFO: `/v3/users/316e2c7dd5d3496e99e55209a9992f5e` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:34.205984 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06360259-45fb-4433-a48c-2c889e2c895d admin admin] RBAC: Authorizing `identity:delete_user(user_id=316e2c7dd5d3496e99e55209a9992f5e)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:34.208097 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06360259-45fb-4433-a48c-2c889e2c895d admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:34.441153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:34.448938 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-06360259-45fb-4433-a48c-2c889e2c895d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '316e2c7dd5d3496e99e55209a9992f5e'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:34.458557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-06360259-45fb-4433-a48c-2c889e2c895d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '316e2c7dd5d3496e99e55209a9992f5e'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:34.544772 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-06360259-45fb-4433-a48c-2c889e2c895d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '316e2c7dd5d3496e99e55209a9992f5e'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:34.545494 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-06360259-45fb-4433-a48c-2c889e2c895d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '316e2c7dd5d3496e99e55209a9992f5e'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:34.569125 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-06360259-45fb-4433-a48c-2c889e2c895d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '316e2c7dd5d3496e99e55209a9992f5e'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:34.577149 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1303/2632] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:34 2022] DELETE /identity/v3/users/316e2c7dd5d3496e99e55209a9992f5e => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:34.877267 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509283fe-2e38-4d1e-b8f7-d71b30921547 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:34.879911 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-509283fe-2e38-4d1e-b8f7-d71b30921547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:34.921769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509283fe-2e38-4d1e-b8f7-d71b30921547 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:35.012759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026190c-5921-435d-bbd4-dd845c8ffd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:35.018797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026190c-5921-435d-bbd4-dd845c8ffd80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:35.018797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026190c-5921-435d-bbd4-dd845c8ffd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:35.018797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026190c-5921-435d-bbd4-dd845c8ffd80 admin admin] PATH_INFO: `/v3/projects/48be1b684c5a4f6397cd3640f5922b59` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:35.018797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026190c-5921-435d-bbd4-dd845c8ffd80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48be1b684c5a4f6397cd3640f5922b59)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:35.028122 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026190c-5921-435d-bbd4-dd845c8ffd80 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:35.068304 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b76a2-76a6-44f8-81e7-00ca90cd9118 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:35.068857 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b76a2-76a6-44f8-81e7-00ca90cd9118 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:35.068978 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b76a2-76a6-44f8-81e7-00ca90cd9118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:35.108459 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-1d8b76a2-76a6-44f8-81e7-00ca90cd9118 None None] MFA Rules not processed for user `90109591e9cd43b9aab0fe5b1593e9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:35.110312 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-1d8b76a2-76a6-44f8-81e7-00ca90cd9118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:35.128586 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:35.144777 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e026190c-5921-435d-bbd4-dd845c8ffd80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48be1b684c5a4f6397cd3640f5922b59', 'request_id': 'req-e026190c-5921-435d-bbd4-dd845c8ffd80'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:35.152966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e026190c-5921-435d-bbd4-dd845c8ffd80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48be1b684c5a4f6397cd3640f5922b59', 'request_id': 'req-e026190c-5921-435d-bbd4-dd845c8ffd80'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:35.204998 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1304/2633] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:11:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:35.219466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e026190c-5921-435d-bbd4-dd845c8ffd80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48be1b684c5a4f6397cd3640f5922b59', 'request_id': 'req-e026190c-5921-435d-bbd4-dd845c8ffd80'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:35.223314 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b76a2-76a6-44f8-81e7-00ca90cd9118 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:35.225121 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-1d8b76a2-76a6-44f8-81e7-00ca90cd9118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:35.231939 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e026190c-5921-435d-bbd4-dd845c8ffd80 admin admin] The token cache is being invalidate because project 48be1b684c5a4f6397cd3640f5922b59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:35.232376 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e026190c-5921-435d-bbd4-dd845c8ffd80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:35.235566 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e026190c-5921-435d-bbd4-dd845c8ffd80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:35.241523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1330/2634] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:34 2022] DELETE /identity/v3/projects/48be1b684c5a4f6397cd3640f5922b59 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:35.243837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa8b1f-cdd9-48a6-b277-93467e88103a None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:35.244134 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa8b1f-cdd9-48a6-b277-93467e88103a None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:35.244420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa8b1f-cdd9-48a6-b277-93467e88103a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:35.276416 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-83fa8b1f-cdd9-48a6-b277-93467e88103a None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:35.277645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-83fa8b1f-cdd9-48a6-b277-93467e88103a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:35.324964 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b76a2-76a6-44f8-81e7-00ca90cd9118 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:35.352132 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1331/2635] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:35.356463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e88e8-6a72-4459-80a5-9ac486517b3d None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:35.356953 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e88e8-6a72-4459-80a5-9ac486517b3d None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:35.363752 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e88e8-6a72-4459-80a5-9ac486517b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:35.386266 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-bd6e88e8-6a72-4459-80a5-9ac486517b3d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:35.387840 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-bd6e88e8-6a72-4459-80a5-9ac486517b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:35.396959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:35.402077 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1332/2636] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:35.403326 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e88e8-6a72-4459-80a5-9ac486517b3d None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:35.414423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e88e8-6a72-4459-80a5-9ac486517b3d None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:35.419970 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb117a9-2acc-4028-a64d-85bbb62fc468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:35.420239 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efac414-8153-47a7-b9df-65e5ad53f9ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:35.420613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb117a9-2acc-4028-a64d-85bbb62fc468 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:35.420874 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efac414-8153-47a7-b9df-65e5ad53f9ea service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:35.421491 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb117a9-2acc-4028-a64d-85bbb62fc468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:35.421691 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb117a9-2acc-4028-a64d-85bbb62fc468 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:35.421820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efac414-8153-47a7-b9df-65e5ad53f9ea service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:35.421968 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efac414-8153-47a7-b9df-65e5ad53f9ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:35.422404 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb117a9-2acc-4028-a64d-85bbb62fc468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:11:35.422720 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb117a9-2acc-4028-a64d-85bbb62fc468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:35.423876 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-5efac414-8153-47a7-b9df-65e5ad53f9ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:35.424689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb117a9-2acc-4028-a64d-85bbb62fc468 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:35.439662 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1333/2637] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:11:35.443974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb117a9-2acc-4028-a64d-85bbb62fc468 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:35.455062 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb117a9-2acc-4028-a64d-85bbb62fc468 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:35.459943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c962ab1-b2e0-439b-accf-70db282d670f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:35.461213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c962ab1-b2e0-439b-accf-70db282d670f admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:35.461213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c962ab1-b2e0-439b-accf-70db282d670f admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:35.461213 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c962ab1-b2e0-439b-accf-70db282d670f admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:35.461868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c962ab1-b2e0-439b-accf-70db282d670f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:35.463832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c962ab1-b2e0-439b-accf-70db282d670f admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:35.490165 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efac414-8153-47a7-b9df-65e5ad53f9ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:35.491786 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efac414-8153-47a7-b9df-65e5ad53f9ea service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:35.501871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1305/2638] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:11:35.582711 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1334/2639] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:35 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:11:35.583993 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efac414-8153-47a7-b9df-65e5ad53f9ea service nova] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:35.595700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efac414-8153-47a7-b9df-65e5ad53f9ea service nova] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:35.663820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b8cee-3758-452d-a451-7e48c6eafde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:35.664641 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b8cee-3758-452d-a451-7e48c6eafde4 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:35.664986 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b8cee-3758-452d-a451-7e48c6eafde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:35.665309 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b8cee-3758-452d-a451-7e48c6eafde4 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:35.666010 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b8cee-3758-452d-a451-7e48c6eafde4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:35.668159 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b8cee-3758-452d-a451-7e48c6eafde4 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:35.773605 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1306/2640] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:35 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:35.778239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c962ab1-b2e0-439b-accf-70db282d670f admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:35.789630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c962ab1-b2e0-439b-accf-70db282d670f admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:35.794670 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feed66d-2ca9-4b3e-aad9-49b623980627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:35.795383 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feed66d-2ca9-4b3e-aad9-49b623980627 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:35.795736 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feed66d-2ca9-4b3e-aad9-49b623980627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:35.796656 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feed66d-2ca9-4b3e-aad9-49b623980627 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:35.797441 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feed66d-2ca9-4b3e-aad9-49b623980627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:35.799176 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feed66d-2ca9-4b3e-aad9-49b623980627 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:35.809407 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1335/2641] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:35.813524 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b8cee-3758-452d-a451-7e48c6eafde4 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:35.824034 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b8cee-3758-452d-a451-7e48c6eafde4 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:35.829091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc301c3-d4b8-4a55-bcab-85669d8d8ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:35.829703 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc301c3-d4b8-4a55-bcab-85669d8d8ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:35.829991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc301c3-d4b8-4a55-bcab-85669d8d8ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:35.830275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc301c3-d4b8-4a55-bcab-85669d8d8ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:35.831005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc301c3-d4b8-4a55-bcab-85669d8d8ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:35.832611 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc301c3-d4b8-4a55-bcab-85669d8d8ee7 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:35.842683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1307/2642] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:35.847251 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feed66d-2ca9-4b3e-aad9-49b623980627 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:35.857207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feed66d-2ca9-4b3e-aad9-49b623980627 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:35.862346 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e705e-586a-4b8e-8589-1e5945e0a0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:35.863038 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e705e-586a-4b8e-8589-1e5945e0a0a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:35.863322 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e705e-586a-4b8e-8589-1e5945e0a0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:35.863598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e705e-586a-4b8e-8589-1e5945e0a0a1 admin admin] PATH_INFO: `/v3/projects/b74fd9c2d8214dcc9dbdbfcb1273eef3/users/c51e5e5a280d422da30047c710d2762d/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:35.877972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e705e-586a-4b8e-8589-1e5945e0a0a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74fd9c2d8214dcc9dbdbfcb1273eef3, user_id=c51e5e5a280d422da30047c710d2762d, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:35.880669 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e705e-586a-4b8e-8589-1e5945e0a0a1 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:35.940256 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1336/2643] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:35 2022] PUT /identity/v3/projects/b74fd9c2d8214dcc9dbdbfcb1273eef3/users/c51e5e5a280d422da30047c710d2762d/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:35.952876 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83402a4b-c2d3-4f73-a4be-3eca8e92b83b None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:35.953423 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83402a4b-c2d3-4f73-a4be-3eca8e92b83b None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:35.953937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83402a4b-c2d3-4f73-a4be-3eca8e92b83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:35.983904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-83402a4b-c2d3-4f73-a4be-3eca8e92b83b None None] MFA Rules not processed for user `c51e5e5a280d422da30047c710d2762d`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:35.985195 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-83402a4b-c2d3-4f73-a4be-3eca8e92b83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:36.036603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:36.053422 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1308/2644] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:11:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:36.057953 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e705e-586a-4b8e-8589-1e5945e0a0a1 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:36.117467 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:36.131662 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e705e-586a-4b8e-8589-1e5945e0a0a1 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:36.137570 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428ff08-5220-4c81-805d-d23ff6fa0c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:36.138287 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428ff08-5220-4c81-805d-d23ff6fa0c9f admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:36.138757 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428ff08-5220-4c81-805d-d23ff6fa0c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:36.140715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428ff08-5220-4c81-805d-d23ff6fa0c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:36.140715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428ff08-5220-4c81-805d-d23ff6fa0c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:36.142673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428ff08-5220-4c81-805d-d23ff6fa0c9f admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:36.236683 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1337/2645] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:36 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:36.236801 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83402a4b-c2d3-4f73-a4be-3eca8e92b83b None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:36.247866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83402a4b-c2d3-4f73-a4be-3eca8e92b83b None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:36.314757 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1705ee1-489a-44fe-8c8d-dd2d97006425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:36.315563 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1705ee1-489a-44fe-8c8d-dd2d97006425 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:36.315909 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1705ee1-489a-44fe-8c8d-dd2d97006425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:36.316197 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1705ee1-489a-44fe-8c8d-dd2d97006425 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:36.316886 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1705ee1-489a-44fe-8c8d-dd2d97006425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:36.318856 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1705ee1-489a-44fe-8c8d-dd2d97006425 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:36.414893 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1309/2646] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:36 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:11:36.418689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428ff08-5220-4c81-805d-d23ff6fa0c9f admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:36.432147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428ff08-5220-4c81-805d-d23ff6fa0c9f admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:36.456459 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e883f-c15b-486b-8138-be1402e7d03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:36.457210 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e883f-c15b-486b-8138-be1402e7d03b admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:36.457569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e883f-c15b-486b-8138-be1402e7d03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:36.457984 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e883f-c15b-486b-8138-be1402e7d03b admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:36.459536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e883f-c15b-486b-8138-be1402e7d03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:36.461662 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e883f-c15b-486b-8138-be1402e7d03b admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:36.498783 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1338/2647] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:11:36.502146 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1705ee1-489a-44fe-8c8d-dd2d97006425 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:36.512743 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1705ee1-489a-44fe-8c8d-dd2d97006425 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:36.518726 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ab507-60dd-432e-b9b0-2d4e23d7dceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:36.519614 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ab507-60dd-432e-b9b0-2d4e23d7dceb admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:36.520024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ab507-60dd-432e-b9b0-2d4e23d7dceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:36.520395 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ab507-60dd-432e-b9b0-2d4e23d7dceb admin admin] PATH_INFO: `/v3/projects/5faaefe8fa6d40d484df39af311fe380/users/954476e49a3c4c448bb49636efdcf98f/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:36.555705 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ab507-60dd-432e-b9b0-2d4e23d7dceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5faaefe8fa6d40d484df39af311fe380, user_id=954476e49a3c4c448bb49636efdcf98f, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:36.562109 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ab507-60dd-432e-b9b0-2d4e23d7dceb admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:36.657730 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1310/2648] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:36 2022] PUT /identity/v3/projects/5faaefe8fa6d40d484df39af311fe380/users/954476e49a3c4c448bb49636efdcf98f/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:36.662138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e883f-c15b-486b-8138-be1402e7d03b admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:36.676344 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e883f-c15b-486b-8138-be1402e7d03b admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:36.752655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341c104-cfeb-4810-8ded-41de22f74e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:36.753214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341c104-cfeb-4810-8ded-41de22f74e0f admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:36.753501 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341c104-cfeb-4810-8ded-41de22f74e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:36.753785 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341c104-cfeb-4810-8ded-41de22f74e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:36.754524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341c104-cfeb-4810-8ded-41de22f74e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:36.756247 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341c104-cfeb-4810-8ded-41de22f74e0f admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:36.770882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1339/2649] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:36.782999 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ab507-60dd-432e-b9b0-2d4e23d7dceb admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:36.798959 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ab507-60dd-432e-b9b0-2d4e23d7dceb admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:36.805736 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38972424-77cb-4abc-b05e-7f25e2cd2128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:36.806495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38972424-77cb-4abc-b05e-7f25e2cd2128 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:36.806816 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38972424-77cb-4abc-b05e-7f25e2cd2128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:36.807763 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38972424-77cb-4abc-b05e-7f25e2cd2128 admin admin] PATH_INFO: `/v3/projects/5faaefe8fa6d40d484df39af311fe380/users/954476e49a3c4c448bb49636efdcf98f/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:36.810597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38972424-77cb-4abc-b05e-7f25e2cd2128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5faaefe8fa6d40d484df39af311fe380, user_id=954476e49a3c4c448bb49636efdcf98f, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:36.813515 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38972424-77cb-4abc-b05e-7f25e2cd2128 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:36.829311 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1311/2650] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:36 2022] PUT /identity/v3/projects/5faaefe8fa6d40d484df39af311fe380/users/954476e49a3c4c448bb49636efdcf98f/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:36.840096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055ea48-07a2-4928-9b38-df8901835bb3 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:36.840096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055ea48-07a2-4928-9b38-df8901835bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:36.840379 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055ea48-07a2-4928-9b38-df8901835bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:36.876296 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-6055ea48-07a2-4928-9b38-df8901835bb3 None None] MFA Rules not processed for user `954476e49a3c4c448bb49636efdcf98f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:36.877540 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-6055ea48-07a2-4928-9b38-df8901835bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:36.952610 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1340/2651] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:11:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:36.971676 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38972424-77cb-4abc-b05e-7f25e2cd2128 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:36.985564 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-38972424-77cb-4abc-b05e-7f25e2cd2128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:37.074381 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38972424-77cb-4abc-b05e-7f25e2cd2128 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:37.079488 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3ab36-76fa-471f-81cc-0151f91db47b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:37.080126 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3ab36-76fa-471f-81cc-0151f91db47b service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:37.080415 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3ab36-76fa-471f-81cc-0151f91db47b service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:37.080766 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3ab36-76fa-471f-81cc-0151f91db47b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:37.092540 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3ab36-76fa-471f-81cc-0151f91db47b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:37.094571 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3ab36-76fa-471f-81cc-0151f91db47b service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:37.105949 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1312/2652] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:37.326158 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055ea48-07a2-4928-9b38-df8901835bb3 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:37.337950 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055ea48-07a2-4928-9b38-df8901835bb3 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:37.342882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03157082-a134-4875-8dac-fa466122b34a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:37.344638 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03157082-a134-4875-8dac-fa466122b34a service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:37.345128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03157082-a134-4875-8dac-fa466122b34a service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:37.345814 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03157082-a134-4875-8dac-fa466122b34a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:37.411235 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:37.446300 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03157082-a134-4875-8dac-fa466122b34a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:37.449415 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03157082-a134-4875-8dac-fa466122b34a service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:37.463305 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1341/2653] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:37.937112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006267b-d01f-40ca-99cb-4d9187ea67be None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:37.937967 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006267b-d01f-40ca-99cb-4d9187ea67be None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:37.941154 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006267b-d01f-40ca-99cb-4d9187ea67be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:37.962514 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-e006267b-d01f-40ca-99cb-4d9187ea67be None None] MFA Rules not processed for user `90109591e9cd43b9aab0fe5b1593e9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:37.963774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e006267b-d01f-40ca-99cb-4d9187ea67be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:38.013985 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:38.030905 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1313/2654] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:11:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:38.634369 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03157082-a134-4875-8dac-fa466122b34a service cinder] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:38.636376 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-03157082-a134-4875-8dac-fa466122b34a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:38.725399 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03157082-a134-4875-8dac-fa466122b34a service cinder] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:38.731433 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6b1a8-edbd-4779-824b-6c4c99d68ae9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:38.732082 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6b1a8-edbd-4779-824b-6c4c99d68ae9 service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:38.732373 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6b1a8-edbd-4779-824b-6c4c99d68ae9 service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:38.732658 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6b1a8-edbd-4779-824b-6c4c99d68ae9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:38.735508 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-7ee6b1a8-edbd-4779-824b-6c4c99d68ae9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:38.749298 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6b1a8-edbd-4779-824b-6c4c99d68ae9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:38.750997 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6b1a8-edbd-4779-824b-6c4c99d68ae9 service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:38.762952 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1342/2655] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:41.930240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006267b-d01f-40ca-99cb-4d9187ea67be None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:41.931690 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e006267b-d01f-40ca-99cb-4d9187ea67be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:41.988853 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006267b-d01f-40ca-99cb-4d9187ea67be None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:41.992424 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90ccb4-7826-4542-a606-cdb27778cfb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:41.993038 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90ccb4-7826-4542-a606-cdb27778cfb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:41.993318 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90ccb4-7826-4542-a606-cdb27778cfb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:41.993592 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90ccb4-7826-4542-a606-cdb27778cfb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:41.995414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-8f90ccb4-7826-4542-a606-cdb27778cfb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:42.057104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90ccb4-7826-4542-a606-cdb27778cfb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:42.058549 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90ccb4-7826-4542-a606-cdb27778cfb4 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:42.068853 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1314/2656] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:41 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:44.133473 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6b1a8-edbd-4779-824b-6c4c99d68ae9 service nova] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:44.145593 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6b1a8-edbd-4779-824b-6c4c99d68ae9 service nova] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:44.151327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e21518-cde6-41f2-9520-3dd6cdbd2af8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:44.151945 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e21518-cde6-41f2-9520-3dd6cdbd2af8 service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:44.152405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e21518-cde6-41f2-9520-3dd6cdbd2af8 service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:44.152685 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e21518-cde6-41f2-9520-3dd6cdbd2af8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:44.154473 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-33e21518-cde6-41f2-9520-3dd6cdbd2af8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:44.169824 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e21518-cde6-41f2-9520-3dd6cdbd2af8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:44.174106 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e21518-cde6-41f2-9520-3dd6cdbd2af8 service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:44.182687 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1343/2657] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:52.064528 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=54 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:54.177829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=49 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:33.580284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90ccb4-7826-4542-a606-cdb27778cfb4 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:33.642159 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90ccb4-7826-4542-a606-cdb27778cfb4 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:33.647314 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787fa5b-8009-4157-a157-ad11492ca110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:33.647956 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787fa5b-8009-4157-a157-ad11492ca110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:33.648243 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787fa5b-8009-4157-a157-ad11492ca110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:33.648524 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787fa5b-8009-4157-a157-ad11492ca110 admin admin] PATH_INFO: `/v3/users/c51e5e5a280d422da30047c710d2762d` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:33.649797 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787fa5b-8009-4157-a157-ad11492ca110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c51e5e5a280d422da30047c710d2762d)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:33.651767 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787fa5b-8009-4157-a157-ad11492ca110 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:33.819509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2787fa5b-8009-4157-a157-ad11492ca110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c51e5e5a280d422da30047c710d2762d'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:33.826373 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2787fa5b-8009-4157-a157-ad11492ca110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c51e5e5a280d422da30047c710d2762d'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:33.896779 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2787fa5b-8009-4157-a157-ad11492ca110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c51e5e5a280d422da30047c710d2762d'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:33.897428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2787fa5b-8009-4157-a157-ad11492ca110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c51e5e5a280d422da30047c710d2762d'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:33.909664 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2787fa5b-8009-4157-a157-ad11492ca110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c51e5e5a280d422da30047c710d2762d'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:33.916597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1315/2658] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:12:33 2022] DELETE /identity/v3/users/c51e5e5a280d422da30047c710d2762d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:33.921224 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22d06e-710b-4762-bc0f-86bd87a95a9d None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:33.921733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22d06e-710b-4762-bc0f-86bd87a95a9d None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:33.921841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22d06e-710b-4762-bc0f-86bd87a95a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:33.941248 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-be22d06e-710b-4762-bc0f-86bd87a95a9d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:33.942548 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-be22d06e-710b-4762-bc0f-86bd87a95a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:34.006115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1344/2659] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:34.016253 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787fa5b-8009-4157-a157-ad11492ca110 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:34.020786 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-2787fa5b-8009-4157-a157-ad11492ca110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:34.078340 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787fa5b-8009-4157-a157-ad11492ca110 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:34.082056 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066564a-fc67-46a2-a594-5ddd01ce85b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:34.082671 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066564a-fc67-46a2-a594-5ddd01ce85b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:34.083044 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066564a-fc67-46a2-a594-5ddd01ce85b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:34.083313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066564a-fc67-46a2-a594-5ddd01ce85b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:34.092674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066564a-fc67-46a2-a594-5ddd01ce85b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:34.094179 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066564a-fc67-46a2-a594-5ddd01ce85b1 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:34.104123 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1316/2660] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:12:34.516397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22d06e-710b-4762-bc0f-86bd87a95a9d None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:34.517868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-be22d06e-710b-4762-bc0f-86bd87a95a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:34.530535 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22d06e-710b-4762-bc0f-86bd87a95a9d None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:34.535184 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d1c01-86a4-4c65-a085-15f69cba4773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:34.537479 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d1c01-86a4-4c65-a085-15f69cba4773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:34.537769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d1c01-86a4-4c65-a085-15f69cba4773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:34.538052 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d1c01-86a4-4c65-a085-15f69cba4773 admin admin] PATH_INFO: `/v3/projects/b74fd9c2d8214dcc9dbdbfcb1273eef3` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:34.539445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d1c01-86a4-4c65-a085-15f69cba4773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b74fd9c2d8214dcc9dbdbfcb1273eef3)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:34.541387 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d1c01-86a4-4c65-a085-15f69cba4773 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:34.659659 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b06d1c01-86a4-4c65-a085-15f69cba4773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b74fd9c2d8214dcc9dbdbfcb1273eef3', 'request_id': 'req-b06d1c01-86a4-4c65-a085-15f69cba4773'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:34.666597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b06d1c01-86a4-4c65-a085-15f69cba4773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b74fd9c2d8214dcc9dbdbfcb1273eef3', 'request_id': 'req-b06d1c01-86a4-4c65-a085-15f69cba4773'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:34.742599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b06d1c01-86a4-4c65-a085-15f69cba4773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b74fd9c2d8214dcc9dbdbfcb1273eef3', 'request_id': 'req-b06d1c01-86a4-4c65-a085-15f69cba4773'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:34.753200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b06d1c01-86a4-4c65-a085-15f69cba4773 admin admin] The token cache is being invalidate because project b74fd9c2d8214dcc9dbdbfcb1273eef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:12:34.755536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b06d1c01-86a4-4c65-a085-15f69cba4773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:34.755536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-b06d1c01-86a4-4c65-a085-15f69cba4773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:34.756293 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1345/2661] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:34 2022] DELETE /identity/v3/projects/b74fd9c2d8214dcc9dbdbfcb1273eef3 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:34.760369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066564a-fc67-46a2-a594-5ddd01ce85b1 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:34.770216 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066564a-fc67-46a2-a594-5ddd01ce85b1 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:34.789350 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:34.827940 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55374971-4f86-49d9-a137-829bd77537de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:34.828964 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55374971-4f86-49d9-a137-829bd77537de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:34.829425 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55374971-4f86-49d9-a137-829bd77537de admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:34.829755 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55374971-4f86-49d9-a137-829bd77537de admin admin] PATH_INFO: `/v3/users/954476e49a3c4c448bb49636efdcf98f` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:34.831307 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55374971-4f86-49d9-a137-829bd77537de admin admin] RBAC: Authorizing `identity:delete_user(user_id=954476e49a3c4c448bb49636efdcf98f)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:34.834022 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55374971-4f86-49d9-a137-829bd77537de admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:35.002272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-55374971-4f86-49d9-a137-829bd77537de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '954476e49a3c4c448bb49636efdcf98f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:35.009845 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-55374971-4f86-49d9-a137-829bd77537de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '954476e49a3c4c448bb49636efdcf98f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:35.062927 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-55374971-4f86-49d9-a137-829bd77537de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '954476e49a3c4c448bb49636efdcf98f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:35.063589 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-55374971-4f86-49d9-a137-829bd77537de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '954476e49a3c4c448bb49636efdcf98f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:35.076228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-55374971-4f86-49d9-a137-829bd77537de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '954476e49a3c4c448bb49636efdcf98f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:35.082023 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1317/2662] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:12:34 2022] DELETE /identity/v3/users/954476e49a3c4c448bb49636efdcf98f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:35.475886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d1c01-86a4-4c65-a085-15f69cba4773 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:35.477348 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-b06d1c01-86a4-4c65-a085-15f69cba4773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:35.490827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d1c01-86a4-4c65-a085-15f69cba4773 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:35.550207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d7218-db8f-482d-9d7d-c00a1cf9a8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:35.550804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d7218-db8f-482d-9d7d-c00a1cf9a8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:35.551089 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d7218-db8f-482d-9d7d-c00a1cf9a8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:35.551394 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d7218-db8f-482d-9d7d-c00a1cf9a8b4 admin admin] PATH_INFO: `/v3/projects/5faaefe8fa6d40d484df39af311fe380` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:35.552660 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d7218-db8f-482d-9d7d-c00a1cf9a8b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5faaefe8fa6d40d484df39af311fe380)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:35.554567 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d7218-db8f-482d-9d7d-c00a1cf9a8b4 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:35.635612 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:35.651815 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-716d7218-db8f-482d-9d7d-c00a1cf9a8b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5faaefe8fa6d40d484df39af311fe380', 'request_id': 'req-716d7218-db8f-482d-9d7d-c00a1cf9a8b4'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:35.657935 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-716d7218-db8f-482d-9d7d-c00a1cf9a8b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5faaefe8fa6d40d484df39af311fe380', 'request_id': 'req-716d7218-db8f-482d-9d7d-c00a1cf9a8b4'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:35.720148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-716d7218-db8f-482d-9d7d-c00a1cf9a8b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5faaefe8fa6d40d484df39af311fe380', 'request_id': 'req-716d7218-db8f-482d-9d7d-c00a1cf9a8b4'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:35.731374 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-716d7218-db8f-482d-9d7d-c00a1cf9a8b4 admin admin] The token cache is being invalidate because project 5faaefe8fa6d40d484df39af311fe380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:12:35.731950 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-716d7218-db8f-482d-9d7d-c00a1cf9a8b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:35.748041 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-716d7218-db8f-482d-9d7d-c00a1cf9a8b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:35.748041 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1346/2663] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:35 2022] DELETE /identity/v3/projects/5faaefe8fa6d40d484df39af311fe380 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:35.748446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb9ddb-c0ec-46db-a5fb-afcb86f40c8d None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:35.748446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb9ddb-c0ec-46db-a5fb-afcb86f40c8d None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:35.748446 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb9ddb-c0ec-46db-a5fb-afcb86f40c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:35.760673 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-3bcb9ddb-c0ec-46db-a5fb-afcb86f40c8d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:35.761950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3bcb9ddb-c0ec-46db-a5fb-afcb86f40c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:35.829240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1318/2664] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:35.837206 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afa02e-bdd5-402b-8461-0a128bffb4b7 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:35.837504 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afa02e-bdd5-402b-8461-0a128bffb4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:35.837794 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afa02e-bdd5-402b-8461-0a128bffb4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:35.860718 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-c0afa02e-bdd5-402b-8461-0a128bffb4b7 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:35.862225 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-c0afa02e-bdd5-402b-8461-0a128bffb4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:35.874920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1347/2665] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:35.878622 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb9ddb-c0ec-46db-a5fb-afcb86f40c8d None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:35.888974 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb9ddb-c0ec-46db-a5fb-afcb86f40c8d None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:35.893619 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f0b7c-74f4-4e2b-8af8-c818eebe8b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:35.895844 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f0b7c-74f4-4e2b-8af8-c818eebe8b9a admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:35.895844 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f0b7c-74f4-4e2b-8af8-c818eebe8b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:35.895844 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f0b7c-74f4-4e2b-8af8-c818eebe8b9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:35.895844 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f0b7c-74f4-4e2b-8af8-c818eebe8b9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:12:35.895844 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f0b7c-74f4-4e2b-8af8-c818eebe8b9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:35.897362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f0b7c-74f4-4e2b-8af8-c818eebe8b9a admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:35.909093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1319/2666] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:12:35.913836 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afa02e-bdd5-402b-8461-0a128bffb4b7 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:35.923377 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afa02e-bdd5-402b-8461-0a128bffb4b7 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:35.928713 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a84fd-0f62-4871-a4e7-06cc4be59a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:35.929323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a84fd-0f62-4871-a4e7-06cc4be59a18 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:35.929623 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a84fd-0f62-4871-a4e7-06cc4be59a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:35.929899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a84fd-0f62-4871-a4e7-06cc4be59a18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:35.930586 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a84fd-0f62-4871-a4e7-06cc4be59a18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:35.932614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a84fd-0f62-4871-a4e7-06cc4be59a18 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:36.035017 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1348/2667] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:12:35 2022] POST /identity/v3/projects => generated 357 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:36.036565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f0b7c-74f4-4e2b-8af8-c818eebe8b9a admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:36.056495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f0b7c-74f4-4e2b-8af8-c818eebe8b9a admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:36.084574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:36.114145 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54a753-eed4-4698-931c-a89218dd405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:36.115329 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54a753-eed4-4698-931c-a89218dd405d admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:36.115616 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54a753-eed4-4698-931c-a89218dd405d admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:36.115892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54a753-eed4-4698-931c-a89218dd405d admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:36.116566 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54a753-eed4-4698-931c-a89218dd405d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:36.118659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54a753-eed4-4698-931c-a89218dd405d admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:36.235271 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1320/2668] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:12:36 2022] POST /identity/v3/users => generated 279 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:36.242384 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a84fd-0f62-4871-a4e7-06cc4be59a18 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:36.252856 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a84fd-0f62-4871-a4e7-06cc4be59a18 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:36.257971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dd9fe-c876-4ae6-9b9c-8b951fe6c1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:36.262472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dd9fe-c876-4ae6-9b9c-8b951fe6c1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:36.262472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dd9fe-c876-4ae6-9b9c-8b951fe6c1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:36.262472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dd9fe-c876-4ae6-9b9c-8b951fe6c1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:36.262472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33dd9fe-c876-4ae6-9b9c-8b951fe6c1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:36.262472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33dd9fe-c876-4ae6-9b9c-8b951fe6c1d7 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:36.272759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1349/2669] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:36.276618 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54a753-eed4-4698-931c-a89218dd405d admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:36.286828 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54a753-eed4-4698-931c-a89218dd405d admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:36.291380 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca5262-c2d6-4f89-ad18-29c185893e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:36.291979 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca5262-c2d6-4f89-ad18-29c185893e21 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:36.292259 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca5262-c2d6-4f89-ad18-29c185893e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:36.292535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca5262-c2d6-4f89-ad18-29c185893e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:36.293225 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca5262-c2d6-4f89-ad18-29c185893e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:36.294839 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca5262-c2d6-4f89-ad18-29c185893e21 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:36.305327 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1321/2670] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:36.309364 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dd9fe-c876-4ae6-9b9c-8b951fe6c1d7 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:36.319876 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dd9fe-c876-4ae6-9b9c-8b951fe6c1d7 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:36.324551 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a083540-f155-43ed-90cd-711feb536a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:36.325337 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a083540-f155-43ed-90cd-711feb536a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:36.325616 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a083540-f155-43ed-90cd-711feb536a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:36.325891 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a083540-f155-43ed-90cd-711feb536a69 admin admin] PATH_INFO: `/v3/projects/bb7917d721d54151b2fee40dafa615b8/users/04c9fd8034a147bea67084f781be556c/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:36.342284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a083540-f155-43ed-90cd-711feb536a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb7917d721d54151b2fee40dafa615b8, user_id=04c9fd8034a147bea67084f781be556c, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:36.344443 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a083540-f155-43ed-90cd-711feb536a69 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:36.423624 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1350/2671] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:36 2022] PUT /identity/v3/projects/bb7917d721d54151b2fee40dafa615b8/users/04c9fd8034a147bea67084f781be556c/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:36.437195 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc17be-fefd-4fbe-8b3c-21150f714e5f None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:36.437489 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc17be-fefd-4fbe-8b3c-21150f714e5f None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:36.437770 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc17be-fefd-4fbe-8b3c-21150f714e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:36.467522 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-60dc17be-fefd-4fbe-8b3c-21150f714e5f None None] MFA Rules not processed for user `04c9fd8034a147bea67084f781be556c`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:36.468789 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-60dc17be-fefd-4fbe-8b3c-21150f714e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:36.534605 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1322/2672] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:12:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:36.539435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a083540-f155-43ed-90cd-711feb536a69 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:36.603435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a083540-f155-43ed-90cd-711feb536a69 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:36.608728 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fca4c4-09ea-4a57-8add-57ff391d5749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:36.609343 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fca4c4-09ea-4a57-8add-57ff391d5749 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:36.609622 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fca4c4-09ea-4a57-8add-57ff391d5749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:36.609902 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fca4c4-09ea-4a57-8add-57ff391d5749 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:36.610569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fca4c4-09ea-4a57-8add-57ff391d5749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:36.612475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fca4c4-09ea-4a57-8add-57ff391d5749 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:36.710691 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1351/2673] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:12:36 2022] POST /identity/v3/projects => generated 357 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:36.714856 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc17be-fefd-4fbe-8b3c-21150f714e5f None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:36.725901 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc17be-fefd-4fbe-8b3c-21150f714e5f None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:36.780939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24e41b-5b25-4a55-8a2b-b30c278fb7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:36.781572 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24e41b-5b25-4a55-8a2b-b30c278fb7aa admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:36.781819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24e41b-5b25-4a55-8a2b-b30c278fb7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:36.782096 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24e41b-5b25-4a55-8a2b-b30c278fb7aa admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:36.782776 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24e41b-5b25-4a55-8a2b-b30c278fb7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:36.784679 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24e41b-5b25-4a55-8a2b-b30c278fb7aa admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:36.897439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1323/2674] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:12:36 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:36.901307 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fca4c4-09ea-4a57-8add-57ff391d5749 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:36.912572 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fca4c4-09ea-4a57-8add-57ff391d5749 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:36.917206 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd321c-8a84-4afc-a6a0-e3601718e8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:36.917807 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd321c-8a84-4afc-a6a0-e3601718e8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:36.918092 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd321c-8a84-4afc-a6a0-e3601718e8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:36.918371 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd321c-8a84-4afc-a6a0-e3601718e8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:36.919261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd321c-8a84-4afc-a6a0-e3601718e8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:36.920840 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd321c-8a84-4afc-a6a0-e3601718e8d7 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:36.932028 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1352/2675] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:36.936237 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24e41b-5b25-4a55-8a2b-b30c278fb7aa admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:36.946280 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24e41b-5b25-4a55-8a2b-b30c278fb7aa admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:36.951280 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37226f43-d777-4666-b1ab-6c17c442cd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:36.951947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37226f43-d777-4666-b1ab-6c17c442cd1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:36.952273 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37226f43-d777-4666-b1ab-6c17c442cd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:36.952554 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37226f43-d777-4666-b1ab-6c17c442cd1d admin admin] PATH_INFO: `/v3/projects/a510dca179d94fe0a4f56363ba58ebb5/users/747e2e4034614155925759c14115db3e/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:36.967522 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37226f43-d777-4666-b1ab-6c17c442cd1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a510dca179d94fe0a4f56363ba58ebb5, user_id=747e2e4034614155925759c14115db3e, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:36.970171 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37226f43-d777-4666-b1ab-6c17c442cd1d admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:37.051644 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1324/2676] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:36 2022] PUT /identity/v3/projects/a510dca179d94fe0a4f56363ba58ebb5/users/747e2e4034614155925759c14115db3e/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:37.056357 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd321c-8a84-4afc-a6a0-e3601718e8d7 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:37.066462 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd321c-8a84-4afc-a6a0-e3601718e8d7 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:37.086256 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:37.122458 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f170ea9-b459-48fc-b1fa-426444fb3692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:37.123111 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f170ea9-b459-48fc-b1fa-426444fb3692 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:37.123445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f170ea9-b459-48fc-b1fa-426444fb3692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:37.123769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f170ea9-b459-48fc-b1fa-426444fb3692 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:37.124467 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f170ea9-b459-48fc-b1fa-426444fb3692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:37.126109 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f170ea9-b459-48fc-b1fa-426444fb3692 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:37.136225 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1353/2677] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:37.144917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37226f43-d777-4666-b1ab-6c17c442cd1d admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:37.149123 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:37.154679 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37226f43-d777-4666-b1ab-6c17c442cd1d admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:37.160134 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e46d98-6dbf-4542-98f2-0fe9f858ad60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:37.161687 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e46d98-6dbf-4542-98f2-0fe9f858ad60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:37.162104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e46d98-6dbf-4542-98f2-0fe9f858ad60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:37.162467 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e46d98-6dbf-4542-98f2-0fe9f858ad60 admin admin] PATH_INFO: `/v3/projects/a510dca179d94fe0a4f56363ba58ebb5/users/747e2e4034614155925759c14115db3e/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:37.165062 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e46d98-6dbf-4542-98f2-0fe9f858ad60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a510dca179d94fe0a4f56363ba58ebb5, user_id=747e2e4034614155925759c14115db3e, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:37.167787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e46d98-6dbf-4542-98f2-0fe9f858ad60 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:37.178969 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1325/2678] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:37 2022] PUT /identity/v3/projects/a510dca179d94fe0a4f56363ba58ebb5/users/747e2e4034614155925759c14115db3e/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:37.190195 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf1803-ca0a-41d4-b422-be9dd8e0cb67 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:37.190492 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf1803-ca0a-41d4-b422-be9dd8e0cb67 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:37.190818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf1803-ca0a-41d4-b422-be9dd8e0cb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:37.217861 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-a1cf1803-ca0a-41d4-b422-be9dd8e0cb67 None None] MFA Rules not processed for user `747e2e4034614155925759c14115db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:37.219148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-a1cf1803-ca0a-41d4-b422-be9dd8e0cb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:37.291999 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1354/2679] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:12:37 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:37.303197 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e46d98-6dbf-4542-98f2-0fe9f858ad60 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:37.304904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-45e46d98-6dbf-4542-98f2-0fe9f858ad60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:37.363834 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e46d98-6dbf-4542-98f2-0fe9f858ad60 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:37.367581 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0c24a-5c8d-422e-be96-5040428fc733 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:37.368206 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0c24a-5c8d-422e-be96-5040428fc733 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:37.368487 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0c24a-5c8d-422e-be96-5040428fc733 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:37.368764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0c24a-5c8d-422e-be96-5040428fc733 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:37.378008 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0c24a-5c8d-422e-be96-5040428fc733 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:37.379525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0c24a-5c8d-422e-be96-5040428fc733 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:37.389173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1326/2680] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:12:37.532197 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf1803-ca0a-41d4-b422-be9dd8e0cb67 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:37.533608 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-a1cf1803-ca0a-41d4-b422-be9dd8e0cb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:37.597752 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0c24a-5c8d-422e-be96-5040428fc733 service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:37.604789 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf1803-ca0a-41d4-b422-be9dd8e0cb67 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:37.606133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0c24a-5c8d-422e-be96-5040428fc733 service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:37.609693 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3cdce-acb7-43eb-82bf-0aca401b912d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:37.610114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa947bb-e69f-4843-a49c-7b03d9b0dcc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de27d25fad634658a1abcb776d9a7b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:37.610368 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3cdce-acb7-43eb-82bf-0aca401b912d service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:37.610582 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3cdce-acb7-43eb-82bf-0aca401b912d service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:37.610768 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa947bb-e69f-4843-a49c-7b03d9b0dcc7 service placement] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:37.610923 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3cdce-acb7-43eb-82bf-0aca401b912d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:37.611034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa947bb-e69f-4843-a49c-7b03d9b0dcc7 service placement] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:37.611315 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa947bb-e69f-4843-a49c-7b03d9b0dcc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:37.613091 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-6fa947bb-e69f-4843-a49c-7b03d9b0dcc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:37.625386 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa947bb-e69f-4843-a49c-7b03d9b0dcc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:37.627118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa947bb-e69f-4843-a49c-7b03d9b0dcc7 service placement] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:37.637765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1355/2681] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:12:37.672489 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3cdce-acb7-43eb-82bf-0aca401b912d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:37.673936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3cdce-acb7-43eb-82bf-0aca401b912d service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:37.683044 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1327/2682] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:12:47.633440 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=84 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:47.678828 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=58,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:51.815582 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa947bb-e69f-4843-a49c-7b03d9b0dcc7 service placement] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:51.817103 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-6fa947bb-e69f-4843-a49c-7b03d9b0dcc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:51.880769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa947bb-e69f-4843-a49c-7b03d9b0dcc7 service placement] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:51.885081 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a74ea-e4a8-40b5-84c8-091967043c99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:51.885743 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a74ea-e4a8-40b5-84c8-091967043c99 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:51.886025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a74ea-e4a8-40b5-84c8-091967043c99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:51.886301 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a74ea-e4a8-40b5-84c8-091967043c99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:51.888110 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-4e9a74ea-e4a8-40b5-84c8-091967043c99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:51.897624 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a74ea-e4a8-40b5-84c8-091967043c99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:51.899090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a74ea-e4a8-40b5-84c8-091967043c99 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:51.908066 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1356/2683] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:12:51.980313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3cdce-acb7-43eb-82bf-0aca401b912d service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:51.989871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3cdce-acb7-43eb-82bf-0aca401b912d service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:51.993478 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4370e-806a-4170-bfe4-9ddc0975fd9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:51.994162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4370e-806a-4170-bfe4-9ddc0975fd9a service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:51.994443 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4370e-806a-4170-bfe4-9ddc0975fd9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:51.994714 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4370e-806a-4170-bfe4-9ddc0975fd9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:51.996496 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-20a4370e-806a-4170-bfe4-9ddc0975fd9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:52.064872 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4370e-806a-4170-bfe4-9ddc0975fd9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:52.066298 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4370e-806a-4170-bfe4-9ddc0975fd9a service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:52.077686 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1328/2684] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:12:56.021886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a74ea-e4a8-40b5-84c8-091967043c99 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:56.094305 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a74ea-e4a8-40b5-84c8-091967043c99 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:56.099190 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb9278-1835-4c95-a2ff-30d3489c6256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:56.099832 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb9278-1835-4c95-a2ff-30d3489c6256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:56.100153 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb9278-1835-4c95-a2ff-30d3489c6256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:56.100437 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb9278-1835-4c95-a2ff-30d3489c6256 admin admin] PATH_INFO: `/v3/users/04c9fd8034a147bea67084f781be556c` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:56.101689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb9278-1835-4c95-a2ff-30d3489c6256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04c9fd8034a147bea67084f781be556c)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:56.103694 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb9278-1835-4c95-a2ff-30d3489c6256 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:56.332948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7ccb9278-1835-4c95-a2ff-30d3489c6256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04c9fd8034a147bea67084f781be556c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:56.340031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7ccb9278-1835-4c95-a2ff-30d3489c6256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04c9fd8034a147bea67084f781be556c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:56.340786 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7ccb9278-1835-4c95-a2ff-30d3489c6256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04c9fd8034a147bea67084f781be556c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:56.353428 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7ccb9278-1835-4c95-a2ff-30d3489c6256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04c9fd8034a147bea67084f781be556c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:56.354064 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7ccb9278-1835-4c95-a2ff-30d3489c6256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04c9fd8034a147bea67084f781be556c'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:56.439224 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1357/2685] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:12:56 2022] DELETE /identity/v3/users/04c9fd8034a147bea67084f781be556c => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:56.443976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37513cdc-14e0-46dd-9707-c0a70c707e2b None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:56.444507 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37513cdc-14e0-46dd-9707-c0a70c707e2b None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:56.444631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37513cdc-14e0-46dd-9707-c0a70c707e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:56.463468 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-37513cdc-14e0-46dd-9707-c0a70c707e2b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:56.464679 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-37513cdc-14e0-46dd-9707-c0a70c707e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:56.528193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1329/2686] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:56.537841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb9278-1835-4c95-a2ff-30d3489c6256 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:56.539389 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-7ccb9278-1835-4c95-a2ff-30d3489c6256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:56.569305 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:56.600035 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb9278-1835-4c95-a2ff-30d3489c6256 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:56.610330 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afa6bf-0b83-4fcb-bab6-53fc1b531f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:56.610330 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afa6bf-0b83-4fcb-bab6-53fc1b531f48 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:56.610330 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afa6bf-0b83-4fcb-bab6-53fc1b531f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:56.610330 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afa6bf-0b83-4fcb-bab6-53fc1b531f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:56.614843 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afa6bf-0b83-4fcb-bab6-53fc1b531f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:56.616267 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afa6bf-0b83-4fcb-bab6-53fc1b531f48 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:56.626319 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1358/2687] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:12:57.042100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37513cdc-14e0-46dd-9707-c0a70c707e2b None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:57.043621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-37513cdc-14e0-46dd-9707-c0a70c707e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:57.055651 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37513cdc-14e0-46dd-9707-c0a70c707e2b None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:57.061800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012f7cd-a61b-4c3d-8ad7-d284e8ff27d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:57.062587 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012f7cd-a61b-4c3d-8ad7-d284e8ff27d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:57.063015 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012f7cd-a61b-4c3d-8ad7-d284e8ff27d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:57.063298 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012f7cd-a61b-4c3d-8ad7-d284e8ff27d1 admin admin] PATH_INFO: `/v3/projects/bb7917d721d54151b2fee40dafa615b8` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:57.064483 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012f7cd-a61b-4c3d-8ad7-d284e8ff27d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb7917d721d54151b2fee40dafa615b8)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:57.066612 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012f7cd-a61b-4c3d-8ad7-d284e8ff27d1 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:57.177465 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-3012f7cd-a61b-4c3d-8ad7-d284e8ff27d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb7917d721d54151b2fee40dafa615b8', 'request_id': 'req-3012f7cd-a61b-4c3d-8ad7-d284e8ff27d1'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:57.183928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-3012f7cd-a61b-4c3d-8ad7-d284e8ff27d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb7917d721d54151b2fee40dafa615b8', 'request_id': 'req-3012f7cd-a61b-4c3d-8ad7-d284e8ff27d1'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:57.256631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-3012f7cd-a61b-4c3d-8ad7-d284e8ff27d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb7917d721d54151b2fee40dafa615b8', 'request_id': 'req-3012f7cd-a61b-4c3d-8ad7-d284e8ff27d1'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:57.267874 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-3012f7cd-a61b-4c3d-8ad7-d284e8ff27d1 admin admin] The token cache is being invalidate because project bb7917d721d54151b2fee40dafa615b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:12:57.268117 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-3012f7cd-a61b-4c3d-8ad7-d284e8ff27d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:57.268760 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-3012f7cd-a61b-4c3d-8ad7-d284e8ff27d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:57.270274 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1330/2688] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:57 2022] DELETE /identity/v3/projects/bb7917d721d54151b2fee40dafa615b8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:57.274325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afa6bf-0b83-4fcb-bab6-53fc1b531f48 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:57.284482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afa6bf-0b83-4fcb-bab6-53fc1b531f48 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:57.340710 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a8883-1964-4089-917f-17bbeed4bdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:57.341347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a8883-1964-4089-917f-17bbeed4bdf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:57.341629 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a8883-1964-4089-917f-17bbeed4bdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:57.341904 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a8883-1964-4089-917f-17bbeed4bdf6 admin admin] PATH_INFO: `/v3/users/747e2e4034614155925759c14115db3e` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:57.343104 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a8883-1964-4089-917f-17bbeed4bdf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=747e2e4034614155925759c14115db3e)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:57.345011 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a8883-1964-4089-917f-17bbeed4bdf6 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:57.481554 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8d7a8883-1964-4089-917f-17bbeed4bdf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '747e2e4034614155925759c14115db3e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:57.488823 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8d7a8883-1964-4089-917f-17bbeed4bdf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '747e2e4034614155925759c14115db3e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:57.489505 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8d7a8883-1964-4089-917f-17bbeed4bdf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '747e2e4034614155925759c14115db3e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:57.502100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8d7a8883-1964-4089-917f-17bbeed4bdf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '747e2e4034614155925759c14115db3e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:57.502870 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8d7a8883-1964-4089-917f-17bbeed4bdf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '747e2e4034614155925759c14115db3e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:57.553552 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1359/2689] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:12:57 2022] DELETE /identity/v3/users/747e2e4034614155925759c14115db3e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:57.996169 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012f7cd-a61b-4c3d-8ad7-d284e8ff27d1 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:57.998005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-3012f7cd-a61b-4c3d-8ad7-d284e8ff27d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:58.011222 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012f7cd-a61b-4c3d-8ad7-d284e8ff27d1 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:58.016722 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:58.069305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8936b-bb47-4286-895f-534c339b25a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:58.069881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8936b-bb47-4286-895f-534c339b25a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:58.070168 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8936b-bb47-4286-895f-534c339b25a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:58.070445 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8936b-bb47-4286-895f-534c339b25a4 admin admin] PATH_INFO: `/v3/projects/a510dca179d94fe0a4f56363ba58ebb5` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:58.071678 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8936b-bb47-4286-895f-534c339b25a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a510dca179d94fe0a4f56363ba58ebb5)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:58.073673 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8936b-bb47-4286-895f-534c339b25a4 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:58.178260 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-89e8936b-bb47-4286-895f-534c339b25a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a510dca179d94fe0a4f56363ba58ebb5', 'request_id': 'req-89e8936b-bb47-4286-895f-534c339b25a4'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:58.185234 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-89e8936b-bb47-4286-895f-534c339b25a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a510dca179d94fe0a4f56363ba58ebb5', 'request_id': 'req-89e8936b-bb47-4286-895f-534c339b25a4'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:58.256819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-89e8936b-bb47-4286-895f-534c339b25a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a510dca179d94fe0a4f56363ba58ebb5', 'request_id': 'req-89e8936b-bb47-4286-895f-534c339b25a4'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:58.267843 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-89e8936b-bb47-4286-895f-534c339b25a4 admin admin] The token cache is being invalidate because project a510dca179d94fe0a4f56363ba58ebb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:12:58.268147 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-89e8936b-bb47-4286-895f-534c339b25a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:58.268782 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-89e8936b-bb47-4286-895f-534c339b25a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:58.270340 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1331/2690] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:57 2022] DELETE /identity/v3/projects/a510dca179d94fe0a4f56363ba58ebb5 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:58.275928 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312140b1-a67a-4e64-8f10-dcb3c3c45e44 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:58.276415 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312140b1-a67a-4e64-8f10-dcb3c3c45e44 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:58.276518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312140b1-a67a-4e64-8f10-dcb3c3c45e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:58.297018 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-312140b1-a67a-4e64-8f10-dcb3c3c45e44 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:58.298249 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-312140b1-a67a-4e64-8f10-dcb3c3c45e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:58.338196 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:58.357075 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1360/2691] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:58.364994 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d0d99-2197-44d3-ae3e-ced6c4759be9 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:58.365320 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d0d99-2197-44d3-ae3e-ced6c4759be9 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:58.365605 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d0d99-2197-44d3-ae3e-ced6c4759be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:58.385293 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-046d0d99-2197-44d3-ae3e-ced6c4759be9 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:58.386516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-046d0d99-2197-44d3-ae3e-ced6c4759be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:58.394600 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1332/2692] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:58.398829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312140b1-a67a-4e64-8f10-dcb3c3c45e44 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:58.409546 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312140b1-a67a-4e64-8f10-dcb3c3c45e44 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:58.414482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677eca2-169f-4d67-9cae-8e42ad8da06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:58.416203 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677eca2-169f-4d67-9cae-8e42ad8da06d admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:58.416203 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677eca2-169f-4d67-9cae-8e42ad8da06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:58.416400 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677eca2-169f-4d67-9cae-8e42ad8da06d admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:58.417048 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677eca2-169f-4d67-9cae-8e42ad8da06d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:12:58.417359 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677eca2-169f-4d67-9cae-8e42ad8da06d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:58.419103 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677eca2-169f-4d67-9cae-8e42ad8da06d admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:58.430688 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1361/2693] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:12:58.435008 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d0d99-2197-44d3-ae3e-ced6c4759be9 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:58.444305 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d0d99-2197-44d3-ae3e-ced6c4759be9 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:58.449014 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b73871-a91a-4cac-8013-c5556d0ff1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:58.449617 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b73871-a91a-4cac-8013-c5556d0ff1ea admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:58.449901 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b73871-a91a-4cac-8013-c5556d0ff1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:58.450179 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b73871-a91a-4cac-8013-c5556d0ff1ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:58.450911 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b73871-a91a-4cac-8013-c5556d0ff1ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:58.452812 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b73871-a91a-4cac-8013-c5556d0ff1ea admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:58.549362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1333/2694] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:12:58 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:12:58.553592 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677eca2-169f-4d67-9cae-8e42ad8da06d admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:58.563554 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677eca2-169f-4d67-9cae-8e42ad8da06d admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:58.621479 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68c200-2cb9-4a75-b7a9-8a24f6c8dfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:58.622030 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68c200-2cb9-4a75-b7a9-8a24f6c8dfd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:58.622332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68c200-2cb9-4a75-b7a9-8a24f6c8dfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:58.622614 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68c200-2cb9-4a75-b7a9-8a24f6c8dfd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:58.623326 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68c200-2cb9-4a75-b7a9-8a24f6c8dfd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:58.625245 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68c200-2cb9-4a75-b7a9-8a24f6c8dfd8 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:58.684955 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1362/2695] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:12:58 2022] POST /identity/v3/users => generated 283 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:58.689070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b73871-a91a-4cac-8013-c5556d0ff1ea admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:58.700306 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b73871-a91a-4cac-8013-c5556d0ff1ea admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:58.705098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682785b-e18b-4036-8c5b-46947e535271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:58.705706 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682785b-e18b-4036-8c5b-46947e535271 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:58.705997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682785b-e18b-4036-8c5b-46947e535271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:58.706279 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682785b-e18b-4036-8c5b-46947e535271 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:58.707020 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682785b-e18b-4036-8c5b-46947e535271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:58.708631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682785b-e18b-4036-8c5b-46947e535271 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:58.719091 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1334/2696] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:58.723025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68c200-2cb9-4a75-b7a9-8a24f6c8dfd8 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:58.732788 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68c200-2cb9-4a75-b7a9-8a24f6c8dfd8 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:58.737389 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49c40a-7421-4d6d-a7b6-5c9443df29aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:58.737988 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49c40a-7421-4d6d-a7b6-5c9443df29aa admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:58.738277 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49c40a-7421-4d6d-a7b6-5c9443df29aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:58.738551 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49c40a-7421-4d6d-a7b6-5c9443df29aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:58.739281 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49c40a-7421-4d6d-a7b6-5c9443df29aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:58.740854 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49c40a-7421-4d6d-a7b6-5c9443df29aa admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:58.751201 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1363/2697] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:58.755083 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682785b-e18b-4036-8c5b-46947e535271 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:58.765898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682785b-e18b-4036-8c5b-46947e535271 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:58.770713 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb5a90-6b1f-4110-b35f-627d16fad101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:58.771394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb5a90-6b1f-4110-b35f-627d16fad101 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:58.771700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb5a90-6b1f-4110-b35f-627d16fad101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:58.771963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb5a90-6b1f-4110-b35f-627d16fad101 admin admin] PATH_INFO: `/v3/projects/aa7c44e576e24b319d63751740b36372/users/b364acb676694ccab09fce335f235513/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:58.787229 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb5a90-6b1f-4110-b35f-627d16fad101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7c44e576e24b319d63751740b36372, user_id=b364acb676694ccab09fce335f235513, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:58.789866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb5a90-6b1f-4110-b35f-627d16fad101 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:58.845806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1335/2698] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:58 2022] PUT /identity/v3/projects/aa7c44e576e24b319d63751740b36372/users/b364acb676694ccab09fce335f235513/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:12:58.918418 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd3ebe-9293-4d80-993e-d8116ede9e3b None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:58.920208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd3ebe-9293-4d80-993e-d8116ede9e3b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:58.920208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd3ebe-9293-4d80-993e-d8116ede9e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:58.949332 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-86fd3ebe-9293-4d80-993e-d8116ede9e3b None None] MFA Rules not processed for user `b364acb676694ccab09fce335f235513`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:58.960340 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-86fd3ebe-9293-4d80-993e-d8116ede9e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:59.016949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1364/2699] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:12:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:59.021381 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb5a90-6b1f-4110-b35f-627d16fad101 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:59.060726 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:59.083163 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb5a90-6b1f-4110-b35f-627d16fad101 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:59.087798 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e05416-3167-43e6-8400-564cc1c11e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:59.088406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e05416-3167-43e6-8400-564cc1c11e7e admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:59.088693 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e05416-3167-43e6-8400-564cc1c11e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:59.088971 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e05416-3167-43e6-8400-564cc1c11e7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:59.089647 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e05416-3167-43e6-8400-564cc1c11e7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:59.091586 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e05416-3167-43e6-8400-564cc1c11e7e admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:59.178821 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1336/2700] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:12:59 2022] POST /identity/v3/projects => generated 365 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:59.183300 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd3ebe-9293-4d80-993e-d8116ede9e3b None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:59.194209 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd3ebe-9293-4d80-993e-d8116ede9e3b None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:59.232317 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:59.249648 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9759fa-c3ba-4006-a008-6f52f7ce8052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:59.250275 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9759fa-c3ba-4006-a008-6f52f7ce8052 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:59.250789 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9759fa-c3ba-4006-a008-6f52f7ce8052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:59.251297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9759fa-c3ba-4006-a008-6f52f7ce8052 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:59.252406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9759fa-c3ba-4006-a008-6f52f7ce8052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:59.254423 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9759fa-c3ba-4006-a008-6f52f7ce8052 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:59.313910 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1365/2701] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:12:59 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:59.317983 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e05416-3167-43e6-8400-564cc1c11e7e admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:59.328943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e05416-3167-43e6-8400-564cc1c11e7e admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:59.333595 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9824b-bb88-4e92-ab54-df45687ce144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:59.334321 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9824b-bb88-4e92-ab54-df45687ce144 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:59.334603 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9824b-bb88-4e92-ab54-df45687ce144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:59.334916 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9824b-bb88-4e92-ab54-df45687ce144 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:59.335611 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9824b-bb88-4e92-ab54-df45687ce144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:59.337839 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9824b-bb88-4e92-ab54-df45687ce144 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:59.348204 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1337/2702] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:59.352543 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9759fa-c3ba-4006-a008-6f52f7ce8052 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:59.362633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9759fa-c3ba-4006-a008-6f52f7ce8052 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:59.367346 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f9b20-e97b-45c3-8762-547ba145acf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:59.368011 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f9b20-e97b-45c3-8762-547ba145acf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:59.368299 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f9b20-e97b-45c3-8762-547ba145acf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:59.368581 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f9b20-e97b-45c3-8762-547ba145acf5 admin admin] PATH_INFO: `/v3/projects/098ba45a035a49cbb2556cec31cf0647/users/078ea923d89347ac9560337836491f07/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:59.383240 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f9b20-e97b-45c3-8762-547ba145acf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098ba45a035a49cbb2556cec31cf0647, user_id=078ea923d89347ac9560337836491f07, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:59.386531 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f9b20-e97b-45c3-8762-547ba145acf5 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:59.473795 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1366/2703] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:59 2022] PUT /identity/v3/projects/098ba45a035a49cbb2556cec31cf0647/users/078ea923d89347ac9560337836491f07/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:59.477607 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9824b-bb88-4e92-ab54-df45687ce144 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:59.487725 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9824b-bb88-4e92-ab54-df45687ce144 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:59.544890 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c457fd-2513-4c6b-80b5-b82ea9b50228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:59.545514 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c457fd-2513-4c6b-80b5-b82ea9b50228 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:59.545827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c457fd-2513-4c6b-80b5-b82ea9b50228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:59.546119 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c457fd-2513-4c6b-80b5-b82ea9b50228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:59.546816 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c457fd-2513-4c6b-80b5-b82ea9b50228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:59.548472 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c457fd-2513-4c6b-80b5-b82ea9b50228 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:59.558694 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1338/2704] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:59.562982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f9b20-e97b-45c3-8762-547ba145acf5 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:59.573767 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f9b20-e97b-45c3-8762-547ba145acf5 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:59.578477 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f9f8e-3754-4acb-9ff0-0b44eaad02a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:59.579168 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f9f8e-3754-4acb-9ff0-0b44eaad02a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:59.579463 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f9f8e-3754-4acb-9ff0-0b44eaad02a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:59.579746 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f9f8e-3754-4acb-9ff0-0b44eaad02a5 admin admin] PATH_INFO: `/v3/projects/098ba45a035a49cbb2556cec31cf0647/users/078ea923d89347ac9560337836491f07/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:59.581746 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f9f8e-3754-4acb-9ff0-0b44eaad02a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098ba45a035a49cbb2556cec31cf0647, user_id=078ea923d89347ac9560337836491f07, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:59.584436 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f9f8e-3754-4acb-9ff0-0b44eaad02a5 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:59.595584 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1367/2705] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:59 2022] PUT /identity/v3/projects/098ba45a035a49cbb2556cec31cf0647/users/078ea923d89347ac9560337836491f07/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:59.606104 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ea5b2-d4aa-45d9-8fd7-efa3c4b42f48 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:59.606394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ea5b2-d4aa-45d9-8fd7-efa3c4b42f48 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:59.606672 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ea5b2-d4aa-45d9-8fd7-efa3c4b42f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:59.633859 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-440ea5b2-d4aa-45d9-8fd7-efa3c4b42f48 None None] MFA Rules not processed for user `078ea923d89347ac9560337836491f07`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:59.635608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-440ea5b2-d4aa-45d9-8fd7-efa3c4b42f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:59.704592 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1339/2706] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:12:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:59.715954 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f9f8e-3754-4acb-9ff0-0b44eaad02a5 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:59.717652 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-902f9f8e-3754-4acb-9ff0-0b44eaad02a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:59.775701 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f9f8e-3754-4acb-9ff0-0b44eaad02a5 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:59.779287 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507100aa-6b33-4e2c-9d15-179f25355a07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:59.779892 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507100aa-6b33-4e2c-9d15-179f25355a07 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:59.780184 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507100aa-6b33-4e2c-9d15-179f25355a07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:59.780462 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507100aa-6b33-4e2c-9d15-179f25355a07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:59.789596 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507100aa-6b33-4e2c-9d15-179f25355a07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:59.791080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507100aa-6b33-4e2c-9d15-179f25355a07 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:59.800583 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1368/2707] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:13:00.037156 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ea5b2-d4aa-45d9-8fd7-efa3c4b42f48 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:00.047469 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ea5b2-d4aa-45d9-8fd7-efa3c4b42f48 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:00.051196 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f4112-8ad5-4edd-961a-7276da56ec22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:00.051828 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f4112-8ad5-4edd-961a-7276da56ec22 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:00.052113 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f4112-8ad5-4edd-961a-7276da56ec22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:00.052387 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f4112-8ad5-4edd-961a-7276da56ec22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:00.084409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:00.112381 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f4112-8ad5-4edd-961a-7276da56ec22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:00.113838 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f4112-8ad5-4edd-961a-7276da56ec22 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:00.124637 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1340/2708] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:13:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:13:09.796435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=52,keystone:INSERT=5 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:10.154805 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=14 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:12.901170 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507100aa-6b33-4e2c-9d15-179f25355a07 service cinder] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:12.964080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507100aa-6b33-4e2c-9d15-179f25355a07 service cinder] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:12.972562 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e96fa0-eadd-4a57-8b47-8bf2cd94810f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:12.973221 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e96fa0-eadd-4a57-8b47-8bf2cd94810f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:12.973509 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e96fa0-eadd-4a57-8b47-8bf2cd94810f admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:12.973801 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e96fa0-eadd-4a57-8b47-8bf2cd94810f admin admin] PATH_INFO: `/v3/users/b364acb676694ccab09fce335f235513` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:12.975143 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e96fa0-eadd-4a57-8b47-8bf2cd94810f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b364acb676694ccab09fce335f235513)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:12.977114 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e96fa0-eadd-4a57-8b47-8bf2cd94810f admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:13.121542 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-69e96fa0-eadd-4a57-8b47-8bf2cd94810f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b364acb676694ccab09fce335f235513'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:13.128956 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-69e96fa0-eadd-4a57-8b47-8bf2cd94810f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b364acb676694ccab09fce335f235513'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:13.129419 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-69e96fa0-eadd-4a57-8b47-8bf2cd94810f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b364acb676694ccab09fce335f235513'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:13.147760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-69e96fa0-eadd-4a57-8b47-8bf2cd94810f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b364acb676694ccab09fce335f235513'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:13.148490 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-69e96fa0-eadd-4a57-8b47-8bf2cd94810f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b364acb676694ccab09fce335f235513'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:13.205405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1369/2709] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:13:12 2022] DELETE /identity/v3/users/b364acb676694ccab09fce335f235513 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:13:13.209891 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa31b7-139c-49e4-87d9-36b3fe011937 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:13.210417 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa31b7-139c-49e4-87d9-36b3fe011937 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:13.210526 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa31b7-139c-49e4-87d9-36b3fe011937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:13.229986 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-4ffa31b7-139c-49e4-87d9-36b3fe011937 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:13.231833 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-4ffa31b7-139c-49e4-87d9-36b3fe011937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:13.292253 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1341/2710] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:13:13.301200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e96fa0-eadd-4a57-8b47-8bf2cd94810f admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:13.302640 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-69e96fa0-eadd-4a57-8b47-8bf2cd94810f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:13.359587 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e96fa0-eadd-4a57-8b47-8bf2cd94810f admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:13.363289 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6dd84-a2a6-4ea5-aae3-cfbcdbc36175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:13.363906 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6dd84-a2a6-4ea5-aae3-cfbcdbc36175 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:13.364300 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6dd84-a2a6-4ea5-aae3-cfbcdbc36175 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:13.364585 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6dd84-a2a6-4ea5-aae3-cfbcdbc36175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:13.373599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6dd84-a2a6-4ea5-aae3-cfbcdbc36175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:13.375094 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6dd84-a2a6-4ea5-aae3-cfbcdbc36175 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:13.384464 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1370/2711] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:13:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:13:13.772418 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa31b7-139c-49e4-87d9-36b3fe011937 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:13.773833 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-4ffa31b7-139c-49e4-87d9-36b3fe011937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:13.788687 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa31b7-139c-49e4-87d9-36b3fe011937 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:13.793590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e53e3-d738-44a8-a080-1fda4a2ad995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:13.794441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e53e3-d738-44a8-a080-1fda4a2ad995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:13.794723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e53e3-d738-44a8-a080-1fda4a2ad995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:13.795025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e53e3-d738-44a8-a080-1fda4a2ad995 admin admin] PATH_INFO: `/v3/projects/aa7c44e576e24b319d63751740b36372` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:13.796233 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e53e3-d738-44a8-a080-1fda4a2ad995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa7c44e576e24b319d63751740b36372)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:13.798173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e53e3-d738-44a8-a080-1fda4a2ad995 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:13.885501 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e51e53e3-d738-44a8-a080-1fda4a2ad995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa7c44e576e24b319d63751740b36372', 'request_id': 'req-e51e53e3-d738-44a8-a080-1fda4a2ad995'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:13.892388 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e51e53e3-d738-44a8-a080-1fda4a2ad995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa7c44e576e24b319d63751740b36372', 'request_id': 'req-e51e53e3-d738-44a8-a080-1fda4a2ad995'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:13.953903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e51e53e3-d738-44a8-a080-1fda4a2ad995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa7c44e576e24b319d63751740b36372', 'request_id': 'req-e51e53e3-d738-44a8-a080-1fda4a2ad995'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:13.964597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e51e53e3-d738-44a8-a080-1fda4a2ad995 admin admin] The token cache is being invalidate because project aa7c44e576e24b319d63751740b36372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:13:13.964887 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e51e53e3-d738-44a8-a080-1fda4a2ad995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:13.967935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e51e53e3-d738-44a8-a080-1fda4a2ad995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:13.967935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1342/2712] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:13:13 2022] DELETE /identity/v3/projects/aa7c44e576e24b319d63751740b36372 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:13:13.971361 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6dd84-a2a6-4ea5-aae3-cfbcdbc36175 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:13.981045 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6dd84-a2a6-4ea5-aae3-cfbcdbc36175 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:13.999884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:14.038060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafcc1d-0ea7-4550-9567-a6faf9d6ff35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:14.038633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafcc1d-0ea7-4550-9567-a6faf9d6ff35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:14.038949 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafcc1d-0ea7-4550-9567-a6faf9d6ff35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:14.039232 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafcc1d-0ea7-4550-9567-a6faf9d6ff35 admin admin] PATH_INFO: `/v3/users/078ea923d89347ac9560337836491f07` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:14.040399 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafcc1d-0ea7-4550-9567-a6faf9d6ff35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=078ea923d89347ac9560337836491f07)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:14.042411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafcc1d-0ea7-4550-9567-a6faf9d6ff35 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:14.202093 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7bafcc1d-0ea7-4550-9567-a6faf9d6ff35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '078ea923d89347ac9560337836491f07'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:14.208925 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7bafcc1d-0ea7-4550-9567-a6faf9d6ff35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '078ea923d89347ac9560337836491f07'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:14.209604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7bafcc1d-0ea7-4550-9567-a6faf9d6ff35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '078ea923d89347ac9560337836491f07'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:14.221402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7bafcc1d-0ea7-4550-9567-a6faf9d6ff35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '078ea923d89347ac9560337836491f07'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:14.222040 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-7bafcc1d-0ea7-4550-9567-a6faf9d6ff35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '078ea923d89347ac9560337836491f07'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:14.275269 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1371/2713] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:13:13 2022] DELETE /identity/v3/users/078ea923d89347ac9560337836491f07 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:13:14.646751 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e53e3-d738-44a8-a080-1fda4a2ad995 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:14.653180 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e51e53e3-d738-44a8-a080-1fda4a2ad995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:14.663924 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e53e3-d738-44a8-a080-1fda4a2ad995 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:14.722025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848b7e7-11f2-4105-809a-fa88d08f89a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:14.722671 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848b7e7-11f2-4105-809a-fa88d08f89a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:14.722993 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848b7e7-11f2-4105-809a-fa88d08f89a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:14.723281 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848b7e7-11f2-4105-809a-fa88d08f89a8 admin admin] PATH_INFO: `/v3/projects/098ba45a035a49cbb2556cec31cf0647` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:14.724449 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848b7e7-11f2-4105-809a-fa88d08f89a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=098ba45a035a49cbb2556cec31cf0647)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:14.726394 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848b7e7-11f2-4105-809a-fa88d08f89a8 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:14.806754 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:14.822381 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e848b7e7-11f2-4105-809a-fa88d08f89a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098ba45a035a49cbb2556cec31cf0647', 'request_id': 'req-e848b7e7-11f2-4105-809a-fa88d08f89a8'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:14.828465 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e848b7e7-11f2-4105-809a-fa88d08f89a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098ba45a035a49cbb2556cec31cf0647', 'request_id': 'req-e848b7e7-11f2-4105-809a-fa88d08f89a8'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:14.913820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e848b7e7-11f2-4105-809a-fa88d08f89a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098ba45a035a49cbb2556cec31cf0647', 'request_id': 'req-e848b7e7-11f2-4105-809a-fa88d08f89a8'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:14.925277 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e848b7e7-11f2-4105-809a-fa88d08f89a8 admin admin] The token cache is being invalidate because project 098ba45a035a49cbb2556cec31cf0647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:13:14.925690 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e848b7e7-11f2-4105-809a-fa88d08f89a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:14.926668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e848b7e7-11f2-4105-809a-fa88d08f89a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:14.928198 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1343/2714] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:13:14 2022] DELETE /identity/v3/projects/098ba45a035a49cbb2556cec31cf0647 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:13:14.933104 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145be5b2-af3e-45bd-8576-faef83d731cd None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:14.934095 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145be5b2-af3e-45bd-8576-faef83d731cd None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:14.934095 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145be5b2-af3e-45bd-8576-faef83d731cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:14.953964 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-145be5b2-af3e-45bd-8576-faef83d731cd None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:14.955218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-145be5b2-af3e-45bd-8576-faef83d731cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:15.024311 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1372/2715] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:13:15.032897 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b013f-91d6-403c-93a3-73f95c758f49 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:15.033190 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b013f-91d6-403c-93a3-73f95c758f49 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:15.033471 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b013f-91d6-403c-93a3-73f95c758f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:15.053109 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-8c4b013f-91d6-403c-93a3-73f95c758f49 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:15.054313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-8c4b013f-91d6-403c-93a3-73f95c758f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:15.062216 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1344/2716] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:13:15.066493 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145be5b2-af3e-45bd-8576-faef83d731cd None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:15.076634 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145be5b2-af3e-45bd-8576-faef83d731cd None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:15.082130 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a62f1-d78f-4d7a-b61f-584dee0275bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:15.082754 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a62f1-d78f-4d7a-b61f-584dee0275bc admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:15.083069 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a62f1-d78f-4d7a-b61f-584dee0275bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:15.083390 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a62f1-d78f-4d7a-b61f-584dee0275bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:15.084103 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a62f1-d78f-4d7a-b61f-584dee0275bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:13:15.084414 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a62f1-d78f-4d7a-b61f-584dee0275bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:15.086002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a62f1-d78f-4d7a-b61f-584dee0275bc admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:15.098305 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1373/2717] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:13:15.104172 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b013f-91d6-403c-93a3-73f95c758f49 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:15.113487 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b013f-91d6-403c-93a3-73f95c758f49 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:15.118119 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46dcc7-d038-453b-9b74-8380967370b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:15.118718 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46dcc7-d038-453b-9b74-8380967370b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:15.119029 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46dcc7-d038-453b-9b74-8380967370b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:15.119304 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46dcc7-d038-453b-9b74-8380967370b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:15.119964 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46dcc7-d038-453b-9b74-8380967370b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:15.121912 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46dcc7-d038-453b-9b74-8380967370b1 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:15.218247 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1345/2718] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:13:15 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:13:15.222401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a62f1-d78f-4d7a-b61f-584dee0275bc admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:15.233032 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a62f1-d78f-4d7a-b61f-584dee0275bc admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:15.259649 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:15.295042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968bd68-baa6-485e-92f7-14f292c40fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:15.295684 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968bd68-baa6-485e-92f7-14f292c40fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:15.295975 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968bd68-baa6-485e-92f7-14f292c40fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:15.296260 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968bd68-baa6-485e-92f7-14f292c40fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:15.296951 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968bd68-baa6-485e-92f7-14f292c40fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:15.298924 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968bd68-baa6-485e-92f7-14f292c40fd0 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:15.375007 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1374/2719] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:13:15 2022] POST /identity/v3/users => generated 283 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:13:15.376161 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46dcc7-d038-453b-9b74-8380967370b1 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:15.386339 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46dcc7-d038-453b-9b74-8380967370b1 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:15.390977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a44965-62cb-4aeb-b79d-0a3d02b4ea61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:15.391589 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a44965-62cb-4aeb-b79d-0a3d02b4ea61 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:15.391875 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a44965-62cb-4aeb-b79d-0a3d02b4ea61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:15.392171 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a44965-62cb-4aeb-b79d-0a3d02b4ea61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:15.392850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a44965-62cb-4aeb-b79d-0a3d02b4ea61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:15.394444 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a44965-62cb-4aeb-b79d-0a3d02b4ea61 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:15.404657 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1346/2720] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:13:15.416520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968bd68-baa6-485e-92f7-14f292c40fd0 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:15.427092 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968bd68-baa6-485e-92f7-14f292c40fd0 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:15.431721 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffa4d1-5500-4453-8c87-3c8052dfc996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:15.432326 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffa4d1-5500-4453-8c87-3c8052dfc996 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:15.432615 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffa4d1-5500-4453-8c87-3c8052dfc996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:15.432897 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffa4d1-5500-4453-8c87-3c8052dfc996 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:15.433597 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ffa4d1-5500-4453-8c87-3c8052dfc996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:15.435227 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ffa4d1-5500-4453-8c87-3c8052dfc996 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:15.445014 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1375/2721] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:13:15.449066 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a44965-62cb-4aeb-b79d-0a3d02b4ea61 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:15.458786 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a44965-62cb-4aeb-b79d-0a3d02b4ea61 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:15.463369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848bc29-63be-4b8e-81b7-f92cae19f83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:15.464015 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848bc29-63be-4b8e-81b7-f92cae19f83e admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:15.464303 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848bc29-63be-4b8e-81b7-f92cae19f83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:15.465072 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848bc29-63be-4b8e-81b7-f92cae19f83e admin admin] PATH_INFO: `/v3/projects/9c7887614c1f4d49af1c00951617681d/users/8afccd63ac4d44618329150ee91874d1/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:15.479857 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848bc29-63be-4b8e-81b7-f92cae19f83e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c7887614c1f4d49af1c00951617681d, user_id=8afccd63ac4d44618329150ee91874d1, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:15.483182 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848bc29-63be-4b8e-81b7-f92cae19f83e admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:15.588552 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1347/2722] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:13:15 2022] PUT /identity/v3/projects/9c7887614c1f4d49af1c00951617681d/users/8afccd63ac4d44618329150ee91874d1/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:13:15.599381 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065930a6-dc85-42d1-b113-2a7794e96aae None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:15.599673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065930a6-dc85-42d1-b113-2a7794e96aae None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:15.599950 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065930a6-dc85-42d1-b113-2a7794e96aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:15.628703 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-065930a6-dc85-42d1-b113-2a7794e96aae None None] MFA Rules not processed for user `8afccd63ac4d44618329150ee91874d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:15.629970 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-065930a6-dc85-42d1-b113-2a7794e96aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:15.702103 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1376/2723] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:13:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:13:15.706518 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848bc29-63be-4b8e-81b7-f92cae19f83e admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:15.767943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848bc29-63be-4b8e-81b7-f92cae19f83e admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:15.772476 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6c43b-a214-4ee8-ad12-04650a7268eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:15.773079 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6c43b-a214-4ee8-ad12-04650a7268eb admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:15.773364 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6c43b-a214-4ee8-ad12-04650a7268eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:15.773639 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6c43b-a214-4ee8-ad12-04650a7268eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:15.774302 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6c43b-a214-4ee8-ad12-04650a7268eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:15.776221 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6c43b-a214-4ee8-ad12-04650a7268eb admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:15.857548 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1348/2724] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:13:15 2022] POST /identity/v3/projects => generated 363 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:13:15.861644 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065930a6-dc85-42d1-b113-2a7794e96aae None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:15.872353 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065930a6-dc85-42d1-b113-2a7794e96aae None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:15.929344 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e5089-2942-435a-a077-b2b4de4f5935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:15.929962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e5089-2942-435a-a077-b2b4de4f5935 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:15.930262 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e5089-2942-435a-a077-b2b4de4f5935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:15.930524 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e5089-2942-435a-a077-b2b4de4f5935 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:15.931215 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e5089-2942-435a-a077-b2b4de4f5935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:15.933124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e5089-2942-435a-a077-b2b4de4f5935 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:16.016922 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1377/2725] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:13:15 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:13:16.021096 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6c43b-a214-4ee8-ad12-04650a7268eb admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:16.031927 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6c43b-a214-4ee8-ad12-04650a7268eb admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:16.036792 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0da77-a228-4230-bd69-359e1e352627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:16.039710 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0da77-a228-4230-bd69-359e1e352627 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:16.039710 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0da77-a228-4230-bd69-359e1e352627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:16.039710 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0da77-a228-4230-bd69-359e1e352627 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:16.039710 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0da77-a228-4230-bd69-359e1e352627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:16.040226 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0da77-a228-4230-bd69-359e1e352627 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:16.050676 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1349/2726] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:13:16.054689 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e5089-2942-435a-a077-b2b4de4f5935 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:16.064624 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e5089-2942-435a-a077-b2b4de4f5935 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:16.069317 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e7d57-b5aa-4d62-b7be-e7a96a26d2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:16.069968 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e7d57-b5aa-4d62-b7be-e7a96a26d2d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:16.070259 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e7d57-b5aa-4d62-b7be-e7a96a26d2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:16.070541 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e7d57-b5aa-4d62-b7be-e7a96a26d2d0 admin admin] PATH_INFO: `/v3/projects/c2a701c1db5f4000b191f9d55f301855/users/ef7b17a419e14b38b2e757de541c64c1/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:16.085480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e7d57-b5aa-4d62-b7be-e7a96a26d2d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2a701c1db5f4000b191f9d55f301855, user_id=ef7b17a419e14b38b2e757de541c64c1, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:16.088183 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e7d57-b5aa-4d62-b7be-e7a96a26d2d0 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:16.165855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1378/2727] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:13:16 2022] PUT /identity/v3/projects/c2a701c1db5f4000b191f9d55f301855/users/ef7b17a419e14b38b2e757de541c64c1/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:13:16.169991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0da77-a228-4230-bd69-359e1e352627 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:16.180205 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0da77-a228-4230-bd69-359e1e352627 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:16.200937 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:16.237718 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559f27d-a0cb-4440-bf51-6b8a64e55aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:16.238369 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559f27d-a0cb-4440-bf51-6b8a64e55aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:16.238656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559f27d-a0cb-4440-bf51-6b8a64e55aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:16.238966 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559f27d-a0cb-4440-bf51-6b8a64e55aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:16.239657 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559f27d-a0cb-4440-bf51-6b8a64e55aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:16.241283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559f27d-a0cb-4440-bf51-6b8a64e55aa9 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:16.251761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1350/2728] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:13:16.255893 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e7d57-b5aa-4d62-b7be-e7a96a26d2d0 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:16.261898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:16.267180 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e7d57-b5aa-4d62-b7be-e7a96a26d2d0 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:16.281288 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5857eb-f319-461b-bae8-e5c41db20fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:16.281288 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5857eb-f319-461b-bae8-e5c41db20fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:16.281288 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5857eb-f319-461b-bae8-e5c41db20fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:16.281288 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5857eb-f319-461b-bae8-e5c41db20fc4 admin admin] PATH_INFO: `/v3/projects/c2a701c1db5f4000b191f9d55f301855/users/ef7b17a419e14b38b2e757de541c64c1/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:16.281842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5857eb-f319-461b-bae8-e5c41db20fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2a701c1db5f4000b191f9d55f301855, user_id=ef7b17a419e14b38b2e757de541c64c1, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:16.281842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5857eb-f319-461b-bae8-e5c41db20fc4 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:16.288818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1379/2729] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:13:16 2022] PUT /identity/v3/projects/c2a701c1db5f4000b191f9d55f301855/users/ef7b17a419e14b38b2e757de541c64c1/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:13:16.299043 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5819e-0ec9-44ec-b343-b4bfd71a316f None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:16.299335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5819e-0ec9-44ec-b343-b4bfd71a316f None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:16.299616 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5819e-0ec9-44ec-b343-b4bfd71a316f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:16.328933 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-93d5819e-0ec9-44ec-b343-b4bfd71a316f None None] MFA Rules not processed for user `ef7b17a419e14b38b2e757de541c64c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:16.330169 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-93d5819e-0ec9-44ec-b343-b4bfd71a316f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:16.396973 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1351/2730] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:13:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:13:16.408537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5857eb-f319-461b-bae8-e5c41db20fc4 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:16.410228 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-0a5857eb-f319-461b-bae8-e5c41db20fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:16.467956 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5857eb-f319-461b-bae8-e5c41db20fc4 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:16.471655 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b089e-150b-4a03-b585-8211619f0be5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:16.472277 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b089e-150b-4a03-b585-8211619f0be5 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:16.472551 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b089e-150b-4a03-b585-8211619f0be5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:16.472830 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b089e-150b-4a03-b585-8211619f0be5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:16.482004 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b089e-150b-4a03-b585-8211619f0be5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:16.483465 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b089e-150b-4a03-b585-8211619f0be5 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:16.492813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1380/2731] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:13:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:13:16.664465 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5819e-0ec9-44ec-b343-b4bfd71a316f None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:16.673956 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5819e-0ec9-44ec-b343-b4bfd71a316f None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:16.677665 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74304014-1ddb-4f19-9648-7faf400e7d36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:16.678304 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74304014-1ddb-4f19-9648-7faf400e7d36 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:16.678588 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74304014-1ddb-4f19-9648-7faf400e7d36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:16.678893 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74304014-1ddb-4f19-9648-7faf400e7d36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:16.735099 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74304014-1ddb-4f19-9648-7faf400e7d36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:16.736541 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74304014-1ddb-4f19-9648-7faf400e7d36 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:16.745300 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1352/2732] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:13:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:13:20.214963 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b089e-150b-4a03-b585-8211619f0be5 service cinder] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:20.276310 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b089e-150b-4a03-b585-8211619f0be5 service cinder] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:20.280898 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c51d8-3cb6-411c-9c25-6f02ee3e684c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:20.281537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c51d8-3cb6-411c-9c25-6f02ee3e684c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:20.281823 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c51d8-3cb6-411c-9c25-6f02ee3e684c admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:20.282106 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c51d8-3cb6-411c-9c25-6f02ee3e684c admin admin] PATH_INFO: `/v3/users/8afccd63ac4d44618329150ee91874d1` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:20.283287 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c51d8-3cb6-411c-9c25-6f02ee3e684c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8afccd63ac4d44618329150ee91874d1)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:20.285196 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c51d8-3cb6-411c-9c25-6f02ee3e684c admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:20.429951 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c71c51d8-3cb6-411c-9c25-6f02ee3e684c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8afccd63ac4d44618329150ee91874d1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:20.437486 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c71c51d8-3cb6-411c-9c25-6f02ee3e684c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8afccd63ac4d44618329150ee91874d1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:20.438157 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c71c51d8-3cb6-411c-9c25-6f02ee3e684c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8afccd63ac4d44618329150ee91874d1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:20.449942 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c71c51d8-3cb6-411c-9c25-6f02ee3e684c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8afccd63ac4d44618329150ee91874d1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:20.450522 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c71c51d8-3cb6-411c-9c25-6f02ee3e684c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8afccd63ac4d44618329150ee91874d1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:20.496097 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1381/2733] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:13:20 2022] DELETE /identity/v3/users/8afccd63ac4d44618329150ee91874d1 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:13:20.500692 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b806a-3734-48b3-821f-8116c4791fb9 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:20.501185 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b806a-3734-48b3-821f-8116c4791fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:20.501303 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b806a-3734-48b3-821f-8116c4791fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:20.520268 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-8d2b806a-3734-48b3-821f-8116c4791fb9 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:20.521495 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-8d2b806a-3734-48b3-821f-8116c4791fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:20.563202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=100 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:20.582054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1353/2734] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:13:20.592609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c51d8-3cb6-411c-9c25-6f02ee3e684c admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:20.594080 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-c71c51d8-3cb6-411c-9c25-6f02ee3e684c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:20.608622 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:20.652347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c51d8-3cb6-411c-9c25-6f02ee3e684c admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:20.656107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00af67-19d3-4d13-b646-267a5f46eda3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:20.659262 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00af67-19d3-4d13-b646-267a5f46eda3 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:20.659262 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00af67-19d3-4d13-b646-267a5f46eda3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:20.659262 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00af67-19d3-4d13-b646-267a5f46eda3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:20.666549 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00af67-19d3-4d13-b646-267a5f46eda3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:20.668536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00af67-19d3-4d13-b646-267a5f46eda3 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:20.679019 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1382/2735] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:13:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:13:21.036184 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b806a-3734-48b3-821f-8116c4791fb9 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:21.037616 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-8d2b806a-3734-48b3-821f-8116c4791fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:21.051951 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b806a-3734-48b3-821f-8116c4791fb9 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:21.056771 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39229a9e-9a6a-43c4-9153-bff2a9ad6568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:21.057425 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39229a9e-9a6a-43c4-9153-bff2a9ad6568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:21.057710 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39229a9e-9a6a-43c4-9153-bff2a9ad6568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:21.057988 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39229a9e-9a6a-43c4-9153-bff2a9ad6568 admin admin] PATH_INFO: `/v3/projects/9c7887614c1f4d49af1c00951617681d` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:21.059881 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39229a9e-9a6a-43c4-9153-bff2a9ad6568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c7887614c1f4d49af1c00951617681d)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:21.061827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39229a9e-9a6a-43c4-9153-bff2a9ad6568 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:21.141966 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-39229a9e-9a6a-43c4-9153-bff2a9ad6568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c7887614c1f4d49af1c00951617681d', 'request_id': 'req-39229a9e-9a6a-43c4-9153-bff2a9ad6568'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:21.148242 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-39229a9e-9a6a-43c4-9153-bff2a9ad6568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c7887614c1f4d49af1c00951617681d', 'request_id': 'req-39229a9e-9a6a-43c4-9153-bff2a9ad6568'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:21.199927 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-39229a9e-9a6a-43c4-9153-bff2a9ad6568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c7887614c1f4d49af1c00951617681d', 'request_id': 'req-39229a9e-9a6a-43c4-9153-bff2a9ad6568'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:21.210745 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-39229a9e-9a6a-43c4-9153-bff2a9ad6568 admin admin] The token cache is being invalidate because project 9c7887614c1f4d49af1c00951617681d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:13:21.211080 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-39229a9e-9a6a-43c4-9153-bff2a9ad6568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:21.211707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-39229a9e-9a6a-43c4-9153-bff2a9ad6568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:21.213258 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1354/2736] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:13:21 2022] DELETE /identity/v3/projects/9c7887614c1f4d49af1c00951617681d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:13:21.218144 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00af67-19d3-4d13-b646-267a5f46eda3 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:21.227938 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00af67-19d3-4d13-b646-267a5f46eda3 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:21.283625 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a957e6-3171-430b-80ad-a60606fb87e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:21.284196 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a957e6-3171-430b-80ad-a60606fb87e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:21.284482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a957e6-3171-430b-80ad-a60606fb87e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:21.284762 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a957e6-3171-430b-80ad-a60606fb87e5 admin admin] PATH_INFO: `/v3/users/ef7b17a419e14b38b2e757de541c64c1` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:21.286186 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a957e6-3171-430b-80ad-a60606fb87e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef7b17a419e14b38b2e757de541c64c1)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:21.288124 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a957e6-3171-430b-80ad-a60606fb87e5 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:21.475484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-f0a957e6-3171-430b-80ad-a60606fb87e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef7b17a419e14b38b2e757de541c64c1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:21.482384 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-f0a957e6-3171-430b-80ad-a60606fb87e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef7b17a419e14b38b2e757de541c64c1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:21.483063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-f0a957e6-3171-430b-80ad-a60606fb87e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef7b17a419e14b38b2e757de541c64c1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:21.495070 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-f0a957e6-3171-430b-80ad-a60606fb87e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef7b17a419e14b38b2e757de541c64c1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:21.496218 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-f0a957e6-3171-430b-80ad-a60606fb87e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef7b17a419e14b38b2e757de541c64c1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:21.576685 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1383/2737] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:13:21 2022] DELETE /identity/v3/users/ef7b17a419e14b38b2e757de541c64c1 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:13:21.954727 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39229a9e-9a6a-43c4-9153-bff2a9ad6568 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:21.956187 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-39229a9e-9a6a-43c4-9153-bff2a9ad6568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:21.970781 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39229a9e-9a6a-43c4-9153-bff2a9ad6568 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:22.029313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d04155-2321-442d-b832-7d6154e3be63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:22.029960 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d04155-2321-442d-b832-7d6154e3be63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:22.030266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d04155-2321-442d-b832-7d6154e3be63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:22.030533 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d04155-2321-442d-b832-7d6154e3be63 admin admin] PATH_INFO: `/v3/projects/c2a701c1db5f4000b191f9d55f301855` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:22.031799 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d04155-2321-442d-b832-7d6154e3be63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2a701c1db5f4000b191f9d55f301855)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:22.033704 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d04155-2321-442d-b832-7d6154e3be63 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:22.153468 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e8d04155-2321-442d-b832-7d6154e3be63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2a701c1db5f4000b191f9d55f301855', 'request_id': 'req-e8d04155-2321-442d-b832-7d6154e3be63'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:22.159824 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e8d04155-2321-442d-b832-7d6154e3be63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2a701c1db5f4000b191f9d55f301855', 'request_id': 'req-e8d04155-2321-442d-b832-7d6154e3be63'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:22.216404 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e8d04155-2321-442d-b832-7d6154e3be63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2a701c1db5f4000b191f9d55f301855', 'request_id': 'req-e8d04155-2321-442d-b832-7d6154e3be63'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:22.222984 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:22.227689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e8d04155-2321-442d-b832-7d6154e3be63 admin admin] The token cache is being invalidate because project c2a701c1db5f4000b191f9d55f301855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:13:22.227979 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e8d04155-2321-442d-b832-7d6154e3be63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:22.228611 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-e8d04155-2321-442d-b832-7d6154e3be63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:22.230759 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1355/2738] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:13:21 2022] DELETE /identity/v3/projects/c2a701c1db5f4000b191f9d55f301855 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:13:22.237300 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d80a8b-f794-499a-be30-89a0c0663d56 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:22.237801 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d80a8b-f794-499a-be30-89a0c0663d56 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:22.238519 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d80a8b-f794-499a-be30-89a0c0663d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:22.257367 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-e7d80a8b-f794-499a-be30-89a0c0663d56 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:22.258611 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-e7d80a8b-f794-499a-be30-89a0c0663d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:22.287868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:22.317023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1384/2739] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:13:22.326005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf9a12-d54c-4012-9fdc-a80ad27d3b75 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:22.326296 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf9a12-d54c-4012-9fdc-a80ad27d3b75 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:22.326576 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf9a12-d54c-4012-9fdc-a80ad27d3b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:22.346232 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-a0cf9a12-d54c-4012-9fdc-a80ad27d3b75 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:22.347466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a0cf9a12-d54c-4012-9fdc-a80ad27d3b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:22.355980 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1356/2740] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:13:22.360318 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d80a8b-f794-499a-be30-89a0c0663d56 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:22.371581 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d80a8b-f794-499a-be30-89a0c0663d56 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:22.377136 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1be7f-29d6-49f9-b300-6b38b594ca47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:22.377753 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1be7f-29d6-49f9-b300-6b38b594ca47 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:22.378037 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1be7f-29d6-49f9-b300-6b38b594ca47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:22.378314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1be7f-29d6-49f9-b300-6b38b594ca47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:22.379049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1be7f-29d6-49f9-b300-6b38b594ca47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:13:22.379357 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1be7f-29d6-49f9-b300-6b38b594ca47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:22.380990 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1be7f-29d6-49f9-b300-6b38b594ca47 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:22.394177 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1385/2741] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:13:22.398468 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf9a12-d54c-4012-9fdc-a80ad27d3b75 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:22.407872 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf9a12-d54c-4012-9fdc-a80ad27d3b75 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:22.412849 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe2248-4f51-4087-9767-317fe439a241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:22.413459 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe2248-4f51-4087-9767-317fe439a241 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:22.413745 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe2248-4f51-4087-9767-317fe439a241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:22.414029 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe2248-4f51-4087-9767-317fe439a241 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:22.414850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe2248-4f51-4087-9767-317fe439a241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:22.416758 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe2248-4f51-4087-9767-317fe439a241 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:22.509299 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1357/2742] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:13:22 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:13:22.513419 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1be7f-29d6-49f9-b300-6b38b594ca47 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:22.523761 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1be7f-29d6-49f9-b300-6b38b594ca47 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:22.580305 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e776df2-5c60-446d-9347-0d00316fc41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:22.580919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e776df2-5c60-446d-9347-0d00316fc41c admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:22.581205 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e776df2-5c60-446d-9347-0d00316fc41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:22.581488 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e776df2-5c60-446d-9347-0d00316fc41c admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:22.582166 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e776df2-5c60-446d-9347-0d00316fc41c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:22.584126 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e776df2-5c60-446d-9347-0d00316fc41c admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:22.702600 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1386/2743] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:13:22 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:13:22.706591 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe2248-4f51-4087-9767-317fe439a241 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:22.717977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe2248-4f51-4087-9767-317fe439a241 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:22.722726 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181377b5-1b90-4979-88e7-45cdba00db05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:22.723408 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181377b5-1b90-4979-88e7-45cdba00db05 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:22.723715 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181377b5-1b90-4979-88e7-45cdba00db05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:22.723993 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181377b5-1b90-4979-88e7-45cdba00db05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:22.724698 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181377b5-1b90-4979-88e7-45cdba00db05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:22.726335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181377b5-1b90-4979-88e7-45cdba00db05 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:22.736442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1358/2744] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:13:22.740361 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e776df2-5c60-446d-9347-0d00316fc41c admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:22.750331 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e776df2-5c60-446d-9347-0d00316fc41c admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:22.754987 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956ce36-d427-4444-8a1c-2ad1b7684322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:22.755595 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956ce36-d427-4444-8a1c-2ad1b7684322 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:22.755884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956ce36-d427-4444-8a1c-2ad1b7684322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:22.756171 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956ce36-d427-4444-8a1c-2ad1b7684322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:22.756867 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956ce36-d427-4444-8a1c-2ad1b7684322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:22.758450 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956ce36-d427-4444-8a1c-2ad1b7684322 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:22.770472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1387/2745] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:13:22.774354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181377b5-1b90-4979-88e7-45cdba00db05 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:22.784872 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181377b5-1b90-4979-88e7-45cdba00db05 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:22.789691 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f99858-f524-40de-9c97-4d32daf7a17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:22.790343 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f99858-f524-40de-9c97-4d32daf7a17e admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:22.790627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f99858-f524-40de-9c97-4d32daf7a17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:22.790934 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f99858-f524-40de-9c97-4d32daf7a17e admin admin] PATH_INFO: `/v3/projects/680fb711d4964e55be6882753aa3a173/users/b16c843cfb4c45fb9ce2cb5630dd774f/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:22.805284 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f99858-f524-40de-9c97-4d32daf7a17e admin admin] RBAC: Authorizing `identity:create_grant(project_id=680fb711d4964e55be6882753aa3a173, user_id=b16c843cfb4c45fb9ce2cb5630dd774f, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:22.807957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f99858-f524-40de-9c97-4d32daf7a17e admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:22.879431 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1359/2746] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:13:22 2022] PUT /identity/v3/projects/680fb711d4964e55be6882753aa3a173/users/b16c843cfb4c45fb9ce2cb5630dd774f/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:13:22.890268 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0b117-b9a8-45ad-9650-46725b78d666 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:22.890560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0b117-b9a8-45ad-9650-46725b78d666 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:22.890876 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0b117-b9a8-45ad-9650-46725b78d666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:22.918147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-19e0b117-b9a8-45ad-9650-46725b78d666 None None] MFA Rules not processed for user `b16c843cfb4c45fb9ce2cb5630dd774f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:22.919396 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-19e0b117-b9a8-45ad-9650-46725b78d666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:22.983538 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1388/2747] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:13:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:13:22.994439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f99858-f524-40de-9c97-4d32daf7a17e admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:22.996774 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e2f99858-f524-40de-9c97-4d32daf7a17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:23.054817 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f99858-f524-40de-9c97-4d32daf7a17e admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:23.059383 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db53bc-11d0-4404-86b9-e294db903c40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:23.060006 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db53bc-11d0-4404-86b9-e294db903c40 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:23.060293 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db53bc-11d0-4404-86b9-e294db903c40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:23.060573 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db53bc-11d0-4404-86b9-e294db903c40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:23.068934 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db53bc-11d0-4404-86b9-e294db903c40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:23.070472 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db53bc-11d0-4404-86b9-e294db903c40 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:23.079913 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1360/2748] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:13:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:13:23.104540 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0b117-b9a8-45ad-9650-46725b78d666 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:23.135084 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:23.167967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0b117-b9a8-45ad-9650-46725b78d666 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:23.172685 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1e735-0779-44af-bb29-abd6e37a9403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:23.173759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1e735-0779-44af-bb29-abd6e37a9403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:23.173759 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1e735-0779-44af-bb29-abd6e37a9403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:23.174090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1e735-0779-44af-bb29-abd6e37a9403 admin admin] PATH_INFO: `/v3/users/b16c843cfb4c45fb9ce2cb5630dd774f` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:23.175073 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1e735-0779-44af-bb29-abd6e37a9403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16c843cfb4c45fb9ce2cb5630dd774f)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:23.176988 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1e735-0779-44af-bb29-abd6e37a9403 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:23.338339 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-caf1e735-0779-44af-bb29-abd6e37a9403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16c843cfb4c45fb9ce2cb5630dd774f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:23.345290 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-caf1e735-0779-44af-bb29-abd6e37a9403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16c843cfb4c45fb9ce2cb5630dd774f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:23.345979 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-caf1e735-0779-44af-bb29-abd6e37a9403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16c843cfb4c45fb9ce2cb5630dd774f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:23.358706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-caf1e735-0779-44af-bb29-abd6e37a9403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16c843cfb4c45fb9ce2cb5630dd774f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:23.359395 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-caf1e735-0779-44af-bb29-abd6e37a9403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16c843cfb4c45fb9ce2cb5630dd774f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:23.434413 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1389/2749] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:13:23 2022] DELETE /identity/v3/users/b16c843cfb4c45fb9ce2cb5630dd774f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:13:23.439047 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df0f74-dec9-47f9-b473-162882e6536f None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:23.439345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df0f74-dec9-47f9-b473-162882e6536f None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:23.439632 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df0f74-dec9-47f9-b473-162882e6536f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:23.458335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-d4df0f74-dec9-47f9-b473-162882e6536f None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:23.459583 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-d4df0f74-dec9-47f9-b473-162882e6536f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:23.516987 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1361/2750] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:13:23.526982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1e735-0779-44af-bb29-abd6e37a9403 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:23.528404 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-caf1e735-0779-44af-bb29-abd6e37a9403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:23.585268 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1e735-0779-44af-bb29-abd6e37a9403 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:23.589029 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9720d66-3dc2-4f43-a602-d3304ec7687c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:23.590084 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9720d66-3dc2-4f43-a602-d3304ec7687c service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:23.590372 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9720d66-3dc2-4f43-a602-d3304ec7687c service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:23.590649 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9720d66-3dc2-4f43-a602-d3304ec7687c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:23.599653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9720d66-3dc2-4f43-a602-d3304ec7687c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:23.601075 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9720d66-3dc2-4f43-a602-d3304ec7687c service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:23.611176 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1390/2751] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:13:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:13:23.994791 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df0f74-dec9-47f9-b473-162882e6536f None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:23.996238 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-d4df0f74-dec9-47f9-b473-162882e6536f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:24.014018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df0f74-dec9-47f9-b473-162882e6536f None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:24.019585 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45772e9-9504-4c62-980c-6a5cb192161a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:24.020656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45772e9-9504-4c62-980c-6a5cb192161a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:24.021039 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45772e9-9504-4c62-980c-6a5cb192161a admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:24.021219 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45772e9-9504-4c62-980c-6a5cb192161a admin admin] PATH_INFO: `/v3/projects/680fb711d4964e55be6882753aa3a173` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:24.022682 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45772e9-9504-4c62-980c-6a5cb192161a admin admin] RBAC: Authorizing `identity:delete_project(project_id=680fb711d4964e55be6882753aa3a173)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:24.024733 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45772e9-9504-4c62-980c-6a5cb192161a admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:24.113230 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:24.124975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c45772e9-9504-4c62-980c-6a5cb192161a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '680fb711d4964e55be6882753aa3a173', 'request_id': 'req-c45772e9-9504-4c62-980c-6a5cb192161a'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:24.131079 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c45772e9-9504-4c62-980c-6a5cb192161a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '680fb711d4964e55be6882753aa3a173', 'request_id': 'req-c45772e9-9504-4c62-980c-6a5cb192161a'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:24.204780 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c45772e9-9504-4c62-980c-6a5cb192161a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '680fb711d4964e55be6882753aa3a173', 'request_id': 'req-c45772e9-9504-4c62-980c-6a5cb192161a'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:24.216186 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c45772e9-9504-4c62-980c-6a5cb192161a admin admin] The token cache is being invalidate because project 680fb711d4964e55be6882753aa3a173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:13:24.216479 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c45772e9-9504-4c62-980c-6a5cb192161a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:24.217113 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c45772e9-9504-4c62-980c-6a5cb192161a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:24.218674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1362/2752] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:13:23 2022] DELETE /identity/v3/projects/680fb711d4964e55be6882753aa3a173 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:13:33.607519 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=66,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:34.284963 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:14:16.371060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9720d66-3dc2-4f43-a602-d3304ec7687c service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:14:16.372480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-f9720d66-3dc2-4f43-a602-d3304ec7687c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:16.383767 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9720d66-3dc2-4f43-a602-d3304ec7687c service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:14:16.432878 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2e8cd-34f1-4291-95e8-4a03b04461a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:14:16.433500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2e8cd-34f1-4291-95e8-4a03b04461a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:16.433788 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2e8cd-34f1-4291-95e8-4a03b04461a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:16.434067 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2e8cd-34f1-4291-95e8-4a03b04461a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:16.435947 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-5bf2e8cd-34f1-4291-95e8-4a03b04461a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:16.501295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2e8cd-34f1-4291-95e8-4a03b04461a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:14:16.502727 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2e8cd-34f1-4291-95e8-4a03b04461a9 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:14:16.512864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1391/2753] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:14:19.724573 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45772e9-9504-4c62-980c-6a5cb192161a admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:14:19.726089 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-c45772e9-9504-4c62-980c-6a5cb192161a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:19.796724 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45772e9-9504-4c62-980c-6a5cb192161a admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:14:19.801884 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea84ca-f55b-4411-be2d-d970645a0b86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de27d25fad634658a1abcb776d9a7b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:14:19.802544 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea84ca-f55b-4411-be2d-d970645a0b86 service placement] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:19.802860 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea84ca-f55b-4411-be2d-d970645a0b86 service placement] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:19.803137 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea84ca-f55b-4411-be2d-d970645a0b86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:19.804896 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-55ea84ca-f55b-4411-be2d-d970645a0b86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:19.821952 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea84ca-f55b-4411-be2d-d970645a0b86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:14:19.821952 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea84ca-f55b-4411-be2d-d970645a0b86 service placement] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:14:19.832617 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1363/2754] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:14:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:14:23.609976 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2e8cd-34f1-4291-95e8-4a03b04461a9 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:14:23.614874 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-5bf2e8cd-34f1-4291-95e8-4a03b04461a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:23.624627 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2e8cd-34f1-4291-95e8-4a03b04461a9 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:14:23.629526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71fea7e-98e3-4605-bcd8-284769ba888c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:14:23.630176 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fea7e-98e3-4605-bcd8-284769ba888c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:23.630464 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fea7e-98e3-4605-bcd8-284769ba888c admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:23.630761 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fea7e-98e3-4605-bcd8-284769ba888c admin admin] PATH_INFO: `/v3/users/b2ccafac03aa420db7f76165f20b0d3b` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:23.632608 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71fea7e-98e3-4605-bcd8-284769ba888c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2ccafac03aa420db7f76165f20b0d3b)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:14:23.634571 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71fea7e-98e3-4605-bcd8-284769ba888c admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:14:23.800926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d71fea7e-98e3-4605-bcd8-284769ba888c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2ccafac03aa420db7f76165f20b0d3b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:14:23.807559 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d71fea7e-98e3-4605-bcd8-284769ba888c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2ccafac03aa420db7f76165f20b0d3b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:14:23.808321 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d71fea7e-98e3-4605-bcd8-284769ba888c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2ccafac03aa420db7f76165f20b0d3b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:14:23.819860 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d71fea7e-98e3-4605-bcd8-284769ba888c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2ccafac03aa420db7f76165f20b0d3b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:14:23.820482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d71fea7e-98e3-4605-bcd8-284769ba888c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2ccafac03aa420db7f76165f20b0d3b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:14:23.888855 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1392/2755] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:14:23 2022] DELETE /identity/v3/users/b2ccafac03aa420db7f76165f20b0d3b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:14:24.137035 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea84ca-f55b-4411-be2d-d970645a0b86 service placement] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:14:24.152542 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea84ca-f55b-4411-be2d-d970645a0b86 service placement] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:14:24.209511 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f296c3-5a90-48f6-ba6d-62a64c1a0140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:14:24.210153 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f296c3-5a90-48f6-ba6d-62a64c1a0140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:24.210439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f296c3-5a90-48f6-ba6d-62a64c1a0140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:24.210717 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f296c3-5a90-48f6-ba6d-62a64c1a0140 admin admin] PATH_INFO: `/v3/projects/5c182a81a1c64866944f21c4e26725a3` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:24.211907 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f296c3-5a90-48f6-ba6d-62a64c1a0140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c182a81a1c64866944f21c4e26725a3)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:14:24.213814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f296c3-5a90-48f6-ba6d-62a64c1a0140 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:14:24.318230 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-28f296c3-5a90-48f6-ba6d-62a64c1a0140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c182a81a1c64866944f21c4e26725a3', 'request_id': 'req-28f296c3-5a90-48f6-ba6d-62a64c1a0140'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:14:24.325010 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-28f296c3-5a90-48f6-ba6d-62a64c1a0140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c182a81a1c64866944f21c4e26725a3', 'request_id': 'req-28f296c3-5a90-48f6-ba6d-62a64c1a0140'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:14:24.403727 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-28f296c3-5a90-48f6-ba6d-62a64c1a0140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c182a81a1c64866944f21c4e26725a3', 'request_id': 'req-28f296c3-5a90-48f6-ba6d-62a64c1a0140'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:14:24.414568 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-28f296c3-5a90-48f6-ba6d-62a64c1a0140 admin admin] The token cache is being invalidate because project 5c182a81a1c64866944f21c4e26725a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:14:24.414903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-28f296c3-5a90-48f6-ba6d-62a64c1a0140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:14:24.415547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-28f296c3-5a90-48f6-ba6d-62a64c1a0140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:14:24.417052 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1364/2756] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:14:24 2022] DELETE /identity/v3/projects/5c182a81a1c64866944f21c4e26725a3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:14:24.421030 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71fea7e-98e3-4605-bcd8-284769ba888c admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:14:24.422474 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-d71fea7e-98e3-4605-bcd8-284769ba888c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:24.436809 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71fea7e-98e3-4605-bcd8-284769ba888c admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:14:24.455659 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:14:24.492560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc8c3b-24ce-40b8-89f0-55905710e44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:14:24.493200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc8c3b-24ce-40b8-89f0-55905710e44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:24.493484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc8c3b-24ce-40b8-89f0-55905710e44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:24.493778 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc8c3b-24ce-40b8-89f0-55905710e44a admin admin] PATH_INFO: `/v3/users/1d73ebbe6f644792bbdb475138ceebd1` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:24.494967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc8c3b-24ce-40b8-89f0-55905710e44a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d73ebbe6f644792bbdb475138ceebd1)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:14:24.497385 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc8c3b-24ce-40b8-89f0-55905710e44a admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:14:24.646065 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-54cc8c3b-24ce-40b8-89f0-55905710e44a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d73ebbe6f644792bbdb475138ceebd1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:14:24.652958 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-54cc8c3b-24ce-40b8-89f0-55905710e44a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d73ebbe6f644792bbdb475138ceebd1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:14:24.653622 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-54cc8c3b-24ce-40b8-89f0-55905710e44a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d73ebbe6f644792bbdb475138ceebd1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:14:24.665822 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-54cc8c3b-24ce-40b8-89f0-55905710e44a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d73ebbe6f644792bbdb475138ceebd1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:14:24.666477 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-54cc8c3b-24ce-40b8-89f0-55905710e44a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d73ebbe6f644792bbdb475138ceebd1'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:14:24.722886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1393/2757] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:14:24 2022] DELETE /identity/v3/users/1d73ebbe6f644792bbdb475138ceebd1 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:14:24.959564 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f296c3-5a90-48f6-ba6d-62a64c1a0140 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:14:24.968688 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-28f296c3-5a90-48f6-ba6d-62a64c1a0140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:24.975139 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f296c3-5a90-48f6-ba6d-62a64c1a0140 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:14:24.994066 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:14:25.034165 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea330a-1cf4-4175-bd9a-64501c20b900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:14:25.034893 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea330a-1cf4-4175-bd9a-64501c20b900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:25.035184 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea330a-1cf4-4175-bd9a-64501c20b900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:25.035465 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea330a-1cf4-4175-bd9a-64501c20b900 admin admin] PATH_INFO: `/v3/projects/ef5a4f37fa144d23b0b9d4c235d79076` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:25.036904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea330a-1cf4-4175-bd9a-64501c20b900 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef5a4f37fa144d23b0b9d4c235d79076)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:14:25.038847 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea330a-1cf4-4175-bd9a-64501c20b900 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:14:25.130871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-6dea330a-1cf4-4175-bd9a-64501c20b900 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef5a4f37fa144d23b0b9d4c235d79076', 'request_id': 'req-6dea330a-1cf4-4175-bd9a-64501c20b900'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:14:25.137786 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-6dea330a-1cf4-4175-bd9a-64501c20b900 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef5a4f37fa144d23b0b9d4c235d79076', 'request_id': 'req-6dea330a-1cf4-4175-bd9a-64501c20b900'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:14:25.180807 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-6dea330a-1cf4-4175-bd9a-64501c20b900 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef5a4f37fa144d23b0b9d4c235d79076', 'request_id': 'req-6dea330a-1cf4-4175-bd9a-64501c20b900'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:14:25.191627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-6dea330a-1cf4-4175-bd9a-64501c20b900 admin admin] The token cache is being invalidate because project ef5a4f37fa144d23b0b9d4c235d79076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:14:25.191920 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-6dea330a-1cf4-4175-bd9a-64501c20b900 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:14:25.192554 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-6dea330a-1cf4-4175-bd9a-64501c20b900 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:14:25.194082 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1365/2758] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:14:24 2022] DELETE /identity/v3/projects/ef5a4f37fa144d23b0b9d4c235d79076 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:14:34.719225 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=43,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:14:35.188473 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:14:49.891104 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc8c3b-24ce-40b8-89f0-55905710e44a admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:14:49.892630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-54cc8c3b-24ce-40b8-89f0-55905710e44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:49.950010 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc8c3b-24ce-40b8-89f0-55905710e44a admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:14:49.998363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33582673-419e-4a11-8e77-12d42819006f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:14:49.999007 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33582673-419e-4a11-8e77-12d42819006f service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:49.999295 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33582673-419e-4a11-8e77-12d42819006f service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:49.999573 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33582673-419e-4a11-8e77-12d42819006f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:50.001472 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-33582673-419e-4a11-8e77-12d42819006f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:50.058705 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33582673-419e-4a11-8e77-12d42819006f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:14:50.060148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33582673-419e-4a11-8e77-12d42819006f service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:14:50.069217 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1394/2759] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:14:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:14:51.348747 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea330a-1cf4-4175-bd9a-64501c20b900 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:14:51.350227 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-6dea330a-1cf4-4175-bd9a-64501c20b900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:51.363466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea330a-1cf4-4175-bd9a-64501c20b900 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:14:51.367184 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162fcac-edf9-490c-8523-879fa81a8f9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:14:51.368201 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162fcac-edf9-490c-8523-879fa81a8f9d service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:51.368201 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162fcac-edf9-490c-8523-879fa81a8f9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:51.368416 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162fcac-edf9-490c-8523-879fa81a8f9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:51.370741 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-8162fcac-edf9-490c-8523-879fa81a8f9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:51.444008 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162fcac-edf9-490c-8523-879fa81a8f9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:14:51.445584 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162fcac-edf9-490c-8523-879fa81a8f9d service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:14:51.457004 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1366/2760] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:14:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:14:52.638835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33582673-419e-4a11-8e77-12d42819006f service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:14:52.647607 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33582673-419e-4a11-8e77-12d42819006f service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:14:52.651290 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79e6a7-0ba0-4cae-b1c7-82fb349b66b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:14:52.651897 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79e6a7-0ba0-4cae-b1c7-82fb349b66b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:52.652185 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79e6a7-0ba0-4cae-b1c7-82fb349b66b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:52.652466 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79e6a7-0ba0-4cae-b1c7-82fb349b66b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:52.654229 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-af79e6a7-0ba0-4cae-b1c7-82fb349b66b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:52.668402 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79e6a7-0ba0-4cae-b1c7-82fb349b66b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:14:52.669918 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79e6a7-0ba0-4cae-b1c7-82fb349b66b9 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:14:52.681038 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1395/2761] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:14:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:14:56.400785 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162fcac-edf9-490c-8523-879fa81a8f9d service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:14:56.407452 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-8162fcac-edf9-490c-8523-879fa81a8f9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:56.413544 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162fcac-edf9-490c-8523-879fa81a8f9d service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:14:56.417137 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2d5a6-1e14-491e-99ac-7323bbee76d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:14:56.417746 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2d5a6-1e14-491e-99ac-7323bbee76d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:56.418027 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2d5a6-1e14-491e-99ac-7323bbee76d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:56.418298 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2d5a6-1e14-491e-99ac-7323bbee76d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:56.420066 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e1c2d5a6-1e14-491e-99ac-7323bbee76d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:56.481674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2d5a6-1e14-491e-99ac-7323bbee76d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:14:56.483133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2d5a6-1e14-491e-99ac-7323bbee76d7 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:14:56.492410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1367/2762] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:14:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:14:59.996426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79e6a7-0ba0-4cae-b1c7-82fb349b66b9 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:14:59.997926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-af79e6a7-0ba0-4cae-b1c7-82fb349b66b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:00.054814 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:00.068476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79e6a7-0ba0-4cae-b1c7-82fb349b66b9 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:00.073579 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0042287-448f-4f81-bb71-a16d6a995d05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de27d25fad634658a1abcb776d9a7b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:00.074196 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0042287-448f-4f81-bb71-a16d6a995d05 service placement] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:00.074481 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0042287-448f-4f81-bb71-a16d6a995d05 service placement] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:00.074891 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0042287-448f-4f81-bb71-a16d6a995d05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:00.076710 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-a0042287-448f-4f81-bb71-a16d6a995d05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:00.088948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0042287-448f-4f81-bb71-a16d6a995d05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:00.090583 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0042287-448f-4f81-bb71-a16d6a995d05 service placement] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:00.101148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1396/2763] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:14:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:15:03.677089 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2d5a6-1e14-491e-99ac-7323bbee76d7 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:03.678652 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-e1c2d5a6-1e14-491e-99ac-7323bbee76d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:03.691991 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2d5a6-1e14-491e-99ac-7323bbee76d7 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:03.696964 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918554d-028d-4707-b378-ce11ceaff881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:03.698243 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918554d-028d-4707-b378-ce11ceaff881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:03.698570 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918554d-028d-4707-b378-ce11ceaff881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:03.698864 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918554d-028d-4707-b378-ce11ceaff881 admin admin] PATH_INFO: `/v3/users/5094778e88de495d96981c16da9ee916` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:03.700039 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918554d-028d-4707-b378-ce11ceaff881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5094778e88de495d96981c16da9ee916)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:03.701978 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918554d-028d-4707-b378-ce11ceaff881 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:03.838745 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2918554d-028d-4707-b378-ce11ceaff881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5094778e88de495d96981c16da9ee916'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:03.845536 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2918554d-028d-4707-b378-ce11ceaff881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5094778e88de495d96981c16da9ee916'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:03.917166 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2918554d-028d-4707-b378-ce11ceaff881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5094778e88de495d96981c16da9ee916'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:03.917794 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2918554d-028d-4707-b378-ce11ceaff881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5094778e88de495d96981c16da9ee916'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:03.926042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:03.930519 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-2918554d-028d-4707-b378-ce11ceaff881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5094778e88de495d96981c16da9ee916'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:03.938919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1368/2764] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:15:03 2022] DELETE /identity/v3/users/5094778e88de495d96981c16da9ee916 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:15:04.216117 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0042287-448f-4f81-bb71-a16d6a995d05 service placement] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:04.226899 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0042287-448f-4f81-bb71-a16d6a995d05 service placement] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:04.283465 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19043be7-4194-48e2-a37c-d8e5eae163b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:04.284108 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19043be7-4194-48e2-a37c-d8e5eae163b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:04.284394 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19043be7-4194-48e2-a37c-d8e5eae163b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:04.284674 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19043be7-4194-48e2-a37c-d8e5eae163b8 admin admin] PATH_INFO: `/v3/projects/8d0b838da49141f99cb5073f13024892` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:04.286092 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19043be7-4194-48e2-a37c-d8e5eae163b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d0b838da49141f99cb5073f13024892)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:04.288008 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19043be7-4194-48e2-a37c-d8e5eae163b8 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:04.386774 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-19043be7-4194-48e2-a37c-d8e5eae163b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d0b838da49141f99cb5073f13024892', 'request_id': 'req-19043be7-4194-48e2-a37c-d8e5eae163b8'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:04.393152 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-19043be7-4194-48e2-a37c-d8e5eae163b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d0b838da49141f99cb5073f13024892', 'request_id': 'req-19043be7-4194-48e2-a37c-d8e5eae163b8'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:04.460111 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-19043be7-4194-48e2-a37c-d8e5eae163b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d0b838da49141f99cb5073f13024892', 'request_id': 'req-19043be7-4194-48e2-a37c-d8e5eae163b8'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:04.471752 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-19043be7-4194-48e2-a37c-d8e5eae163b8 admin admin] The token cache is being invalidate because project 8d0b838da49141f99cb5073f13024892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:15:04.472041 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-19043be7-4194-48e2-a37c-d8e5eae163b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:04.472664 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-19043be7-4194-48e2-a37c-d8e5eae163b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:04.474302 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1397/2765] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:15:04 2022] DELETE /identity/v3/projects/8d0b838da49141f99cb5073f13024892 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:15:04.478378 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918554d-028d-4707-b378-ce11ceaff881 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:04.480472 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-2918554d-028d-4707-b378-ce11ceaff881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:04.493556 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918554d-028d-4707-b378-ce11ceaff881 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:04.550537 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eacef5-62eb-4b00-a882-a856b9df88af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:04.551210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eacef5-62eb-4b00-a882-a856b9df88af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:04.551492 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eacef5-62eb-4b00-a882-a856b9df88af admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:04.551767 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eacef5-62eb-4b00-a882-a856b9df88af admin admin] PATH_INFO: `/v3/users/d4228f04dfbf4b17b3b076c87782b58f` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:04.552936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eacef5-62eb-4b00-a882-a856b9df88af admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4228f04dfbf4b17b3b076c87782b58f)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:04.554866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eacef5-62eb-4b00-a882-a856b9df88af admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:04.712729 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-77eacef5-62eb-4b00-a882-a856b9df88af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4228f04dfbf4b17b3b076c87782b58f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:04.720158 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-77eacef5-62eb-4b00-a882-a856b9df88af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4228f04dfbf4b17b3b076c87782b58f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:04.773919 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-77eacef5-62eb-4b00-a882-a856b9df88af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4228f04dfbf4b17b3b076c87782b58f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:04.774523 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-77eacef5-62eb-4b00-a882-a856b9df88af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4228f04dfbf4b17b3b076c87782b58f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:04.787509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-77eacef5-62eb-4b00-a882-a856b9df88af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4228f04dfbf4b17b3b076c87782b58f'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:04.794058 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1369/2766] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:15:04 2022] DELETE /identity/v3/users/d4228f04dfbf4b17b3b076c87782b58f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:15:05.032610 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19043be7-4194-48e2-a37c-d8e5eae163b8 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:05.034109 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-19043be7-4194-48e2-a37c-d8e5eae163b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:05.050833 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19043be7-4194-48e2-a37c-d8e5eae163b8 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:05.109180 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06541f38-2c7e-46d3-8a36-2a0ade456545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:05.109825 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06541f38-2c7e-46d3-8a36-2a0ade456545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:05.110107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06541f38-2c7e-46d3-8a36-2a0ade456545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:05.110411 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06541f38-2c7e-46d3-8a36-2a0ade456545 admin admin] PATH_INFO: `/v3/projects/686c4b066ad44a6fa1ba2265870cdcab` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:05.111599 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06541f38-2c7e-46d3-8a36-2a0ade456545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=686c4b066ad44a6fa1ba2265870cdcab)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:05.113482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06541f38-2c7e-46d3-8a36-2a0ade456545 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:05.136217 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:05.204128 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-06541f38-2c7e-46d3-8a36-2a0ade456545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '686c4b066ad44a6fa1ba2265870cdcab', 'request_id': 'req-06541f38-2c7e-46d3-8a36-2a0ade456545'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:05.210324 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-06541f38-2c7e-46d3-8a36-2a0ade456545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '686c4b066ad44a6fa1ba2265870cdcab', 'request_id': 'req-06541f38-2c7e-46d3-8a36-2a0ade456545'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:05.265471 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-06541f38-2c7e-46d3-8a36-2a0ade456545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '686c4b066ad44a6fa1ba2265870cdcab', 'request_id': 'req-06541f38-2c7e-46d3-8a36-2a0ade456545'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:05.276121 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-06541f38-2c7e-46d3-8a36-2a0ade456545 admin admin] The token cache is being invalidate because project 686c4b066ad44a6fa1ba2265870cdcab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:15:05.276864 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-06541f38-2c7e-46d3-8a36-2a0ade456545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:05.277482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-06541f38-2c7e-46d3-8a36-2a0ade456545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:05.279025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1398/2767] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:15:05 2022] DELETE /identity/v3/projects/686c4b066ad44a6fa1ba2265870cdcab => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:15:14.789872 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=56,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:15.272972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:22.518062 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eacef5-62eb-4b00-a882-a856b9df88af admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:22.519619 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-77eacef5-62eb-4b00-a882-a856b9df88af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:22.576958 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eacef5-62eb-4b00-a882-a856b9df88af admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:22.625499 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20cf9f-27de-43c2-b3c4-6b4f8f689409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:22.626025 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20cf9f-27de-43c2-b3c4-6b4f8f689409 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:22.626310 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20cf9f-27de-43c2-b3c4-6b4f8f689409 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:22.626587 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20cf9f-27de-43c2-b3c4-6b4f8f689409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:22.628375 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-5b20cf9f-27de-43c2-b3c4-6b4f8f689409 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:22.637576 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20cf9f-27de-43c2-b3c4-6b4f8f689409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:22.639663 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20cf9f-27de-43c2-b3c4-6b4f8f689409 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:22.647545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1370/2768] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:15:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:15:32.643964 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=46 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:23.445657 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06541f38-2c7e-46d3-8a36-2a0ade456545 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:23.447315 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-06541f38-2c7e-46d3-8a36-2a0ade456545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:23.527911 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06541f38-2c7e-46d3-8a36-2a0ade456545 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:23.533752 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2f987-7630-42fa-a5e5-593f725952f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:23.534523 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2f987-7630-42fa-a5e5-593f725952f6 service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:23.534869 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2f987-7630-42fa-a5e5-593f725952f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:23.535161 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2f987-7630-42fa-a5e5-593f725952f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:23.537273 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-89c2f987-7630-42fa-a5e5-593f725952f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:23.551207 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2f987-7630-42fa-a5e5-593f725952f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:23.554334 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2f987-7630-42fa-a5e5-593f725952f6 service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:23.566652 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1399/2769] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:27.855483 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253a043-54c4-4177-a198-ab8b7de2db7f None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:27.855992 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253a043-54c4-4177-a198-ab8b7de2db7f None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:27.856102 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253a043-54c4-4177-a198-ab8b7de2db7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:27.875368 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-c253a043-54c4-4177-a198-ab8b7de2db7f None None] MFA Rules not processed for user `90109591e9cd43b9aab0fe5b1593e9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:27.876571 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-c253a043-54c4-4177-a198-ab8b7de2db7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:27.930327 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1371/2770] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:16:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:28.229611 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2f987-7630-42fa-a5e5-593f725952f6 service nova] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:28.231071 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-89c2f987-7630-42fa-a5e5-593f725952f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:28.242522 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2f987-7630-42fa-a5e5-593f725952f6 service nova] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:28.246167 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad991f-5f60-44ea-b23d-ab6821a17541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:28.246803 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad991f-5f60-44ea-b23d-ab6821a17541 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:28.247087 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad991f-5f60-44ea-b23d-ab6821a17541 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:28.247363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad991f-5f60-44ea-b23d-ab6821a17541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:28.249587 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-6bad991f-5f60-44ea-b23d-ab6821a17541 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:28.258882 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad991f-5f60-44ea-b23d-ab6821a17541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:28.260289 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad991f-5f60-44ea-b23d-ab6821a17541 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:28.269030 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1400/2771] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:28.657324 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253a043-54c4-4177-a198-ab8b7de2db7f None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:28.658764 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-c253a043-54c4-4177-a198-ab8b7de2db7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:28.727621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253a043-54c4-4177-a198-ab8b7de2db7f None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:28.732606 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e08e5-1808-4469-aa45-0ed88e293d24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de27d25fad634658a1abcb776d9a7b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:28.733740 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e08e5-1808-4469-aa45-0ed88e293d24 service placement] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:28.734018 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e08e5-1808-4469-aa45-0ed88e293d24 service placement] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:28.734288 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e08e5-1808-4469-aa45-0ed88e293d24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:28.736071 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-6c6e08e5-1808-4469-aa45-0ed88e293d24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:28.747250 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e08e5-1808-4469-aa45-0ed88e293d24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:28.749431 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e08e5-1808-4469-aa45-0ed88e293d24 service placement] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:28.759201 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1372/2772] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:35.437503 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad991f-5f60-44ea-b23d-ab6821a17541 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:35.439085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-6bad991f-5f60-44ea-b23d-ab6821a17541 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:35.455349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad991f-5f60-44ea-b23d-ab6821a17541 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:35.460844 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a378d4-1251-4b58-bb3c-0a2ce262d70d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:35.461449 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a378d4-1251-4b58-bb3c-0a2ce262d70d service nova] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:35.461734 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a378d4-1251-4b58-bb3c-0a2ce262d70d service nova] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:35.462014 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a378d4-1251-4b58-bb3c-0a2ce262d70d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:35.463750 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-57a378d4-1251-4b58-bb3c-0a2ce262d70d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:35.474300 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a378d4-1251-4b58-bb3c-0a2ce262d70d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:35.475888 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a378d4-1251-4b58-bb3c-0a2ce262d70d service nova] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:35.485149 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1401/2773] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:16:38.754983 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=57 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:39.309679 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e08e5-1808-4469-aa45-0ed88e293d24 service placement] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:39.322302 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e08e5-1808-4469-aa45-0ed88e293d24 service placement] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:39.327860 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5626b-e184-4af3-b9a6-5873145e0b29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:39.328472 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5626b-e184-4af3-b9a6-5873145e0b29 service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:39.328756 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5626b-e184-4af3-b9a6-5873145e0b29 service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:39.329033 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5626b-e184-4af3-b9a6-5873145e0b29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:39.330809 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-baa5626b-e184-4af3-b9a6-5873145e0b29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:39.343227 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5626b-e184-4af3-b9a6-5873145e0b29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:39.344810 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5626b-e184-4af3-b9a6-5873145e0b29 service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:39.355534 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1373/2774] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:45.480665 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=46 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:49.351049 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=6 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:43.475354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a378d4-1251-4b58-bb3c-0a2ce262d70d service nova] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:43.476787 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-57a378d4-1251-4b58-bb3c-0a2ce262d70d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:43.549389 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a378d4-1251-4b58-bb3c-0a2ce262d70d service nova] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:43.554428 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c9abf-08da-48b7-9788-98831e5f4cd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de27d25fad634658a1abcb776d9a7b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:43.555075 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c9abf-08da-48b7-9788-98831e5f4cd6 service placement] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:43.555356 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c9abf-08da-48b7-9788-98831e5f4cd6 service placement] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:43.555629 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c9abf-08da-48b7-9788-98831e5f4cd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:43.557418 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-101c9abf-08da-48b7-9788-98831e5f4cd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:43.569191 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c9abf-08da-48b7-9788-98831e5f4cd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:43.574475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c9abf-08da-48b7-9788-98831e5f4cd6 service placement] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:43.581292 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1402/2775] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:53.576569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=31 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:21.260645 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5626b-e184-4af3-b9a6-5873145e0b29 service nova] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:21.296673 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5626b-e184-4af3-b9a6-5873145e0b29 service nova] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:21.300761 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3be52-010e-4938-aba0-4f2cdaa771a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:21.301360 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3be52-010e-4938-aba0-4f2cdaa771a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:21.301641 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3be52-010e-4938-aba0-4f2cdaa771a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:21.301916 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3be52-010e-4938-aba0-4f2cdaa771a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:21.303656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-30b3be52-010e-4938-aba0-4f2cdaa771a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:21.393799 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3be52-010e-4938-aba0-4f2cdaa771a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:21.395272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3be52-010e-4938-aba0-4f2cdaa771a0 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:21.414208 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1374/2776] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:24.935381 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c9abf-08da-48b7-9788-98831e5f4cd6 service placement] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:24.936893 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-101c9abf-08da-48b7-9788-98831e5f4cd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:24.964437 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c9abf-08da-48b7-9788-98831e5f4cd6 service placement] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:24.969306 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b5ed9-3f49-4c9b-aa75-372527d0c9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:24.970002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b5ed9-3f49-4c9b-aa75-372527d0c9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:24.970303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b5ed9-3f49-4c9b-aa75-372527d0c9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:24.970583 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b5ed9-3f49-4c9b-aa75-372527d0c9fd admin admin] PATH_INFO: `/v3/users/90109591e9cd43b9aab0fe5b1593e9dd` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:24.971774 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b5ed9-3f49-4c9b-aa75-372527d0c9fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=90109591e9cd43b9aab0fe5b1593e9dd)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:24.973760 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b5ed9-3f49-4c9b-aa75-372527d0c9fd admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:25.155136 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-cd2b5ed9-3f49-4c9b-aa75-372527d0c9fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90109591e9cd43b9aab0fe5b1593e9dd'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:25.163034 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-cd2b5ed9-3f49-4c9b-aa75-372527d0c9fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90109591e9cd43b9aab0fe5b1593e9dd'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:25.163719 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-cd2b5ed9-3f49-4c9b-aa75-372527d0c9fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90109591e9cd43b9aab0fe5b1593e9dd'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:25.176476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-cd2b5ed9-3f49-4c9b-aa75-372527d0c9fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90109591e9cd43b9aab0fe5b1593e9dd'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:25.177154 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-cd2b5ed9-3f49-4c9b-aa75-372527d0c9fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90109591e9cd43b9aab0fe5b1593e9dd'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:25.255609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1403/2777] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:18:24 2022] DELETE /identity/v3/users/90109591e9cd43b9aab0fe5b1593e9dd => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:25.485558 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3be52-010e-4938-aba0-4f2cdaa771a0 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:25.496140 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3be52-010e-4938-aba0-4f2cdaa771a0 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:25.558327 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0367c-dfcc-410e-9d5f-077a13a9fb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:25.558999 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0367c-dfcc-410e-9d5f-077a13a9fb94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:25.559286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0367c-dfcc-410e-9d5f-077a13a9fb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:25.559565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0367c-dfcc-410e-9d5f-077a13a9fb94 admin admin] PATH_INFO: `/v3/projects/965502bfffde4ee19c6bd7ea81f08672` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:25.560773 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0367c-dfcc-410e-9d5f-077a13a9fb94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=965502bfffde4ee19c6bd7ea81f08672)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:25.562718 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0367c-dfcc-410e-9d5f-077a13a9fb94 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:25.667441 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:25.679301 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-19f0367c-dfcc-410e-9d5f-077a13a9fb94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '965502bfffde4ee19c6bd7ea81f08672', 'request_id': 'req-19f0367c-dfcc-410e-9d5f-077a13a9fb94'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:25.685510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-19f0367c-dfcc-410e-9d5f-077a13a9fb94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '965502bfffde4ee19c6bd7ea81f08672', 'request_id': 'req-19f0367c-dfcc-410e-9d5f-077a13a9fb94'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:25.724056 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-19f0367c-dfcc-410e-9d5f-077a13a9fb94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '965502bfffde4ee19c6bd7ea81f08672', 'request_id': 'req-19f0367c-dfcc-410e-9d5f-077a13a9fb94'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:25.736860 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-19f0367c-dfcc-410e-9d5f-077a13a9fb94 admin admin] The token cache is being invalidate because project 965502bfffde4ee19c6bd7ea81f08672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:18:25.736860 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-19f0367c-dfcc-410e-9d5f-077a13a9fb94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:25.736860 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-19f0367c-dfcc-410e-9d5f-077a13a9fb94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:25.738927 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1375/2778] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:18:25 2022] DELETE /identity/v3/projects/965502bfffde4ee19c6bd7ea81f08672 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:25.742891 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860c5c3-0e76-4f23-9ddb-8cf3581b35a5 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:25.743186 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860c5c3-0e76-4f23-9ddb-8cf3581b35a5 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:25.743473 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860c5c3-0e76-4f23-9ddb-8cf3581b35a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:25.802500 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-c860c5c3-0e76-4f23-9ddb-8cf3581b35a5 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:25.803765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-c860c5c3-0e76-4f23-9ddb-8cf3581b35a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:25.861802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1404/2779] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:25.870677 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b17c8-5727-4b80-997b-b25430c61637 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:25.871052 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b17c8-5727-4b80-997b-b25430c61637 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:25.871338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b17c8-5727-4b80-997b-b25430c61637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:25.893641 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-c03b17c8-5727-4b80-997b-b25430c61637 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:25.894899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-c03b17c8-5727-4b80-997b-b25430c61637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:25.902721 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1376/2780] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:25.906996 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860c5c3-0e76-4f23-9ddb-8cf3581b35a5 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:25.916945 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860c5c3-0e76-4f23-9ddb-8cf3581b35a5 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:25.921557 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486003b9-06ae-46f3-b380-b627f70e0b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:25.922163 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486003b9-06ae-46f3-b380-b627f70e0b57 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:25.922452 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486003b9-06ae-46f3-b380-b627f70e0b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:25.922750 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486003b9-06ae-46f3-b380-b627f70e0b57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:25.923455 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486003b9-06ae-46f3-b380-b627f70e0b57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:18:25.923763 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486003b9-06ae-46f3-b380-b627f70e0b57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:25.925348 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486003b9-06ae-46f3-b380-b627f70e0b57 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:25.936654 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1405/2781] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:18:25.941129 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b17c8-5727-4b80-997b-b25430c61637 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:25.950280 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b17c8-5727-4b80-997b-b25430c61637 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:25.955621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b548362-404f-4277-9f98-f52bedc39390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:25.956221 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b548362-404f-4277-9f98-f52bedc39390 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:25.956502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b548362-404f-4277-9f98-f52bedc39390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:25.956801 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b548362-404f-4277-9f98-f52bedc39390 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:25.957461 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b548362-404f-4277-9f98-f52bedc39390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:25.959379 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b548362-404f-4277-9f98-f52bedc39390 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:26.057037 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1377/2782] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:18:25 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:26.061410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486003b9-06ae-46f3-b380-b627f70e0b57 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:26.072327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486003b9-06ae-46f3-b380-b627f70e0b57 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:26.084497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:26.127704 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cde460-c738-4d47-aa9a-a2db8de9e9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:26.128312 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cde460-c738-4d47-aa9a-a2db8de9e9bc admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:26.128623 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cde460-c738-4d47-aa9a-a2db8de9e9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:26.128896 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cde460-c738-4d47-aa9a-a2db8de9e9bc admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:26.129569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cde460-c738-4d47-aa9a-a2db8de9e9bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:26.131497 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cde460-c738-4d47-aa9a-a2db8de9e9bc admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:26.250362 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1406/2783] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:18:26 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:26.255623 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b548362-404f-4277-9f98-f52bedc39390 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:26.266245 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b548362-404f-4277-9f98-f52bedc39390 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:26.270856 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4158d-af2f-4e24-a44b-6b484352a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:26.271457 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4158d-af2f-4e24-a44b-6b484352a8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:26.271738 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4158d-af2f-4e24-a44b-6b484352a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:26.272014 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4158d-af2f-4e24-a44b-6b484352a8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:26.272709 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4158d-af2f-4e24-a44b-6b484352a8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:26.274301 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4158d-af2f-4e24-a44b-6b484352a8a7 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:26.284573 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1378/2784] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:26.290852 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cde460-c738-4d47-aa9a-a2db8de9e9bc admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:26.301227 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cde460-c738-4d47-aa9a-a2db8de9e9bc admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:26.306172 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16285cdc-e52d-47d5-82a9-c8759d2491b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:26.307031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16285cdc-e52d-47d5-82a9-c8759d2491b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:26.307726 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16285cdc-e52d-47d5-82a9-c8759d2491b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:26.308007 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16285cdc-e52d-47d5-82a9-c8759d2491b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:26.308710 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16285cdc-e52d-47d5-82a9-c8759d2491b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:26.310319 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16285cdc-e52d-47d5-82a9-c8759d2491b2 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:26.321594 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1407/2785] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:26.325695 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4158d-af2f-4e24-a44b-6b484352a8a7 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:26.335591 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4158d-af2f-4e24-a44b-6b484352a8a7 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:26.340200 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9a6b8-14a8-4559-b710-d091f474dc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:26.340848 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9a6b8-14a8-4559-b710-d091f474dc75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:26.341131 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9a6b8-14a8-4559-b710-d091f474dc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:26.341408 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9a6b8-14a8-4559-b710-d091f474dc75 admin admin] PATH_INFO: `/v3/projects/f6cc3c3890134449a4a63bd46f2430a5/users/3e3980ddaf444b4199f455ab270c3afd/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:26.355743 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9a6b8-14a8-4559-b710-d091f474dc75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6cc3c3890134449a4a63bd46f2430a5, user_id=3e3980ddaf444b4199f455ab270c3afd, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:26.358371 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9a6b8-14a8-4559-b710-d091f474dc75 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:26.427099 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1379/2786] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:18:26 2022] PUT /identity/v3/projects/f6cc3c3890134449a4a63bd46f2430a5/users/3e3980ddaf444b4199f455ab270c3afd/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:26.439392 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488d307-36b8-43c1-a76e-baba80338e2b None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:26.439680 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488d307-36b8-43c1-a76e-baba80338e2b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:26.439960 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488d307-36b8-43c1-a76e-baba80338e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:26.467563 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-a488d307-36b8-43c1-a76e-baba80338e2b None None] MFA Rules not processed for user `3e3980ddaf444b4199f455ab270c3afd`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:26.468787 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-a488d307-36b8-43c1-a76e-baba80338e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:26.531438 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1408/2787] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:26.542609 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9a6b8-14a8-4559-b710-d091f474dc75 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:26.544396 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-2cc9a6b8-14a8-4559-b710-d091f474dc75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:26.619265 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9a6b8-14a8-4559-b710-d091f474dc75 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:26.625175 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d209f5-bf65-4198-9cbc-4654d104a134 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc939818c9224b0ebe2dbaa1eaaec5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:26.625944 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d209f5-bf65-4198-9cbc-4654d104a134 service nova] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:26.626233 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d209f5-bf65-4198-9cbc-4654d104a134 service nova] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:26.626516 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d209f5-bf65-4198-9cbc-4654d104a134 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:26.634466 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d209f5-bf65-4198-9cbc-4654d104a134 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:26.636133 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d209f5-bf65-4198-9cbc-4654d104a134 service nova] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:26.645196 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1380/2788] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:35.661088 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488d307-36b8-43c1-a76e-baba80338e2b None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:35.721569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488d307-36b8-43c1-a76e-baba80338e2b None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:35.726130 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ac0fd-c3e3-4177-85ac-31316e44cdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:35.726797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ac0fd-c3e3-4177-85ac-31316e44cdae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:35.727094 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ac0fd-c3e3-4177-85ac-31316e44cdae admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:35.727376 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ac0fd-c3e3-4177-85ac-31316e44cdae admin admin] PATH_INFO: `/v3/users/3e3980ddaf444b4199f455ab270c3afd` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:35.728537 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ac0fd-c3e3-4177-85ac-31316e44cdae admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e3980ddaf444b4199f455ab270c3afd)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:35.730479 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ac0fd-c3e3-4177-85ac-31316e44cdae admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:35.828016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:35.977212 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c59ac0fd-c3e3-4177-85ac-31316e44cdae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e3980ddaf444b4199f455ab270c3afd'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:35.983967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c59ac0fd-c3e3-4177-85ac-31316e44cdae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e3980ddaf444b4199f455ab270c3afd'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:35.984639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c59ac0fd-c3e3-4177-85ac-31316e44cdae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e3980ddaf444b4199f455ab270c3afd'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:35.996303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c59ac0fd-c3e3-4177-85ac-31316e44cdae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e3980ddaf444b4199f455ab270c3afd'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:35.996966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c59ac0fd-c3e3-4177-85ac-31316e44cdae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e3980ddaf444b4199f455ab270c3afd'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:36.059536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1409/2789] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:18:35 2022] DELETE /identity/v3/users/3e3980ddaf444b4199f455ab270c3afd => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:36.064339 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1ce84-b0ee-4b81-a852-2f13d2599f2d None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:36.064836 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1ce84-b0ee-4b81-a852-2f13d2599f2d None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:36.064947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1ce84-b0ee-4b81-a852-2f13d2599f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:36.084442 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-59c1ce84-b0ee-4b81-a852-2f13d2599f2d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:36.085752 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-59c1ce84-b0ee-4b81-a852-2f13d2599f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:36.128135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:36.149157 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1381/2790] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:36.159609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ac0fd-c3e3-4177-85ac-31316e44cdae admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:36.161346 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-c59ac0fd-c3e3-4177-85ac-31316e44cdae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:36.230685 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ac0fd-c3e3-4177-85ac-31316e44cdae admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:36.234315 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b022f-e567-45b9-a9e0-2a6d73f39e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:36.234988 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b022f-e567-45b9-a9e0-2a6d73f39e91 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:36.235277 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b022f-e567-45b9-a9e0-2a6d73f39e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:36.235555 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b022f-e567-45b9-a9e0-2a6d73f39e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:36.244592 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b022f-e567-45b9-a9e0-2a6d73f39e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:36.246019 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b022f-e567-45b9-a9e0-2a6d73f39e91 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:36.255443 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1410/2791] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:36.647107 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1ce84-b0ee-4b81-a852-2f13d2599f2d None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:36.648696 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-59c1ce84-b0ee-4b81-a852-2f13d2599f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:36.662939 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1ce84-b0ee-4b81-a852-2f13d2599f2d None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:36.668235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a8dd3-540e-4c00-86cb-4b08e8467375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:36.674183 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a8dd3-540e-4c00-86cb-4b08e8467375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:36.674183 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a8dd3-540e-4c00-86cb-4b08e8467375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:36.674183 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a8dd3-540e-4c00-86cb-4b08e8467375 admin admin] PATH_INFO: `/v3/projects/f6cc3c3890134449a4a63bd46f2430a5` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:36.674183 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a8dd3-540e-4c00-86cb-4b08e8467375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6cc3c3890134449a4a63bd46f2430a5)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:36.674183 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a8dd3-540e-4c00-86cb-4b08e8467375 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:36.769830 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c93a8dd3-540e-4c00-86cb-4b08e8467375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6cc3c3890134449a4a63bd46f2430a5', 'request_id': 'req-c93a8dd3-540e-4c00-86cb-4b08e8467375'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:36.776116 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c93a8dd3-540e-4c00-86cb-4b08e8467375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6cc3c3890134449a4a63bd46f2430a5', 'request_id': 'req-c93a8dd3-540e-4c00-86cb-4b08e8467375'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:36.861598 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c93a8dd3-540e-4c00-86cb-4b08e8467375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6cc3c3890134449a4a63bd46f2430a5', 'request_id': 'req-c93a8dd3-540e-4c00-86cb-4b08e8467375'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:36.873461 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c93a8dd3-540e-4c00-86cb-4b08e8467375 admin admin] The token cache is being invalidate because project f6cc3c3890134449a4a63bd46f2430a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:18:36.873690 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c93a8dd3-540e-4c00-86cb-4b08e8467375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:36.874317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-c93a8dd3-540e-4c00-86cb-4b08e8467375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:36.876585 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1382/2792] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:18:36 2022] DELETE /identity/v3/projects/f6cc3c3890134449a4a63bd46f2430a5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:36.883182 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb84e1-5bcc-4a1a-819c-a40d494994aa None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:36.883182 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb84e1-5bcc-4a1a-819c-a40d494994aa None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:36.883182 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb84e1-5bcc-4a1a-819c-a40d494994aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:36.901902 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-1feb84e1-5bcc-4a1a-819c-a40d494994aa None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:36.906176 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-1feb84e1-5bcc-4a1a-819c-a40d494994aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:36.964577 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1411/2793] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:36.972727 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a03ae-e7c3-4900-b411-e52a072fa20d None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:36.973016 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a03ae-e7c3-4900-b411-e52a072fa20d None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:36.973293 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a03ae-e7c3-4900-b411-e52a072fa20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:36.994249 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-f69a03ae-e7c3-4900-b411-e52a072fa20d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:36.995514 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-f69a03ae-e7c3-4900-b411-e52a072fa20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:37.004113 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1383/2794] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:37.008405 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb84e1-5bcc-4a1a-819c-a40d494994aa None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:37.018288 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb84e1-5bcc-4a1a-819c-a40d494994aa None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:37.023094 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af4dd0-aa96-4b1f-be44-bac38a5b4539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:37.023737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af4dd0-aa96-4b1f-be44-bac38a5b4539 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:37.024018 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af4dd0-aa96-4b1f-be44-bac38a5b4539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:37.024293 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af4dd0-aa96-4b1f-be44-bac38a5b4539 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:37.024988 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af4dd0-aa96-4b1f-be44-bac38a5b4539 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:18:37.025377 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af4dd0-aa96-4b1f-be44-bac38a5b4539 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:37.027001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af4dd0-aa96-4b1f-be44-bac38a5b4539 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:37.038833 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1412/2795] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:18:37.043005 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a03ae-e7c3-4900-b411-e52a072fa20d None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:37.052975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a03ae-e7c3-4900-b411-e52a072fa20d None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:37.057635 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe96aaf-fcf1-459f-adc2-7d751976a14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:37.058235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe96aaf-fcf1-459f-adc2-7d751976a14a admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:37.058522 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe96aaf-fcf1-459f-adc2-7d751976a14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:37.058834 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe96aaf-fcf1-459f-adc2-7d751976a14a admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:37.059507 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe96aaf-fcf1-459f-adc2-7d751976a14a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:37.061429 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe96aaf-fcf1-459f-adc2-7d751976a14a admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:37.145440 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1384/2796] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:18:37 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:37.146478 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af4dd0-aa96-4b1f-be44-bac38a5b4539 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:37.157208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af4dd0-aa96-4b1f-be44-bac38a5b4539 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:37.177854 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:37.215288 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b56ad-491d-4159-a49d-f6cc3f7b354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:37.215915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b56ad-491d-4159-a49d-f6cc3f7b354a admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:37.216200 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b56ad-491d-4159-a49d-f6cc3f7b354a admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:37.216482 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b56ad-491d-4159-a49d-f6cc3f7b354a admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:37.217144 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b56ad-491d-4159-a49d-f6cc3f7b354a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:37.219620 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b56ad-491d-4159-a49d-f6cc3f7b354a admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:37.341194 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1413/2797] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:18:37 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:18:37.345827 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe96aaf-fcf1-459f-adc2-7d751976a14a admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:37.356272 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe96aaf-fcf1-459f-adc2-7d751976a14a admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:37.361480 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea0423-30b5-4e29-8394-9e48a742bc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:37.362097 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea0423-30b5-4e29-8394-9e48a742bc57 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:37.362410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea0423-30b5-4e29-8394-9e48a742bc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:37.362711 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea0423-30b5-4e29-8394-9e48a742bc57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:37.363437 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea0423-30b5-4e29-8394-9e48a742bc57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:37.365042 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea0423-30b5-4e29-8394-9e48a742bc57 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:37.374910 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1385/2798] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:37.378769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b56ad-491d-4159-a49d-f6cc3f7b354a admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:37.388804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b56ad-491d-4159-a49d-f6cc3f7b354a admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:37.393571 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b228b-16fa-4039-8902-1bd6e1c70e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:37.394181 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b228b-16fa-4039-8902-1bd6e1c70e91 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:37.394468 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b228b-16fa-4039-8902-1bd6e1c70e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:37.394769 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b228b-16fa-4039-8902-1bd6e1c70e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:37.395550 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b228b-16fa-4039-8902-1bd6e1c70e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:37.397079 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b228b-16fa-4039-8902-1bd6e1c70e91 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:37.407589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1414/2799] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:37.417950 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea0423-30b5-4e29-8394-9e48a742bc57 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:37.428647 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea0423-30b5-4e29-8394-9e48a742bc57 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:37.433215 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdb9db-c618-4cc9-8561-cf7e0bc4d91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:37.433865 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdb9db-c618-4cc9-8561-cf7e0bc4d91c admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:37.434146 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdb9db-c618-4cc9-8561-cf7e0bc4d91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:37.434423 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdb9db-c618-4cc9-8561-cf7e0bc4d91c admin admin] PATH_INFO: `/v3/projects/dbc40d1ed6244b9da60bd7fa589a0d58/users/9e0a73364ed14c2e9c66389cd01807c5/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:37.448554 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cdb9db-c618-4cc9-8561-cf7e0bc4d91c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbc40d1ed6244b9da60bd7fa589a0d58, user_id=9e0a73364ed14c2e9c66389cd01807c5, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:37.451199 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cdb9db-c618-4cc9-8561-cf7e0bc4d91c admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:37.505904 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1386/2800] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:18:37 2022] PUT /identity/v3/projects/dbc40d1ed6244b9da60bd7fa589a0d58/users/9e0a73364ed14c2e9c66389cd01807c5/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:37.517804 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5caf90-5714-4f08-99f4-ad63233db524 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:37.518149 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5caf90-5714-4f08-99f4-ad63233db524 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:37.522476 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5caf90-5714-4f08-99f4-ad63233db524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:37.546664 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-2c5caf90-5714-4f08-99f4-ad63233db524 None None] MFA Rules not processed for user `9e0a73364ed14c2e9c66389cd01807c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:37.547916 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-2c5caf90-5714-4f08-99f4-ad63233db524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:37.612408 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1415/2801] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:37.618955 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdb9db-c618-4cc9-8561-cf7e0bc4d91c admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:37.680079 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdb9db-c618-4cc9-8561-cf7e0bc4d91c admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:37.684712 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089c56c-394c-4b61-9115-b6c1f43e76ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:37.685338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089c56c-394c-4b61-9115-b6c1f43e76ba admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:37.685618 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089c56c-394c-4b61-9115-b6c1f43e76ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:37.685892 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089c56c-394c-4b61-9115-b6c1f43e76ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:37.686557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089c56c-394c-4b61-9115-b6c1f43e76ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:37.688560 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089c56c-394c-4b61-9115-b6c1f43e76ba admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:37.693889 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:37.765319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1387/2802] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:18:37 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:37.770049 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5caf90-5714-4f08-99f4-ad63233db524 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:37.780841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5caf90-5714-4f08-99f4-ad63233db524 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:37.837261 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c9613-d108-4a8d-b93e-5b303dcd3707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:37.837873 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c9613-d108-4a8d-b93e-5b303dcd3707 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:37.838155 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c9613-d108-4a8d-b93e-5b303dcd3707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:37.838427 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c9613-d108-4a8d-b93e-5b303dcd3707 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:37.839110 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c9613-d108-4a8d-b93e-5b303dcd3707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:37.841010 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c9613-d108-4a8d-b93e-5b303dcd3707 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:37.942001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1416/2803] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:18:37 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:37.945947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089c56c-394c-4b61-9115-b6c1f43e76ba admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:37.959696 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089c56c-394c-4b61-9115-b6c1f43e76ba admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:37.964319 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a980c-a3cd-4b0f-b244-f459b509c9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:37.964947 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a980c-a3cd-4b0f-b244-f459b509c9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:37.965212 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a980c-a3cd-4b0f-b244-f459b509c9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:37.965485 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a980c-a3cd-4b0f-b244-f459b509c9c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:37.966194 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a980c-a3cd-4b0f-b244-f459b509c9c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:37.967814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a980c-a3cd-4b0f-b244-f459b509c9c5 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:37.977723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1388/2804] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:37.981932 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c9613-d108-4a8d-b93e-5b303dcd3707 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:37.992138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c9613-d108-4a8d-b93e-5b303dcd3707 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:37.996828 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3ec6f-ed05-4dc2-a64c-6390f8e42577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:37.997486 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3ec6f-ed05-4dc2-a64c-6390f8e42577 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:37.997776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3ec6f-ed05-4dc2-a64c-6390f8e42577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:37.998060 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3ec6f-ed05-4dc2-a64c-6390f8e42577 admin admin] PATH_INFO: `/v3/projects/b3d01ef5ff16441dbf63a6aa384170a5/users/7a13e136a3494466ba3dbfbc9e86d55c/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:38.013019 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3ec6f-ed05-4dc2-a64c-6390f8e42577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d01ef5ff16441dbf63a6aa384170a5, user_id=7a13e136a3494466ba3dbfbc9e86d55c, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:38.015703 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3ec6f-ed05-4dc2-a64c-6390f8e42577 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:38.019676 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:38.095269 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1417/2805] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:18:37 2022] PUT /identity/v3/projects/b3d01ef5ff16441dbf63a6aa384170a5/users/7a13e136a3494466ba3dbfbc9e86d55c/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:18:38.099313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a980c-a3cd-4b0f-b244-f459b509c9c5 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:38.109454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a980c-a3cd-4b0f-b244-f459b509c9c5 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:38.168717 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590c5a4-3675-4dad-ba2a-a03b64a23993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:38.169337 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590c5a4-3675-4dad-ba2a-a03b64a23993 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:38.169618 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590c5a4-3675-4dad-ba2a-a03b64a23993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:38.169890 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590c5a4-3675-4dad-ba2a-a03b64a23993 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:38.170574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590c5a4-3675-4dad-ba2a-a03b64a23993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:38.172313 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590c5a4-3675-4dad-ba2a-a03b64a23993 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:38.182594 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1389/2806] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:38.186696 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3ec6f-ed05-4dc2-a64c-6390f8e42577 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:38.197247 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3ec6f-ed05-4dc2-a64c-6390f8e42577 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:38.202038 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a578cf-2317-4f62-8076-00ac354d1831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:38.202708 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a578cf-2317-4f62-8076-00ac354d1831 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:38.203041 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a578cf-2317-4f62-8076-00ac354d1831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:38.203319 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a578cf-2317-4f62-8076-00ac354d1831 admin admin] PATH_INFO: `/v3/projects/b3d01ef5ff16441dbf63a6aa384170a5/users/7a13e136a3494466ba3dbfbc9e86d55c/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:38.205854 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a578cf-2317-4f62-8076-00ac354d1831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d01ef5ff16441dbf63a6aa384170a5, user_id=7a13e136a3494466ba3dbfbc9e86d55c, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:38.208673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a578cf-2317-4f62-8076-00ac354d1831 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:38.218819 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1418/2807] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:18:38 2022] PUT /identity/v3/projects/b3d01ef5ff16441dbf63a6aa384170a5/users/7a13e136a3494466ba3dbfbc9e86d55c/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:18:38.229613 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58218155-141b-4f6a-a8a2-a633487ec5c5 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:38.229905 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58218155-141b-4f6a-a8a2-a633487ec5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:38.230181 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58218155-141b-4f6a-a8a2-a633487ec5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:38.257591 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-58218155-141b-4f6a-a8a2-a633487ec5c5 None None] MFA Rules not processed for user `7a13e136a3494466ba3dbfbc9e86d55c`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:38.258916 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-58218155-141b-4f6a-a8a2-a633487ec5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:38.331627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1390/2808] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:18:38.343022 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a578cf-2317-4f62-8076-00ac354d1831 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:38.345349 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-23a578cf-2317-4f62-8076-00ac354d1831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:38.424639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a578cf-2317-4f62-8076-00ac354d1831 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:38.428335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12ae6a-7937-41e0-aee1-53a26bf34c4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:38.428945 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12ae6a-7937-41e0-aee1-53a26bf34c4a service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:38.429238 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12ae6a-7937-41e0-aee1-53a26bf34c4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:38.429517 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12ae6a-7937-41e0-aee1-53a26bf34c4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:38.438473 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12ae6a-7937-41e0-aee1-53a26bf34c4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:38.439936 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12ae6a-7937-41e0-aee1-53a26bf34c4a service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:38.449439 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1419/2809] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:38.478315 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58218155-141b-4f6a-a8a2-a633487ec5c5 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:38.535793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:38.539984 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58218155-141b-4f6a-a8a2-a633487ec5c5 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:38.544538 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0d9db-f4b8-4993-8a08-13153cd2b585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:38.545173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0d9db-f4b8-4993-8a08-13153cd2b585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:38.545462 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0d9db-f4b8-4993-8a08-13153cd2b585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:38.545745 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0d9db-f4b8-4993-8a08-13153cd2b585 admin admin] PATH_INFO: `/v3/users/9e0a73364ed14c2e9c66389cd01807c5` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:38.547007 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0d9db-f4b8-4993-8a08-13153cd2b585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e0a73364ed14c2e9c66389cd01807c5)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:38.549860 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0d9db-f4b8-4993-8a08-13153cd2b585 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:38.748362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-7ce0d9db-f4b8-4993-8a08-13153cd2b585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e0a73364ed14c2e9c66389cd01807c5'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:38.755860 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-7ce0d9db-f4b8-4993-8a08-13153cd2b585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e0a73364ed14c2e9c66389cd01807c5'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:38.797889 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-7ce0d9db-f4b8-4993-8a08-13153cd2b585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e0a73364ed14c2e9c66389cd01807c5'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:38.798519 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-7ce0d9db-f4b8-4993-8a08-13153cd2b585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e0a73364ed14c2e9c66389cd01807c5'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:38.810493 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-7ce0d9db-f4b8-4993-8a08-13153cd2b585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e0a73364ed14c2e9c66389cd01807c5'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:38.816943 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1391/2810] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:18:38 2022] DELETE /identity/v3/users/9e0a73364ed14c2e9c66389cd01807c5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:38.821625 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40260d89-1d3f-4626-a32c-11b70e5ba92b None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:38.821916 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40260d89-1d3f-4626-a32c-11b70e5ba92b None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:38.822198 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40260d89-1d3f-4626-a32c-11b70e5ba92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:38.841276 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-40260d89-1d3f-4626-a32c-11b70e5ba92b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:38.842485 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-40260d89-1d3f-4626-a32c-11b70e5ba92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:38.902262 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1420/2811] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:38.912354 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0d9db-f4b8-4993-8a08-13153cd2b585 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:38.913760 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-7ce0d9db-f4b8-4993-8a08-13153cd2b585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:38.977655 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0d9db-f4b8-4993-8a08-13153cd2b585 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:38.981687 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7daccd-f677-405f-932f-4241cf8404b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:38.982418 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7daccd-f677-405f-932f-4241cf8404b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:38.982709 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7daccd-f677-405f-932f-4241cf8404b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:38.983019 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7daccd-f677-405f-932f-4241cf8404b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:38.993190 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7daccd-f677-405f-932f-4241cf8404b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:38.994632 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7daccd-f677-405f-932f-4241cf8404b5 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:39.004977 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1392/2812] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:39.383145 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40260d89-1d3f-4626-a32c-11b70e5ba92b None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:39.384688 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-40260d89-1d3f-4626-a32c-11b70e5ba92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:39.399673 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40260d89-1d3f-4626-a32c-11b70e5ba92b None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:39.405558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ff7f2-ed90-4d7b-961b-317523202412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:39.406205 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ff7f2-ed90-4d7b-961b-317523202412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:39.407004 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ff7f2-ed90-4d7b-961b-317523202412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:39.407598 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ff7f2-ed90-4d7b-961b-317523202412 admin admin] PATH_INFO: `/v3/projects/dbc40d1ed6244b9da60bd7fa589a0d58` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:39.408564 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ff7f2-ed90-4d7b-961b-317523202412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbc40d1ed6244b9da60bd7fa589a0d58)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:39.411041 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ff7f2-ed90-4d7b-961b-317523202412 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:39.496085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-121ff7f2-ed90-4d7b-961b-317523202412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbc40d1ed6244b9da60bd7fa589a0d58', 'request_id': 'req-121ff7f2-ed90-4d7b-961b-317523202412'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:39.502192 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-121ff7f2-ed90-4d7b-961b-317523202412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbc40d1ed6244b9da60bd7fa589a0d58', 'request_id': 'req-121ff7f2-ed90-4d7b-961b-317523202412'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:39.540917 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-121ff7f2-ed90-4d7b-961b-317523202412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbc40d1ed6244b9da60bd7fa589a0d58', 'request_id': 'req-121ff7f2-ed90-4d7b-961b-317523202412'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:39.542129 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:39.552681 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-121ff7f2-ed90-4d7b-961b-317523202412 admin admin] The token cache is being invalidate because project dbc40d1ed6244b9da60bd7fa589a0d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:18:39.552973 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-121ff7f2-ed90-4d7b-961b-317523202412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:39.553723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-121ff7f2-ed90-4d7b-961b-317523202412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:39.555303 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1421/2813] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:18:39 2022] DELETE /identity/v3/projects/dbc40d1ed6244b9da60bd7fa589a0d58 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:39.559294 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7daccd-f677-405f-932f-4241cf8404b5 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:39.569055 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7daccd-f677-405f-932f-4241cf8404b5 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:39.625822 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f9d99-c81f-42a2-aa4b-e9fcf0643883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:39.626493 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f9d99-c81f-42a2-aa4b-e9fcf0643883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:39.626806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f9d99-c81f-42a2-aa4b-e9fcf0643883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:39.627088 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f9d99-c81f-42a2-aa4b-e9fcf0643883 admin admin] PATH_INFO: `/v3/users/7a13e136a3494466ba3dbfbc9e86d55c` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:39.628291 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f9d99-c81f-42a2-aa4b-e9fcf0643883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a13e136a3494466ba3dbfbc9e86d55c)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:39.630224 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f9d99-c81f-42a2-aa4b-e9fcf0643883 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:39.652820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:39.840512 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-895f9d99-c81f-42a2-aa4b-e9fcf0643883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a13e136a3494466ba3dbfbc9e86d55c'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:39.848662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-895f9d99-c81f-42a2-aa4b-e9fcf0643883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a13e136a3494466ba3dbfbc9e86d55c'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:39.935045 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-895f9d99-c81f-42a2-aa4b-e9fcf0643883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a13e136a3494466ba3dbfbc9e86d55c'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:39.935701 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-895f9d99-c81f-42a2-aa4b-e9fcf0643883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a13e136a3494466ba3dbfbc9e86d55c'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:39.948629 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-895f9d99-c81f-42a2-aa4b-e9fcf0643883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a13e136a3494466ba3dbfbc9e86d55c'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:39.954824 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1393/2814] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:18:39 2022] DELETE /identity/v3/users/7a13e136a3494466ba3dbfbc9e86d55c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:40.382520 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ff7f2-ed90-4d7b-961b-317523202412 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:40.384208 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-121ff7f2-ed90-4d7b-961b-317523202412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:40.397822 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ff7f2-ed90-4d7b-961b-317523202412 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:40.457641 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e78b8-260f-4d12-b114-4a5d61b28816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:40.458291 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e78b8-260f-4d12-b114-4a5d61b28816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:40.458609 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e78b8-260f-4d12-b114-4a5d61b28816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:40.458919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e78b8-260f-4d12-b114-4a5d61b28816 admin admin] PATH_INFO: `/v3/projects/b3d01ef5ff16441dbf63a6aa384170a5` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:40.460115 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e78b8-260f-4d12-b114-4a5d61b28816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3d01ef5ff16441dbf63a6aa384170a5)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:40.462055 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e78b8-260f-4d12-b114-4a5d61b28816 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:40.568258 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d57e78b8-260f-4d12-b114-4a5d61b28816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3d01ef5ff16441dbf63a6aa384170a5', 'request_id': 'req-d57e78b8-260f-4d12-b114-4a5d61b28816'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:40.574363 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d57e78b8-260f-4d12-b114-4a5d61b28816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3d01ef5ff16441dbf63a6aa384170a5', 'request_id': 'req-d57e78b8-260f-4d12-b114-4a5d61b28816'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:40.654148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d57e78b8-260f-4d12-b114-4a5d61b28816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3d01ef5ff16441dbf63a6aa384170a5', 'request_id': 'req-d57e78b8-260f-4d12-b114-4a5d61b28816'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:40.665797 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d57e78b8-260f-4d12-b114-4a5d61b28816 admin admin] The token cache is being invalidate because project b3d01ef5ff16441dbf63a6aa384170a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:18:40.666091 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d57e78b8-260f-4d12-b114-4a5d61b28816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:40.666756 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-d57e78b8-260f-4d12-b114-4a5d61b28816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:40.668299 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1422/2815] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:18:40 2022] DELETE /identity/v3/projects/b3d01ef5ff16441dbf63a6aa384170a5 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:18:40.673368 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b0d5d-d095-412e-8f55-fd834d84fbbe None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:40.673851 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b0d5d-d095-412e-8f55-fd834d84fbbe None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:40.673976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b0d5d-d095-412e-8f55-fd834d84fbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:40.693414 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-f15b0d5d-d095-412e-8f55-fd834d84fbbe None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:40.694608 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-f15b0d5d-d095-412e-8f55-fd834d84fbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:40.752921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1394/2816] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:40.761868 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a20f7f-4f3c-4e56-b482-00fa59bb8202 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:40.762158 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a20f7f-4f3c-4e56-b482-00fa59bb8202 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:40.762440 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a20f7f-4f3c-4e56-b482-00fa59bb8202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:40.783895 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-c6a20f7f-4f3c-4e56-b482-00fa59bb8202 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:40.785382 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-c6a20f7f-4f3c-4e56-b482-00fa59bb8202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:40.793323 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1423/2817] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:40.797587 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b0d5d-d095-412e-8f55-fd834d84fbbe None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:40.807386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b0d5d-d095-412e-8f55-fd834d84fbbe None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:40.812180 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1621b8-a337-46f0-91a5-d166a79c1773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:40.813320 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1621b8-a337-46f0-91a5-d166a79c1773 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:40.813601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1621b8-a337-46f0-91a5-d166a79c1773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:40.813887 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1621b8-a337-46f0-91a5-d166a79c1773 admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:40.814574 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1621b8-a337-46f0-91a5-d166a79c1773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:18:40.814997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1621b8-a337-46f0-91a5-d166a79c1773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:40.816680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1621b8-a337-46f0-91a5-d166a79c1773 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:40.829019 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1395/2818] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:18:40.832857 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a20f7f-4f3c-4e56-b482-00fa59bb8202 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:40.842036 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a20f7f-4f3c-4e56-b482-00fa59bb8202 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:40.846849 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd311c-dda4-423d-a9e9-e6d12c959128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:40.847453 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd311c-dda4-423d-a9e9-e6d12c959128 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:40.847740 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd311c-dda4-423d-a9e9-e6d12c959128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:40.848022 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd311c-dda4-423d-a9e9-e6d12c959128 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:40.848687 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd311c-dda4-423d-a9e9-e6d12c959128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:40.850589 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd311c-dda4-423d-a9e9-e6d12c959128 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:40.942397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1424/2819] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:18:40 2022] POST /identity/v3/projects => generated 389 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:40.946481 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1621b8-a337-46f0-91a5-d166a79c1773 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:40.957177 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1621b8-a337-46f0-91a5-d166a79c1773 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:41.013240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7cb26-f048-4d1e-abe5-0bb1d522a71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:41.013854 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7cb26-f048-4d1e-abe5-0bb1d522a71d admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:41.014138 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7cb26-f048-4d1e-abe5-0bb1d522a71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:41.014415 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7cb26-f048-4d1e-abe5-0bb1d522a71d admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:41.015103 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7cb26-f048-4d1e-abe5-0bb1d522a71d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:41.017654 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7cb26-f048-4d1e-abe5-0bb1d522a71d admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:41.140705 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1396/2820] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:18:40 2022] POST /identity/v3/users => generated 295 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:41.145547 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd311c-dda4-423d-a9e9-e6d12c959128 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:41.156210 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd311c-dda4-423d-a9e9-e6d12c959128 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:41.161350 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124d562-3f59-4e0b-b7d5-4c16b44c479c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:41.161974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124d562-3f59-4e0b-b7d5-4c16b44c479c admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:41.162348 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124d562-3f59-4e0b-b7d5-4c16b44c479c admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:41.162632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124d562-3f59-4e0b-b7d5-4c16b44c479c admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:41.163372 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124d562-3f59-4e0b-b7d5-4c16b44c479c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:41.164972 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124d562-3f59-4e0b-b7d5-4c16b44c479c admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:41.176035 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1425/2821] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:41.180055 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7cb26-f048-4d1e-abe5-0bb1d522a71d admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:41.191026 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7cb26-f048-4d1e-abe5-0bb1d522a71d admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:41.195770 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2a93d-00aa-4ec6-ba88-17cc4edcc04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:41.196340 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2a93d-00aa-4ec6-ba88-17cc4edcc04f admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:41.196628 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2a93d-00aa-4ec6-ba88-17cc4edcc04f admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:41.196935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2a93d-00aa-4ec6-ba88-17cc4edcc04f admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:41.197661 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2a93d-00aa-4ec6-ba88-17cc4edcc04f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:41.199299 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2a93d-00aa-4ec6-ba88-17cc4edcc04f admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:41.209308 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1397/2822] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:41.213193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124d562-3f59-4e0b-b7d5-4c16b44c479c admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:41.223057 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124d562-3f59-4e0b-b7d5-4c16b44c479c admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:41.227624 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc11b8-e1ed-47f4-8de2-67037e627430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:41.228281 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc11b8-e1ed-47f4-8de2-67037e627430 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:41.228569 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc11b8-e1ed-47f4-8de2-67037e627430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:41.228850 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc11b8-e1ed-47f4-8de2-67037e627430 admin admin] PATH_INFO: `/v3/projects/e13145530264412f94b1b8ed36f8e033/users/ca3b7f936ae947aca1863a6e46dc3d5e/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:41.243604 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc11b8-e1ed-47f4-8de2-67037e627430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e13145530264412f94b1b8ed36f8e033, user_id=ca3b7f936ae947aca1863a6e46dc3d5e, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:41.246238 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc11b8-e1ed-47f4-8de2-67037e627430 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:41.335241 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1426/2823] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:18:41 2022] PUT /identity/v3/projects/e13145530264412f94b1b8ed36f8e033/users/ca3b7f936ae947aca1863a6e46dc3d5e/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:41.398707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ed2f9-c2c7-4bec-b544-9bb87a48a426 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:41.399032 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ed2f9-c2c7-4bec-b544-9bb87a48a426 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:41.399316 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ed2f9-c2c7-4bec-b544-9bb87a48a426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:41.407738 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:41.429053 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-be5ed2f9-c2c7-4bec-b544-9bb87a48a426 None None] MFA Rules not processed for user `ca3b7f936ae947aca1863a6e46dc3d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:41.430275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-be5ed2f9-c2c7-4bec-b544-9bb87a48a426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:41.494883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1398/2824] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:41.499188 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc11b8-e1ed-47f4-8de2-67037e627430 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:41.517279 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:41.560687 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc11b8-e1ed-47f4-8de2-67037e627430 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:41.565948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470528c-4780-4b03-985d-f99438db2c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:41.566560 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470528c-4780-4b03-985d-f99438db2c8e admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:41.566878 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470528c-4780-4b03-985d-f99438db2c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:41.567163 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470528c-4780-4b03-985d-f99438db2c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:41.567842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470528c-4780-4b03-985d-f99438db2c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:41.569837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470528c-4780-4b03-985d-f99438db2c8e admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:41.646280 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1427/2825] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:18:41 2022] POST /identity/v3/projects => generated 389 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:41.650266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ed2f9-c2c7-4bec-b544-9bb87a48a426 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:41.661240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ed2f9-c2c7-4bec-b544-9bb87a48a426 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:41.717697 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba5308-e610-423b-bc26-3f7a6414e8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:41.718345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba5308-e610-423b-bc26-3f7a6414e8cd admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:41.718583 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba5308-e610-423b-bc26-3f7a6414e8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:41.718903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba5308-e610-423b-bc26-3f7a6414e8cd admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:41.719561 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba5308-e610-423b-bc26-3f7a6414e8cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:41.721479 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba5308-e610-423b-bc26-3f7a6414e8cd admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:41.792173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1399/2826] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:18:41 2022] POST /identity/v3/users => generated 301 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:41.796006 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470528c-4780-4b03-985d-f99438db2c8e admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:41.806574 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470528c-4780-4b03-985d-f99438db2c8e admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:41.811270 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faee231-18de-4919-be48-36460d04611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:41.811886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faee231-18de-4919-be48-36460d04611d admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:41.812169 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faee231-18de-4919-be48-36460d04611d admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:41.812451 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faee231-18de-4919-be48-36460d04611d admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:41.813803 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faee231-18de-4919-be48-36460d04611d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:41.815445 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faee231-18de-4919-be48-36460d04611d admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:41.826395 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1428/2827] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:41.831146 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba5308-e610-423b-bc26-3f7a6414e8cd admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:41.841290 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba5308-e610-423b-bc26-3f7a6414e8cd admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:41.846029 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57924b-77a8-49db-b393-a2b30aabb561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:41.846683 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57924b-77a8-49db-b393-a2b30aabb561 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:41.846997 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57924b-77a8-49db-b393-a2b30aabb561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:41.847275 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57924b-77a8-49db-b393-a2b30aabb561 admin admin] PATH_INFO: `/v3/projects/ddf0dc654b3e426b860041c5021c4978/users/3d3e912bc8e9451eb23c4e733a5eeb2f/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:41.862102 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57924b-77a8-49db-b393-a2b30aabb561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf0dc654b3e426b860041c5021c4978, user_id=3d3e912bc8e9451eb23c4e733a5eeb2f, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:41.864838 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57924b-77a8-49db-b393-a2b30aabb561 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:41.969739 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1400/2828] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:18:41 2022] PUT /identity/v3/projects/ddf0dc654b3e426b860041c5021c4978/users/3d3e912bc8e9451eb23c4e733a5eeb2f/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:41.973656 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faee231-18de-4919-be48-36460d04611d admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:41.983957 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faee231-18de-4919-be48-36460d04611d admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:42.038505 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8877e0f-5d13-43e6-9dae-73da708ae506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:42.039144 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8877e0f-5d13-43e6-9dae-73da708ae506 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:42.039426 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8877e0f-5d13-43e6-9dae-73da708ae506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:42.039707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8877e0f-5d13-43e6-9dae-73da708ae506 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:42.040388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8877e0f-5d13-43e6-9dae-73da708ae506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:42.041967 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8877e0f-5d13-43e6-9dae-73da708ae506 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:42.051895 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1429/2829] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:42.056346 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57924b-77a8-49db-b393-a2b30aabb561 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:42.067065 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57924b-77a8-49db-b393-a2b30aabb561 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:42.071671 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917eb88-f707-4f1f-9f3e-e3993450ca8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:42.072317 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917eb88-f707-4f1f-9f3e-e3993450ca8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:42.072597 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917eb88-f707-4f1f-9f3e-e3993450ca8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:42.072869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917eb88-f707-4f1f-9f3e-e3993450ca8d admin admin] PATH_INFO: `/v3/projects/ddf0dc654b3e426b860041c5021c4978/users/3d3e912bc8e9451eb23c4e733a5eeb2f/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:42.074866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917eb88-f707-4f1f-9f3e-e3993450ca8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf0dc654b3e426b860041c5021c4978, user_id=3d3e912bc8e9451eb23c4e733a5eeb2f, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:42.077458 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917eb88-f707-4f1f-9f3e-e3993450ca8d admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:42.087995 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1401/2830] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:18:42 2022] PUT /identity/v3/projects/ddf0dc654b3e426b860041c5021c4978/users/3d3e912bc8e9451eb23c4e733a5eeb2f/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:42.098558 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf311d-7cae-425e-a42a-225bd6f28225 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:42.098883 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf311d-7cae-425e-a42a-225bd6f28225 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:42.099247 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf311d-7cae-425e-a42a-225bd6f28225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:42.125884 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-18bf311d-7cae-425e-a42a-225bd6f28225 None None] MFA Rules not processed for user `3d3e912bc8e9451eb23c4e733a5eeb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:42.127116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-18bf311d-7cae-425e-a42a-225bd6f28225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:42.193990 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1430/2831] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:42 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:42.205249 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917eb88-f707-4f1f-9f3e-e3993450ca8d admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:42.207015 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b917eb88-f707-4f1f-9f3e-e3993450ca8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:42.258946 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:42.263744 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917eb88-f707-4f1f-9f3e-e3993450ca8d admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:42.268710 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37f172-8188-4dfc-9eb2-28c0b43551fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:42.269320 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37f172-8188-4dfc-9eb2-28c0b43551fc service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:42.269601 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37f172-8188-4dfc-9eb2-28c0b43551fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:42.269870 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37f172-8188-4dfc-9eb2-28c0b43551fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:42.278819 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37f172-8188-4dfc-9eb2-28c0b43551fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:42.280240 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37f172-8188-4dfc-9eb2-28c0b43551fc service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:42.290465 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1402/2832] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:42 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:42.426580 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf311d-7cae-425e-a42a-225bd6f28225 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:42.438800 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:42.487844 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf311d-7cae-425e-a42a-225bd6f28225 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:42.492442 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b494bc-d778-4571-98aa-ff748bc552a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:42.493086 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b494bc-d778-4571-98aa-ff748bc552a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:42.493373 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b494bc-d778-4571-98aa-ff748bc552a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:42.493653 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b494bc-d778-4571-98aa-ff748bc552a5 admin admin] PATH_INFO: `/v3/users/ca3b7f936ae947aca1863a6e46dc3d5e` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:42.495041 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b494bc-d778-4571-98aa-ff748bc552a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca3b7f936ae947aca1863a6e46dc3d5e)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:42.497251 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b494bc-d778-4571-98aa-ff748bc552a5 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:42.668966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-14b494bc-d778-4571-98aa-ff748bc552a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca3b7f936ae947aca1863a6e46dc3d5e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:42.676545 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-14b494bc-d778-4571-98aa-ff748bc552a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca3b7f936ae947aca1863a6e46dc3d5e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:42.680217 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-14b494bc-d778-4571-98aa-ff748bc552a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca3b7f936ae947aca1863a6e46dc3d5e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:42.689260 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-14b494bc-d778-4571-98aa-ff748bc552a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca3b7f936ae947aca1863a6e46dc3d5e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:42.689985 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-14b494bc-d778-4571-98aa-ff748bc552a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca3b7f936ae947aca1863a6e46dc3d5e'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:42.757420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1431/2833] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:18:42 2022] DELETE /identity/v3/users/ca3b7f936ae947aca1863a6e46dc3d5e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:42.762123 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ba6e6-07a4-4467-a247-ed18bd856f5d None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:42.762576 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ba6e6-07a4-4467-a247-ed18bd856f5d None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:42.766390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ba6e6-07a4-4467-a247-ed18bd856f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:42.782439 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-397ba6e6-07a4-4467-a247-ed18bd856f5d None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:42.783680 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-397ba6e6-07a4-4467-a247-ed18bd856f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:42.842293 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1403/2834] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:42.852608 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b494bc-d778-4571-98aa-ff748bc552a5 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:42.854004 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-14b494bc-d778-4571-98aa-ff748bc552a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:42.912776 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b494bc-d778-4571-98aa-ff748bc552a5 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:42.916475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b5422-1e01-4e74-9b86-89917e21fedb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:42.917098 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b5422-1e01-4e74-9b86-89917e21fedb service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:42.917389 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b5422-1e01-4e74-9b86-89917e21fedb service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:42.917670 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b5422-1e01-4e74-9b86-89917e21fedb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:42.926613 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b5422-1e01-4e74-9b86-89917e21fedb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:42.928002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b5422-1e01-4e74-9b86-89917e21fedb service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:42.937311 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1432/2835] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:43.325627 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ba6e6-07a4-4467-a247-ed18bd856f5d None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:43.327293 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-397ba6e6-07a4-4467-a247-ed18bd856f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:43.341917 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ba6e6-07a4-4467-a247-ed18bd856f5d None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:43.347019 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92fd67-ab0e-4f81-9477-4d48c96ccf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:43.347686 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92fd67-ab0e-4f81-9477-4d48c96ccf61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:43.348564 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92fd67-ab0e-4f81-9477-4d48c96ccf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:43.348851 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92fd67-ab0e-4f81-9477-4d48c96ccf61 admin admin] PATH_INFO: `/v3/projects/e13145530264412f94b1b8ed36f8e033` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:43.350409 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92fd67-ab0e-4f81-9477-4d48c96ccf61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e13145530264412f94b1b8ed36f8e033)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:43.352490 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92fd67-ab0e-4f81-9477-4d48c96ccf61 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:43.444525 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-db92fd67-ab0e-4f81-9477-4d48c96ccf61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e13145530264412f94b1b8ed36f8e033', 'request_id': 'req-db92fd67-ab0e-4f81-9477-4d48c96ccf61'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:43.450689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-db92fd67-ab0e-4f81-9477-4d48c96ccf61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e13145530264412f94b1b8ed36f8e033', 'request_id': 'req-db92fd67-ab0e-4f81-9477-4d48c96ccf61'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:43.494918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-db92fd67-ab0e-4f81-9477-4d48c96ccf61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e13145530264412f94b1b8ed36f8e033', 'request_id': 'req-db92fd67-ab0e-4f81-9477-4d48c96ccf61'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:43.506012 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-db92fd67-ab0e-4f81-9477-4d48c96ccf61 admin admin] The token cache is being invalidate because project e13145530264412f94b1b8ed36f8e033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:18:43.506335 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-db92fd67-ab0e-4f81-9477-4d48c96ccf61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:43.507001 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-db92fd67-ab0e-4f81-9477-4d48c96ccf61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:43.508607 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1404/2836] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:18:43 2022] DELETE /identity/v3/projects/e13145530264412f94b1b8ed36f8e033 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:43.512659 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b5422-1e01-4e74-9b86-89917e21fedb service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:43.522417 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b5422-1e01-4e74-9b86-89917e21fedb service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:43.551909 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:43.577269 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bbbc3-f6cd-4c09-8df1-7468596bd654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:43.577905 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bbbc3-f6cd-4c09-8df1-7468596bd654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:43.578219 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bbbc3-f6cd-4c09-8df1-7468596bd654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:43.578467 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bbbc3-f6cd-4c09-8df1-7468596bd654 admin admin] PATH_INFO: `/v3/users/3d3e912bc8e9451eb23c4e733a5eeb2f` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:43.579666 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bbbc3-f6cd-4c09-8df1-7468596bd654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3e912bc8e9451eb23c4e733a5eeb2f)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:43.582055 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bbbc3-f6cd-4c09-8df1-7468596bd654 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:43.725320 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c92bbbc3-f6cd-4c09-8df1-7468596bd654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3e912bc8e9451eb23c4e733a5eeb2f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:43.732044 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c92bbbc3-f6cd-4c09-8df1-7468596bd654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3e912bc8e9451eb23c4e733a5eeb2f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:43.732712 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c92bbbc3-f6cd-4c09-8df1-7468596bd654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3e912bc8e9451eb23c4e733a5eeb2f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:43.744880 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c92bbbc3-f6cd-4c09-8df1-7468596bd654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3e912bc8e9451eb23c4e733a5eeb2f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:43.745506 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-c92bbbc3-f6cd-4c09-8df1-7468596bd654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3e912bc8e9451eb23c4e733a5eeb2f'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:43.808837 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1433/2837] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:18:43 2022] DELETE /identity/v3/users/3d3e912bc8e9451eb23c4e733a5eeb2f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:44.268581 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92fd67-ab0e-4f81-9477-4d48c96ccf61 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:44.270024 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-db92fd67-ab0e-4f81-9477-4d48c96ccf61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:44.284051 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92fd67-ab0e-4f81-9477-4d48c96ccf61 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:44.343431 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce3f78-7c3a-4a84-9055-164d89fa47c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:44.344069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce3f78-7c3a-4a84-9055-164d89fa47c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:44.344353 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce3f78-7c3a-4a84-9055-164d89fa47c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:44.345297 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce3f78-7c3a-4a84-9055-164d89fa47c4 admin admin] PATH_INFO: `/v3/projects/ddf0dc654b3e426b860041c5021c4978` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:44.346472 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce3f78-7c3a-4a84-9055-164d89fa47c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddf0dc654b3e426b860041c5021c4978)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:44.348392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce3f78-7c3a-4a84-9055-164d89fa47c4 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:44.364286 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:44.461348 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-f1ce3f78-7c3a-4a84-9055-164d89fa47c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddf0dc654b3e426b860041c5021c4978', 'request_id': 'req-f1ce3f78-7c3a-4a84-9055-164d89fa47c4'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:44.467716 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-f1ce3f78-7c3a-4a84-9055-164d89fa47c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddf0dc654b3e426b860041c5021c4978', 'request_id': 'req-f1ce3f78-7c3a-4a84-9055-164d89fa47c4'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:44.523419 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-f1ce3f78-7c3a-4a84-9055-164d89fa47c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddf0dc654b3e426b860041c5021c4978', 'request_id': 'req-f1ce3f78-7c3a-4a84-9055-164d89fa47c4'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:44.534178 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-f1ce3f78-7c3a-4a84-9055-164d89fa47c4 admin admin] The token cache is being invalidate because project ddf0dc654b3e426b860041c5021c4978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:18:44.534470 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-f1ce3f78-7c3a-4a84-9055-164d89fa47c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:44.535389 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-f1ce3f78-7c3a-4a84-9055-164d89fa47c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:44.540492 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1405/2838] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:18:44 2022] DELETE /identity/v3/projects/ddf0dc654b3e426b860041c5021c4978 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:18:44.541747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf677a8-a4ff-4240-9da7-900216d8a007 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:44.542042 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf677a8-a4ff-4240-9da7-900216d8a007 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:44.542325 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf677a8-a4ff-4240-9da7-900216d8a007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:44.562373 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-faf677a8-a4ff-4240-9da7-900216d8a007 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:44.563621 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-faf677a8-a4ff-4240-9da7-900216d8a007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:44.621729 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1434/2839] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:44.630613 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12034b8e-37b1-46ae-988d-85b6fb2188e4 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:44.631016 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12034b8e-37b1-46ae-988d-85b6fb2188e4 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:44.631359 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12034b8e-37b1-46ae-988d-85b6fb2188e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:44.651098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-12034b8e-37b1-46ae-988d-85b6fb2188e4 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:44.652294 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-12034b8e-37b1-46ae-988d-85b6fb2188e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:44.661168 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1406/2840] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:44.665294 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf677a8-a4ff-4240-9da7-900216d8a007 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:44.675398 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf677a8-a4ff-4240-9da7-900216d8a007 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:44.679947 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d4ed3-6998-42b5-9223-90776e57d5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:44.680548 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d4ed3-6998-42b5-9223-90776e57d5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:44.680827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d4ed3-6998-42b5-9223-90776e57d5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:44.681101 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d4ed3-6998-42b5-9223-90776e57d5b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:44.681790 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d4ed3-6998-42b5-9223-90776e57d5b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:18:44.682094 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d4ed3-6998-42b5-9223-90776e57d5b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:44.683702 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d4ed3-6998-42b5-9223-90776e57d5b7 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:44.695284 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1435/2841] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:18:44.699451 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12034b8e-37b1-46ae-988d-85b6fb2188e4 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:44.708668 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12034b8e-37b1-46ae-988d-85b6fb2188e4 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:44.713569 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4a996-293e-4ad5-baab-345595b47960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:44.714168 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4a996-293e-4ad5-baab-345595b47960 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:44.714454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4a996-293e-4ad5-baab-345595b47960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:44.714762 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4a996-293e-4ad5-baab-345595b47960 admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:44.715434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4a996-293e-4ad5-baab-345595b47960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:44.717333 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4a996-293e-4ad5-baab-345595b47960 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:44.805828 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1407/2842] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:18:44 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:18:44.809761 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d4ed3-6998-42b5-9223-90776e57d5b7 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:44.820031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d4ed3-6998-42b5-9223-90776e57d5b7 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:44.857765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:44.876736 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0a7c5-62f7-4fbd-a5ae-640b3b096b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:44.877354 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0a7c5-62f7-4fbd-a5ae-640b3b096b19 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:44.877639 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0a7c5-62f7-4fbd-a5ae-640b3b096b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:44.877926 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0a7c5-62f7-4fbd-a5ae-640b3b096b19 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:44.878605 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0a7c5-62f7-4fbd-a5ae-640b3b096b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:44.880574 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0a7c5-62f7-4fbd-a5ae-640b3b096b19 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:44.970521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1436/2843] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:18:44 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:44.974684 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4a996-293e-4ad5-baab-345595b47960 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:44.985490 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4a996-293e-4ad5-baab-345595b47960 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:44.990193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf26e2f-3e81-4227-bd86-83f5c4aa341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:44.990800 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf26e2f-3e81-4227-bd86-83f5c4aa341a admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:44.991098 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf26e2f-3e81-4227-bd86-83f5c4aa341a admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:44.991368 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf26e2f-3e81-4227-bd86-83f5c4aa341a admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:44.992069 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf26e2f-3e81-4227-bd86-83f5c4aa341a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:44.993662 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf26e2f-3e81-4227-bd86-83f5c4aa341a admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:45.003539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1408/2844] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:45.008853 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0a7c5-62f7-4fbd-a5ae-640b3b096b19 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:45.017970 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0a7c5-62f7-4fbd-a5ae-640b3b096b19 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:45.022718 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df9c07-e460-4d17-9fdf-ddb223c284ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:45.023350 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df9c07-e460-4d17-9fdf-ddb223c284ef admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:45.023634 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df9c07-e460-4d17-9fdf-ddb223c284ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:45.023935 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df9c07-e460-4d17-9fdf-ddb223c284ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:45.024629 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df9c07-e460-4d17-9fdf-ddb223c284ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:45.026217 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df9c07-e460-4d17-9fdf-ddb223c284ef admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:45.037587 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1437/2845] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:45.041594 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf26e2f-3e81-4227-bd86-83f5c4aa341a admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:45.051456 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf26e2f-3e81-4227-bd86-83f5c4aa341a admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:45.056059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70c0f8-a4db-4dca-b1d2-5a46aedba499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:45.056647 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70c0f8-a4db-4dca-b1d2-5a46aedba499 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:45.056928 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70c0f8-a4db-4dca-b1d2-5a46aedba499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:45.057202 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70c0f8-a4db-4dca-b1d2-5a46aedba499 admin admin] PATH_INFO: `/v3/projects/579474c3f59247a0bba7d62ea3d290cc/users/a59f3ac5b6214a8684356876c4f81b99/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:45.071553 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70c0f8-a4db-4dca-b1d2-5a46aedba499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=579474c3f59247a0bba7d62ea3d290cc, user_id=a59f3ac5b6214a8684356876c4f81b99, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:45.074235 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70c0f8-a4db-4dca-b1d2-5a46aedba499 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:45.159392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1409/2846] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:18:45 2022] PUT /identity/v3/projects/579474c3f59247a0bba7d62ea3d290cc/users/a59f3ac5b6214a8684356876c4f81b99/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:45.176443 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d437d9a-a46e-437f-bf25-7814c49cb300 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:45.176735 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d437d9a-a46e-437f-bf25-7814c49cb300 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:45.177016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d437d9a-a46e-437f-bf25-7814c49cb300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:45.204808 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-3d437d9a-a46e-437f-bf25-7814c49cb300 None None] MFA Rules not processed for user `a59f3ac5b6214a8684356876c4f81b99`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:45.206023 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-3d437d9a-a46e-437f-bf25-7814c49cb300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:45.268280 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1438/2847] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:45.272732 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70c0f8-a4db-4dca-b1d2-5a46aedba499 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:45.336631 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70c0f8-a4db-4dca-b1d2-5a46aedba499 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:45.341625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602397f8-d437-4985-a14f-fa4f2c02cc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:45.342242 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602397f8-d437-4985-a14f-fa4f2c02cc2c admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:45.342532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602397f8-d437-4985-a14f-fa4f2c02cc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:45.342850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602397f8-d437-4985-a14f-fa4f2c02cc2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:45.343520 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602397f8-d437-4985-a14f-fa4f2c02cc2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:45.345486 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602397f8-d437-4985-a14f-fa4f2c02cc2c admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:45.457757 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1410/2848] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:18:45 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:45.461842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d437d9a-a46e-437f-bf25-7814c49cb300 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:45.472680 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d437d9a-a46e-437f-bf25-7814c49cb300 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:45.528912 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5be262-7ee8-4116-9f69-f4a24a935a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:45.529551 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5be262-7ee8-4116-9f69-f4a24a935a0e admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:45.529828 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5be262-7ee8-4116-9f69-f4a24a935a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:45.530107 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5be262-7ee8-4116-9f69-f4a24a935a0e admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:45.530829 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5be262-7ee8-4116-9f69-f4a24a935a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:45.532780 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5be262-7ee8-4116-9f69-f4a24a935a0e admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:45.614703 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1439/2849] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:18:45 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:45.618612 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602397f8-d437-4985-a14f-fa4f2c02cc2c admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:45.629688 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602397f8-d437-4985-a14f-fa4f2c02cc2c admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:45.634465 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61574b82-9ddd-495f-bc0c-fd609ee07945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:45.635110 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61574b82-9ddd-495f-bc0c-fd609ee07945 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:45.635402 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61574b82-9ddd-495f-bc0c-fd609ee07945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:45.635689 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61574b82-9ddd-495f-bc0c-fd609ee07945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:45.636567 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61574b82-9ddd-495f-bc0c-fd609ee07945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:45.638171 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61574b82-9ddd-495f-bc0c-fd609ee07945 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:45.650953 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1411/2850] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:18:45.656434 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5be262-7ee8-4116-9f69-f4a24a935a0e admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:45.667406 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5be262-7ee8-4116-9f69-f4a24a935a0e admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:45.673327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d4dfe-f02e-4e23-a33c-ad12352ac60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:45.673608 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d4dfe-f02e-4e23-a33c-ad12352ac60b admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:45.674556 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d4dfe-f02e-4e23-a33c-ad12352ac60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:45.674886 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d4dfe-f02e-4e23-a33c-ad12352ac60b admin admin] PATH_INFO: `/v3/projects/8cdfd459ba3b470d8b55e259d615f6d1/users/e74ea85fb8f4412a8c0830110567443e/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:45.691539 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d4dfe-f02e-4e23-a33c-ad12352ac60b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cdfd459ba3b470d8b55e259d615f6d1, user_id=e74ea85fb8f4412a8c0830110567443e, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:45.694285 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d4dfe-f02e-4e23-a33c-ad12352ac60b admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:45.741397 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1440/2851] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:18:45 2022] PUT /identity/v3/projects/8cdfd459ba3b470d8b55e259d615f6d1/users/e74ea85fb8f4412a8c0830110567443e/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:45.745180 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61574b82-9ddd-495f-bc0c-fd609ee07945 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:45.756758 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61574b82-9ddd-495f-bc0c-fd609ee07945 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:45.765879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:45.814115 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef0e12-16c9-44cf-b228-19ddbb4c3c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:45.814753 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef0e12-16c9-44cf-b228-19ddbb4c3c4c admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:45.815041 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef0e12-16c9-44cf-b228-19ddbb4c3c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:45.815322 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef0e12-16c9-44cf-b228-19ddbb4c3c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:45.816016 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef0e12-16c9-44cf-b228-19ddbb4c3c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:45.817621 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef0e12-16c9-44cf-b228-19ddbb4c3c4c admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:45.827400 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1412/2852] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:18:45.831401 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d4dfe-f02e-4e23-a33c-ad12352ac60b admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:45.841596 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d4dfe-f02e-4e23-a33c-ad12352ac60b admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:45.846461 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2263d7-6d2c-44bb-9be1-c666bd885a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:45.847166 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2263d7-6d2c-44bb-9be1-c666bd885a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:45.847480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2263d7-6d2c-44bb-9be1-c666bd885a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:45.847765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2263d7-6d2c-44bb-9be1-c666bd885a45 admin admin] PATH_INFO: `/v3/projects/8cdfd459ba3b470d8b55e259d615f6d1/users/e74ea85fb8f4412a8c0830110567443e/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:45.849777 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2263d7-6d2c-44bb-9be1-c666bd885a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cdfd459ba3b470d8b55e259d615f6d1, user_id=e74ea85fb8f4412a8c0830110567443e, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:45.852459 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2263d7-6d2c-44bb-9be1-c666bd885a45 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:45.858640 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:45.863538 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1441/2853] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:18:45 2022] PUT /identity/v3/projects/8cdfd459ba3b470d8b55e259d615f6d1/users/e74ea85fb8f4412a8c0830110567443e/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:45.873730 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19772f4-a47c-44a9-a378-d9aa160ca32c None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:45.874054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19772f4-a47c-44a9-a378-d9aa160ca32c None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:45.874338 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19772f4-a47c-44a9-a378-d9aa160ca32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:45.902558 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-d19772f4-a47c-44a9-a378-d9aa160ca32c None None] MFA Rules not processed for user `e74ea85fb8f4412a8c0830110567443e`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:45.903795 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-d19772f4-a47c-44a9-a378-d9aa160ca32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:45.972384 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1413/2854] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:45.982828 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2263d7-6d2c-44bb-9be1-c666bd885a45 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:45.984503 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-6a2263d7-6d2c-44bb-9be1-c666bd885a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:46.042512 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2263d7-6d2c-44bb-9be1-c666bd885a45 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:46.046175 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3bcfe-79e3-48ae-bb25-2603f22e3129 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:46.046806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3bcfe-79e3-48ae-bb25-2603f22e3129 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:46.047096 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3bcfe-79e3-48ae-bb25-2603f22e3129 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:46.047375 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3bcfe-79e3-48ae-bb25-2603f22e3129 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:46.101576 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3bcfe-79e3-48ae-bb25-2603f22e3129 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:46.103032 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3bcfe-79e3-48ae-bb25-2603f22e3129 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:46.112384 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1442/2855] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:49.085303 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19772f4-a47c-44a9-a378-d9aa160ca32c None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:49.148532 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19772f4-a47c-44a9-a378-d9aa160ca32c None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:49.153135 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90186f09-5d9d-4d27-8c65-cd3dc27405f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:49.153777 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90186f09-5d9d-4d27-8c65-cd3dc27405f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:49.154059 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90186f09-5d9d-4d27-8c65-cd3dc27405f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:49.154337 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90186f09-5d9d-4d27-8c65-cd3dc27405f9 admin admin] PATH_INFO: `/v3/users/a59f3ac5b6214a8684356876c4f81b99` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:49.155548 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90186f09-5d9d-4d27-8c65-cd3dc27405f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a59f3ac5b6214a8684356876c4f81b99)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:49.157488 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90186f09-5d9d-4d27-8c65-cd3dc27405f9 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:49.316382 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:49.324898 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-90186f09-5d9d-4d27-8c65-cd3dc27405f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a59f3ac5b6214a8684356876c4f81b99'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:49.331996 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-90186f09-5d9d-4d27-8c65-cd3dc27405f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a59f3ac5b6214a8684356876c4f81b99'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:49.403440 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-90186f09-5d9d-4d27-8c65-cd3dc27405f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a59f3ac5b6214a8684356876c4f81b99'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:49.404162 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-90186f09-5d9d-4d27-8c65-cd3dc27405f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a59f3ac5b6214a8684356876c4f81b99'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:49.417175 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-90186f09-5d9d-4d27-8c65-cd3dc27405f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a59f3ac5b6214a8684356876c4f81b99'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:49.423201 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1414/2856] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:18:49 2022] DELETE /identity/v3/users/a59f3ac5b6214a8684356876c4f81b99 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:49.427735 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59b46c-c2b3-4971-9a7b-3510ca41d3fa None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:49.428224 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59b46c-c2b3-4971-9a7b-3510ca41d3fa None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:49.428327 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59b46c-c2b3-4971-9a7b-3510ca41d3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:49.447813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-ef59b46c-c2b3-4971-9a7b-3510ca41d3fa None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:49.449016 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ef59b46c-c2b3-4971-9a7b-3510ca41d3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:49.506706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1443/2857] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:49.516489 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90186f09-5d9d-4d27-8c65-cd3dc27405f9 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:49.517988 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-90186f09-5d9d-4d27-8c65-cd3dc27405f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:49.575850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90186f09-5d9d-4d27-8c65-cd3dc27405f9 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:49.579587 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edb09a-2b2c-45f1-9b31-7b7155731849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:49.580243 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edb09a-2b2c-45f1-9b31-7b7155731849 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:49.580557 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edb09a-2b2c-45f1-9b31-7b7155731849 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:49.580817 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edb09a-2b2c-45f1-9b31-7b7155731849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:49.590295 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edb09a-2b2c-45f1-9b31-7b7155731849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:49.591760 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edb09a-2b2c-45f1-9b31-7b7155731849 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:49.601822 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1415/2858] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:50.023469 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59b46c-c2b3-4971-9a7b-3510ca41d3fa None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:50.024970 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ef59b46c-c2b3-4971-9a7b-3510ca41d3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:50.037953 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59b46c-c2b3-4971-9a7b-3510ca41d3fa None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:50.043001 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9b3fa-0ca7-4ce5-9fde-877c17725bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:50.043694 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9b3fa-0ca7-4ce5-9fde-877c17725bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:50.043982 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9b3fa-0ca7-4ce5-9fde-877c17725bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:50.044289 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9b3fa-0ca7-4ce5-9fde-877c17725bf3 admin admin] PATH_INFO: `/v3/projects/579474c3f59247a0bba7d62ea3d290cc` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:50.046169 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9b3fa-0ca7-4ce5-9fde-877c17725bf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=579474c3f59247a0bba7d62ea3d290cc)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:50.048291 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9b3fa-0ca7-4ce5-9fde-877c17725bf3 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:50.130278 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-70f9b3fa-0ca7-4ce5-9fde-877c17725bf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '579474c3f59247a0bba7d62ea3d290cc', 'request_id': 'req-70f9b3fa-0ca7-4ce5-9fde-877c17725bf3'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:50.131540 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:50.137090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-70f9b3fa-0ca7-4ce5-9fde-877c17725bf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '579474c3f59247a0bba7d62ea3d290cc', 'request_id': 'req-70f9b3fa-0ca7-4ce5-9fde-877c17725bf3'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:50.198123 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-70f9b3fa-0ca7-4ce5-9fde-877c17725bf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '579474c3f59247a0bba7d62ea3d290cc', 'request_id': 'req-70f9b3fa-0ca7-4ce5-9fde-877c17725bf3'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:50.208838 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-70f9b3fa-0ca7-4ce5-9fde-877c17725bf3 admin admin] The token cache is being invalidate because project 579474c3f59247a0bba7d62ea3d290cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:18:50.210239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-70f9b3fa-0ca7-4ce5-9fde-877c17725bf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:50.210239 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-70f9b3fa-0ca7-4ce5-9fde-877c17725bf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:50.211309 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1444/2859] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:18:50 2022] DELETE /identity/v3/projects/579474c3f59247a0bba7d62ea3d290cc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:18:50.215460 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edb09a-2b2c-45f1-9b31-7b7155731849 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:50.225179 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edb09a-2b2c-45f1-9b31-7b7155731849 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:50.279615 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06c7f8-11a0-4d79-9b84-711dc877b802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:50.285017 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06c7f8-11a0-4d79-9b84-711dc877b802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:50.285017 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06c7f8-11a0-4d79-9b84-711dc877b802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:50.285017 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06c7f8-11a0-4d79-9b84-711dc877b802 admin admin] PATH_INFO: `/v3/users/e74ea85fb8f4412a8c0830110567443e` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:50.285017 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06c7f8-11a0-4d79-9b84-711dc877b802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e74ea85fb8f4412a8c0830110567443e)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:50.285017 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06c7f8-11a0-4d79-9b84-711dc877b802 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:50.422510 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ee06c7f8-11a0-4d79-9b84-711dc877b802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e74ea85fb8f4412a8c0830110567443e'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:50.431390 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ee06c7f8-11a0-4d79-9b84-711dc877b802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e74ea85fb8f4412a8c0830110567443e'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:50.433871 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:50.506323 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ee06c7f8-11a0-4d79-9b84-711dc877b802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e74ea85fb8f4412a8c0830110567443e'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:50.506978 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ee06c7f8-11a0-4d79-9b84-711dc877b802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e74ea85fb8f4412a8c0830110567443e'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:50.519191 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-ee06c7f8-11a0-4d79-9b84-711dc877b802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e74ea85fb8f4412a8c0830110567443e'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:50.525038 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1416/2860] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:18:50 2022] DELETE /identity/v3/users/e74ea85fb8f4412a8c0830110567443e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:50.897236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9b3fa-0ca7-4ce5-9fde-877c17725bf3 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:50.898757 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-70f9b3fa-0ca7-4ce5-9fde-877c17725bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:50.912686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9b3fa-0ca7-4ce5-9fde-877c17725bf3 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:50.979118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d820e11-7486-4a33-9310-a347c296fe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:50.979118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d820e11-7486-4a33-9310-a347c296fe04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:50.979118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d820e11-7486-4a33-9310-a347c296fe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:50.979118 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d820e11-7486-4a33-9310-a347c296fe04 admin admin] PATH_INFO: `/v3/projects/8cdfd459ba3b470d8b55e259d615f6d1` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:50.979685 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d820e11-7486-4a33-9310-a347c296fe04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cdfd459ba3b470d8b55e259d615f6d1)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:50.980543 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d820e11-7486-4a33-9310-a347c296fe04 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:51.102071 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0d820e11-7486-4a33-9310-a347c296fe04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cdfd459ba3b470d8b55e259d615f6d1', 'request_id': 'req-0d820e11-7486-4a33-9310-a347c296fe04'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:51.108403 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0d820e11-7486-4a33-9310-a347c296fe04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cdfd459ba3b470d8b55e259d615f6d1', 'request_id': 'req-0d820e11-7486-4a33-9310-a347c296fe04'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:51.169254 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0d820e11-7486-4a33-9310-a347c296fe04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cdfd459ba3b470d8b55e259d615f6d1', 'request_id': 'req-0d820e11-7486-4a33-9310-a347c296fe04'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:51.180360 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0d820e11-7486-4a33-9310-a347c296fe04 admin admin] The token cache is being invalidate because project 8cdfd459ba3b470d8b55e259d615f6d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:18:51.180654 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0d820e11-7486-4a33-9310-a347c296fe04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:51.182677 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-0d820e11-7486-4a33-9310-a347c296fe04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:51.183063 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1445/2861] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:18:50 2022] DELETE /identity/v3/projects/8cdfd459ba3b470d8b55e259d615f6d1 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:51.189400 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea139de-1855-43a0-b02c-94fc7dfe7053 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:51.189695 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea139de-1855-43a0-b02c-94fc7dfe7053 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:51.189990 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea139de-1855-43a0-b02c-94fc7dfe7053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:51.211526 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-2ea139de-1855-43a0-b02c-94fc7dfe7053 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:51.212751 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-2ea139de-1855-43a0-b02c-94fc7dfe7053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:51.271287 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1417/2862] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:51.278711 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a1970-9519-4b27-8ac0-3d0d9b5a03ca None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:51.279025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a1970-9519-4b27-8ac0-3d0d9b5a03ca None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:51.279307 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a1970-9519-4b27-8ac0-3d0d9b5a03ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:51.299388 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-ee6a1970-9519-4b27-8ac0-3d0d9b5a03ca None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:51.301511 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-ee6a1970-9519-4b27-8ac0-3d0d9b5a03ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:51.308902 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1446/2863] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:51.313274 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea139de-1855-43a0-b02c-94fc7dfe7053 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:51.323509 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea139de-1855-43a0-b02c-94fc7dfe7053 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:51.328234 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa5805-e58e-4c3f-b66c-e9a5e268d743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:51.328839 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa5805-e58e-4c3f-b66c-e9a5e268d743 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:51.329123 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa5805-e58e-4c3f-b66c-e9a5e268d743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:51.329404 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa5805-e58e-4c3f-b66c-e9a5e268d743 admin admin] PATH_INFO: `/v3/domains` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:51.330100 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa5805-e58e-4c3f-b66c-e9a5e268d743 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:18:51.330407 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa5805-e58e-4c3f-b66c-e9a5e268d743 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:51.332656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa5805-e58e-4c3f-b66c-e9a5e268d743 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:51.343954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1418/2864] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:18:51.348148 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a1970-9519-4b27-8ac0-3d0d9b5a03ca None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:51.357419 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a1970-9519-4b27-8ac0-3d0d9b5a03ca None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:51.362147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd3ae2-07d7-496c-812f-01504e287fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:51.362756 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd3ae2-07d7-496c-812f-01504e287fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:51.363061 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd3ae2-07d7-496c-812f-01504e287fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:51.363342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd3ae2-07d7-496c-812f-01504e287fd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:51.364021 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd3ae2-07d7-496c-812f-01504e287fd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:51.365910 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd3ae2-07d7-496c-812f-01504e287fd9 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:51.455876 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1447/2865] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:18:51 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:51.460585 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa5805-e58e-4c3f-b66c-e9a5e268d743 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:51.470957 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa5805-e58e-4c3f-b66c-e9a5e268d743 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:51.526507 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5eb80-1220-4d51-a6de-00fc83da53b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:51.527073 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5eb80-1220-4d51-a6de-00fc83da53b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:51.527362 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5eb80-1220-4d51-a6de-00fc83da53b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:51.527645 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5eb80-1220-4d51-a6de-00fc83da53b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:51.528303 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5eb80-1220-4d51-a6de-00fc83da53b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:51.530211 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5eb80-1220-4d51-a6de-00fc83da53b7 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:51.602918 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1419/2866] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:18:51 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:51.606962 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd3ae2-07d7-496c-812f-01504e287fd9 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:51.617771 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd3ae2-07d7-496c-812f-01504e287fd9 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:51.622631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b701e8f-9994-47ba-8519-6a158ffeb19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:51.623280 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b701e8f-9994-47ba-8519-6a158ffeb19c admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:51.623567 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b701e8f-9994-47ba-8519-6a158ffeb19c admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:51.623873 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b701e8f-9994-47ba-8519-6a158ffeb19c admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:51.624578 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b701e8f-9994-47ba-8519-6a158ffeb19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:51.626167 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b701e8f-9994-47ba-8519-6a158ffeb19c admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:51.636910 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1448/2867] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:51.640685 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5eb80-1220-4d51-a6de-00fc83da53b7 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:51.650588 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5eb80-1220-4d51-a6de-00fc83da53b7 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:51.655255 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351d4a8-ce6f-4b37-b132-a0577ae0cc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:51.655850 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351d4a8-ce6f-4b37-b132-a0577ae0cc22 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:51.656134 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351d4a8-ce6f-4b37-b132-a0577ae0cc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:51.656410 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351d4a8-ce6f-4b37-b132-a0577ae0cc22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:51.657096 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351d4a8-ce6f-4b37-b132-a0577ae0cc22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:51.658675 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351d4a8-ce6f-4b37-b132-a0577ae0cc22 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:51.669590 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1420/2868] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:51.673518 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b701e8f-9994-47ba-8519-6a158ffeb19c admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:51.684116 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b701e8f-9994-47ba-8519-6a158ffeb19c admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:51.688789 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1a36d-4ab6-47ad-9a2b-71932394de11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:51.689447 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1a36d-4ab6-47ad-9a2b-71932394de11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:51.689733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1a36d-4ab6-47ad-9a2b-71932394de11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:51.690020 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1a36d-4ab6-47ad-9a2b-71932394de11 admin admin] PATH_INFO: `/v3/projects/fe754868a5554bd1b0b95774f1b110bc/users/3206e516fc5444b0bc73801d6a3f8d7b/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:51.706324 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1a36d-4ab6-47ad-9a2b-71932394de11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe754868a5554bd1b0b95774f1b110bc, user_id=3206e516fc5444b0bc73801d6a3f8d7b, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:51.709223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1a36d-4ab6-47ad-9a2b-71932394de11 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:51.758258 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1449/2869] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:18:51 2022] PUT /identity/v3/projects/fe754868a5554bd1b0b95774f1b110bc/users/3206e516fc5444b0bc73801d6a3f8d7b/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:18:51.768695 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe75c3-874e-43b5-8df6-f38425ac6376 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:51.768988 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe75c3-874e-43b5-8df6-f38425ac6376 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:51.769268 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe75c3-874e-43b5-8df6-f38425ac6376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:51.796684 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-a5fe75c3-874e-43b5-8df6-f38425ac6376 None None] MFA Rules not processed for user `3206e516fc5444b0bc73801d6a3f8d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:51.797842 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-a5fe75c3-874e-43b5-8df6-f38425ac6376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:51.828022 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:51.863022 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1421/2870] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:51.867932 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1a36d-4ab6-47ad-9a2b-71932394de11 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:51.873818 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:51.930940 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1a36d-4ab6-47ad-9a2b-71932394de11 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:51.936043 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a401b7-d36b-476a-84af-922817e48b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:51.936685 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a401b7-d36b-476a-84af-922817e48b1f admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:51.937335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a401b7-d36b-476a-84af-922817e48b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:51.937335 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a401b7-d36b-476a-84af-922817e48b1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:51.937896 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a401b7-d36b-476a-84af-922817e48b1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:51.939835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a401b7-d36b-476a-84af-922817e48b1f admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:52.049431 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1450/2871] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:18:51 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:18:52.053873 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe75c3-874e-43b5-8df6-f38425ac6376 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:52.064545 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe75c3-874e-43b5-8df6-f38425ac6376 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:52.120266 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdf7bc-0be8-48de-8627-d0f88682158e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:52.120883 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdf7bc-0be8-48de-8627-d0f88682158e admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:52.121169 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdf7bc-0be8-48de-8627-d0f88682158e admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:52.121448 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdf7bc-0be8-48de-8627-d0f88682158e admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:52.122108 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdf7bc-0be8-48de-8627-d0f88682158e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:52.124070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdf7bc-0be8-48de-8627-d0f88682158e admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:52.208797 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1422/2872] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:18:52 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:18:52.212887 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a401b7-d36b-476a-84af-922817e48b1f admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:52.223739 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a401b7-d36b-476a-84af-922817e48b1f admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:52.228592 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7aba00-7089-4292-baa9-811a4299b6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:52.229203 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7aba00-7089-4292-baa9-811a4299b6ff admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:52.229487 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7aba00-7089-4292-baa9-811a4299b6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:52.229763 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7aba00-7089-4292-baa9-811a4299b6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:52.230484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7aba00-7089-4292-baa9-811a4299b6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:52.232184 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7aba00-7089-4292-baa9-811a4299b6ff admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:52.243666 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1451/2873] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:52.247485 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdf7bc-0be8-48de-8627-d0f88682158e admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:52.257565 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdf7bc-0be8-48de-8627-d0f88682158e admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:52.262230 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311fb3f-e182-42dd-8f95-8aa03502c6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:52.262889 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311fb3f-e182-42dd-8f95-8aa03502c6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:52.263174 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311fb3f-e182-42dd-8f95-8aa03502c6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:52.263454 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311fb3f-e182-42dd-8f95-8aa03502c6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:52.264150 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311fb3f-e182-42dd-8f95-8aa03502c6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:52.265742 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311fb3f-e182-42dd-8f95-8aa03502c6d3 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:52.275614 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1423/2874] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:52.279536 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7aba00-7089-4292-baa9-811a4299b6ff admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:52.290062 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7aba00-7089-4292-baa9-811a4299b6ff admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:52.294658 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970f0a1-82b2-4f67-bc3c-80ee2049eedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:52.295347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970f0a1-82b2-4f67-bc3c-80ee2049eedb admin admin] REQUEST_METHOD: `PUT` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:52.295630 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970f0a1-82b2-4f67-bc3c-80ee2049eedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:52.295910 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970f0a1-82b2-4f67-bc3c-80ee2049eedb admin admin] PATH_INFO: `/v3/projects/e1c790cdee8c457d8fffaa9f095ccc2d/users/2d35bf66ebc140c5ad1c017081b4be2a/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:52.310835 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970f0a1-82b2-4f67-bc3c-80ee2049eedb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c790cdee8c457d8fffaa9f095ccc2d, user_id=2d35bf66ebc140c5ad1c017081b4be2a, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:52.313410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970f0a1-82b2-4f67-bc3c-80ee2049eedb admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:52.374877 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1452/2875] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:18:52 2022] PUT /identity/v3/projects/e1c790cdee8c457d8fffaa9f095ccc2d/users/2d35bf66ebc140c5ad1c017081b4be2a/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:52.385874 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966ea89-4ea3-4199-a1b8-f593a18e8ce0 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:52.386168 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966ea89-4ea3-4199-a1b8-f593a18e8ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:52.386448 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966ea89-4ea3-4199-a1b8-f593a18e8ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:52.415130 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-1966ea89-4ea3-4199-a1b8-f593a18e8ce0 None None] MFA Rules not processed for user `2d35bf66ebc140c5ad1c017081b4be2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:52.416406 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-1966ea89-4ea3-4199-a1b8-f593a18e8ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:52.481872 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1424/2876] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:52.486443 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970f0a1-82b2-4f67-bc3c-80ee2049eedb admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:52.548521 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970f0a1-82b2-4f67-bc3c-80ee2049eedb admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:52.553680 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed457116-ae19-4771-98a0-1e55eaca94ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:52.554291 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed457116-ae19-4771-98a0-1e55eaca94ca admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:52.554580 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed457116-ae19-4771-98a0-1e55eaca94ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:52.554892 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed457116-ae19-4771-98a0-1e55eaca94ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:52.555572 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed457116-ae19-4771-98a0-1e55eaca94ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:52.557488 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed457116-ae19-4771-98a0-1e55eaca94ca admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:52.644707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1453/2877] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:18:52 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:52.648972 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966ea89-4ea3-4199-a1b8-f593a18e8ce0 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:52.659731 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966ea89-4ea3-4199-a1b8-f593a18e8ce0 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:52.699189 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:52.717903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064420f-8941-448f-9bd1-f023788a4b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:52.718554 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064420f-8941-448f-9bd1-f023788a4b52 admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:52.718870 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064420f-8941-448f-9bd1-f023788a4b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:52.719151 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064420f-8941-448f-9bd1-f023788a4b52 admin admin] PATH_INFO: `/v3/users` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:52.719820 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064420f-8941-448f-9bd1-f023788a4b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:52.722299 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064420f-8941-448f-9bd1-f023788a4b52 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:52.820804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1425/2878] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:18:52 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:52.824787 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed457116-ae19-4771-98a0-1e55eaca94ca admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:52.835161 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed457116-ae19-4771-98a0-1e55eaca94ca admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:52.839767 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17223a5e-9d5e-467b-a034-31e9fd629e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:52.840419 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17223a5e-9d5e-467b-a034-31e9fd629e7b admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:52.840706 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17223a5e-9d5e-467b-a034-31e9fd629e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:52.840980 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17223a5e-9d5e-467b-a034-31e9fd629e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:52.841747 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17223a5e-9d5e-467b-a034-31e9fd629e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:52.843410 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17223a5e-9d5e-467b-a034-31e9fd629e7b admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:52.855193 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1454/2879] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:52.859200 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064420f-8941-448f-9bd1-f023788a4b52 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:52.869989 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064420f-8941-448f-9bd1-f023788a4b52 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:52.874700 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7343e-43de-4e1f-b91e-eee292794f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:52.875386 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7343e-43de-4e1f-b91e-eee292794f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:52.875674 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7343e-43de-4e1f-b91e-eee292794f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:52.875955 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7343e-43de-4e1f-b91e-eee292794f6f admin admin] PATH_INFO: `/v3/projects/3d4243bb47c7475ea99264281ee348d0/users/d2671661b6074dae8df089ee93f63dd5/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:52.891164 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7343e-43de-4e1f-b91e-eee292794f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4243bb47c7475ea99264281ee348d0, user_id=d2671661b6074dae8df089ee93f63dd5, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:52.894434 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7343e-43de-4e1f-b91e-eee292794f6f admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:52.968591 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1426/2880] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:18:52 2022] PUT /identity/v3/projects/3d4243bb47c7475ea99264281ee348d0/users/d2671661b6074dae8df089ee93f63dd5/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:18:52.972643 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17223a5e-9d5e-467b-a034-31e9fd629e7b admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:52.983025 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17223a5e-9d5e-467b-a034-31e9fd629e7b admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:53.010139 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:53.040857 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486659b-75ef-4457-b674-582fdae78d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:53.041481 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486659b-75ef-4457-b674-582fdae78d3c admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:53.041765 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486659b-75ef-4457-b674-582fdae78d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:53.042044 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486659b-75ef-4457-b674-582fdae78d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:53.042781 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486659b-75ef-4457-b674-582fdae78d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:53.044733 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486659b-75ef-4457-b674-582fdae78d3c admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:53.054693 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1455/2881] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:18:53.058897 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7343e-43de-4e1f-b91e-eee292794f6f admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:53.069730 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7343e-43de-4e1f-b91e-eee292794f6f admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:53.074298 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7f23b-a8ac-46b4-8045-cb2ca0e1120a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:53.074984 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7f23b-a8ac-46b4-8045-cb2ca0e1120a admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:53.075268 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7f23b-a8ac-46b4-8045-cb2ca0e1120a admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:53.075573 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7f23b-a8ac-46b4-8045-cb2ca0e1120a admin admin] PATH_INFO: `/v3/projects/3d4243bb47c7475ea99264281ee348d0/users/d2671661b6074dae8df089ee93f63dd5/roles/a6d209169b77456f9f1cc3ff53646cfc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:53.077571 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7f23b-a8ac-46b4-8045-cb2ca0e1120a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4243bb47c7475ea99264281ee348d0, user_id=d2671661b6074dae8df089ee93f63dd5, role_id=a6d209169b77456f9f1cc3ff53646cfc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:53.080236 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7f23b-a8ac-46b4-8045-cb2ca0e1120a admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:53.090814 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1427/2882] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:18:53 2022] PUT /identity/v3/projects/3d4243bb47c7475ea99264281ee348d0/users/d2671661b6074dae8df089ee93f63dd5/roles/a6d209169b77456f9f1cc3ff53646cfc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:53.100737 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ae859-9db1-4f7b-aac7-afb00125ef95 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:53.101031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ae859-9db1-4f7b-aac7-afb00125ef95 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:53.101313 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ae859-9db1-4f7b-aac7-afb00125ef95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:53.129659 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-110ae859-9db1-4f7b-aac7-afb00125ef95 None None] MFA Rules not processed for user `d2671661b6074dae8df089ee93f63dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:53.130991 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-110ae859-9db1-4f7b-aac7-afb00125ef95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:53.198031 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1456/2883] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:18:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:53.209004 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7f23b-a8ac-46b4-8045-cb2ca0e1120a admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:53.210687 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-d9a7f23b-a8ac-46b4-8045-cb2ca0e1120a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:53.267344 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7f23b-a8ac-46b4-8045-cb2ca0e1120a admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:53.270921 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19dee0-dfb3-42b2-97b4-a6dc69d12231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:53.271521 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19dee0-dfb3-42b2-97b4-a6dc69d12231 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:53.271804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19dee0-dfb3-42b2-97b4-a6dc69d12231 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:53.272075 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19dee0-dfb3-42b2-97b4-a6dc69d12231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:53.326294 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19dee0-dfb3-42b2-97b4-a6dc69d12231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:53.327753 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19dee0-dfb3-42b2-97b4-a6dc69d12231 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:53.337805 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1428/2884] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:55.238420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ae859-9db1-4f7b-aac7-afb00125ef95 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:55.239987 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-110ae859-9db1-4f7b-aac7-afb00125ef95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:55.252339 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ae859-9db1-4f7b-aac7-afb00125ef95 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:55.256348 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c44fd-a6f2-4512-8707-bb589f4f8907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:55.256948 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c44fd-a6f2-4512-8707-bb589f4f8907 service cinder] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:55.257228 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c44fd-a6f2-4512-8707-bb589f4f8907 service cinder] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:55.257501 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c44fd-a6f2-4512-8707-bb589f4f8907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:55.313662 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c44fd-a6f2-4512-8707-bb589f4f8907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:55.315989 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c44fd-a6f2-4512-8707-bb589f4f8907 service cinder] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:55.325251 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1457/2885] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:56.560502 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19dee0-dfb3-42b2-97b4-a6dc69d12231 service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:56.569234 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19dee0-dfb3-42b2-97b4-a6dc69d12231 service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:56.572880 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba974ff-0568-4ea5-9c76-07704dcb112b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:56.573488 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba974ff-0568-4ea5-9c76-07704dcb112b service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:56.573773 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba974ff-0568-4ea5-9c76-07704dcb112b service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:56.574054 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba974ff-0568-4ea5-9c76-07704dcb112b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:56.583419 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba974ff-0568-4ea5-9c76-07704dcb112b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:56.584848 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba974ff-0568-4ea5-9c76-07704dcb112b service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:56.594347 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1429/2886] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:19:01.072593 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c44fd-a6f2-4512-8707-bb589f4f8907 service cinder] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:01.121779 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=100 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:01.136429 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c44fd-a6f2-4512-8707-bb589f4f8907 service cinder] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:01.143374 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080566f-bbda-493b-9b2f-030318c0e245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:01.144040 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080566f-bbda-493b-9b2f-030318c0e245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:01.144333 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080566f-bbda-493b-9b2f-030318c0e245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:01.144620 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080566f-bbda-493b-9b2f-030318c0e245 admin admin] PATH_INFO: `/v3/users/3206e516fc5444b0bc73801d6a3f8d7b` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:01.145888 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080566f-bbda-493b-9b2f-030318c0e245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3206e516fc5444b0bc73801d6a3f8d7b)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:01.147919 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080566f-bbda-493b-9b2f-030318c0e245 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:01.309314 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8080566f-bbda-493b-9b2f-030318c0e245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3206e516fc5444b0bc73801d6a3f8d7b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:01.316281 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8080566f-bbda-493b-9b2f-030318c0e245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3206e516fc5444b0bc73801d6a3f8d7b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:01.316935 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8080566f-bbda-493b-9b2f-030318c0e245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3206e516fc5444b0bc73801d6a3f8d7b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:01.328572 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8080566f-bbda-493b-9b2f-030318c0e245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3206e516fc5444b0bc73801d6a3f8d7b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:01.329203 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-8080566f-bbda-493b-9b2f-030318c0e245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3206e516fc5444b0bc73801d6a3f8d7b'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:01.401608 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1458/2887] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:19:01 2022] DELETE /identity/v3/users/3206e516fc5444b0bc73801d6a3f8d7b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:19:01.406070 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f2a12-cecc-40f7-9f5b-07f3d1e13c6b None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:01.406559 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f2a12-cecc-40f7-9f5b-07f3d1e13c6b None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:01.406667 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f2a12-cecc-40f7-9f5b-07f3d1e13c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:01.426186 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-b20f2a12-cecc-40f7-9f5b-07f3d1e13c6b None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:19:01.427423 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b20f2a12-cecc-40f7-9f5b-07f3d1e13c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:01.456392 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:01.485802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1430/2888] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:19:01.495990 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080566f-bbda-493b-9b2f-030318c0e245 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:01.497475 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-8080566f-bbda-493b-9b2f-030318c0e245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:01.554432 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080566f-bbda-493b-9b2f-030318c0e245 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:01.558071 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c616c12-9c35-4e69-bb56-9dda07be74cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:01.558682 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c616c12-9c35-4e69-bb56-9dda07be74cd service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:01.558993 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c616c12-9c35-4e69-bb56-9dda07be74cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:01.559270 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c616c12-9c35-4e69-bb56-9dda07be74cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:01.568694 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c616c12-9c35-4e69-bb56-9dda07be74cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:01.570051 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c616c12-9c35-4e69-bb56-9dda07be74cd service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:01.579478 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1459/2889] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:19:01.999261 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f2a12-cecc-40f7-9f5b-07f3d1e13c6b None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:02.000707 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-b20f2a12-cecc-40f7-9f5b-07f3d1e13c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:02.012802 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f2a12-cecc-40f7-9f5b-07f3d1e13c6b None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:02.017563 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdffdf-af00-4fed-8dd4-4415e037ba63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:02.018210 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdffdf-af00-4fed-8dd4-4415e037ba63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:02.018497 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdffdf-af00-4fed-8dd4-4415e037ba63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:02.018806 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdffdf-af00-4fed-8dd4-4415e037ba63 admin admin] PATH_INFO: `/v3/projects/fe754868a5554bd1b0b95774f1b110bc` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:02.020000 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdffdf-af00-4fed-8dd4-4415e037ba63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe754868a5554bd1b0b95774f1b110bc)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:02.021935 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdffdf-af00-4fed-8dd4-4415e037ba63 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:02.141165 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-eccdffdf-af00-4fed-8dd4-4415e037ba63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe754868a5554bd1b0b95774f1b110bc', 'request_id': 'req-eccdffdf-af00-4fed-8dd4-4415e037ba63'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:02.148081 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-eccdffdf-af00-4fed-8dd4-4415e037ba63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe754868a5554bd1b0b95774f1b110bc', 'request_id': 'req-eccdffdf-af00-4fed-8dd4-4415e037ba63'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:02.219823 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-eccdffdf-af00-4fed-8dd4-4415e037ba63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe754868a5554bd1b0b95774f1b110bc', 'request_id': 'req-eccdffdf-af00-4fed-8dd4-4415e037ba63'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:02.231197 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-eccdffdf-af00-4fed-8dd4-4415e037ba63 admin admin] The token cache is being invalidate because project fe754868a5554bd1b0b95774f1b110bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:19:02.231487 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-eccdffdf-af00-4fed-8dd4-4415e037ba63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:02.232119 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-eccdffdf-af00-4fed-8dd4-4415e037ba63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:02.233651 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1431/2890] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:19:01 2022] DELETE /identity/v3/projects/fe754868a5554bd1b0b95774f1b110bc => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:19:02.237631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c616c12-9c35-4e69-bb56-9dda07be74cd service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:02.247512 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c616c12-9c35-4e69-bb56-9dda07be74cd service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:02.304277 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debcbeb0-60a9-4c45-86d6-6346db9b491d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:02.304943 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcbeb0-60a9-4c45-86d6-6346db9b491d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:02.305223 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcbeb0-60a9-4c45-86d6-6346db9b491d admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:02.305499 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcbeb0-60a9-4c45-86d6-6346db9b491d admin admin] PATH_INFO: `/v3/users/2d35bf66ebc140c5ad1c017081b4be2a` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:02.306652 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debcbeb0-60a9-4c45-86d6-6346db9b491d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d35bf66ebc140c5ad1c017081b4be2a)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:02.308633 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debcbeb0-60a9-4c45-86d6-6346db9b491d admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:02.320827 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:02.451176 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-debcbeb0-60a9-4c45-86d6-6346db9b491d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d35bf66ebc140c5ad1c017081b4be2a'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:02.459767 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-debcbeb0-60a9-4c45-86d6-6346db9b491d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d35bf66ebc140c5ad1c017081b4be2a'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:02.460484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-debcbeb0-60a9-4c45-86d6-6346db9b491d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d35bf66ebc140c5ad1c017081b4be2a'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:02.473138 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-debcbeb0-60a9-4c45-86d6-6346db9b491d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d35bf66ebc140c5ad1c017081b4be2a'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:02.473790 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-debcbeb0-60a9-4c45-86d6-6346db9b491d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d35bf66ebc140c5ad1c017081b4be2a'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:02.540745 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1460/2891] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:19:02 2022] DELETE /identity/v3/users/2d35bf66ebc140c5ad1c017081b4be2a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:19:02.942093 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdffdf-af00-4fed-8dd4-4415e037ba63 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:02.943594 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-eccdffdf-af00-4fed-8dd4-4415e037ba63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:02.957150 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdffdf-af00-4fed-8dd4-4415e037ba63 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:03.014283 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27651c-4c1d-420a-af27-a48a7c09ee06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:03.014936 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27651c-4c1d-420a-af27-a48a7c09ee06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:03.015418 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27651c-4c1d-420a-af27-a48a7c09ee06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:03.015702 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27651c-4c1d-420a-af27-a48a7c09ee06 admin admin] PATH_INFO: `/v3/projects/e1c790cdee8c457d8fffaa9f095ccc2d` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:03.016869 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27651c-4c1d-420a-af27-a48a7c09ee06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1c790cdee8c457d8fffaa9f095ccc2d)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:03.018838 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27651c-4c1d-420a-af27-a48a7c09ee06 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:03.117451 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-7b27651c-4c1d-420a-af27-a48a7c09ee06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1c790cdee8c457d8fffaa9f095ccc2d', 'request_id': 'req-7b27651c-4c1d-420a-af27-a48a7c09ee06'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:03.123687 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-7b27651c-4c1d-420a-af27-a48a7c09ee06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1c790cdee8c457d8fffaa9f095ccc2d', 'request_id': 'req-7b27651c-4c1d-420a-af27-a48a7c09ee06'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:03.127340 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:03.197448 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-7b27651c-4c1d-420a-af27-a48a7c09ee06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1c790cdee8c457d8fffaa9f095ccc2d', 'request_id': 'req-7b27651c-4c1d-420a-af27-a48a7c09ee06'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:03.208408 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-7b27651c-4c1d-420a-af27-a48a7c09ee06 admin admin] The token cache is being invalidate because project e1c790cdee8c457d8fffaa9f095ccc2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:19:03.208625 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-7b27651c-4c1d-420a-af27-a48a7c09ee06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:03.209258 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-7b27651c-4c1d-420a-af27-a48a7c09ee06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:03.210804 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1432/2892] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:19:02 2022] DELETE /identity/v3/projects/e1c790cdee8c457d8fffaa9f095ccc2d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:19:03.214752 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debcbeb0-60a9-4c45-86d6-6346db9b491d admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:03.216270 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-debcbeb0-60a9-4c45-86d6-6346db9b491d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:03.230074 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debcbeb0-60a9-4c45-86d6-6346db9b491d admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:03.286707 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb0a60-2f0a-42c8-a4ff-83356ab9084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:03.287408 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0a60-2f0a-42c8-a4ff-83356ab9084c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:03.287813 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0a60-2f0a-42c8-a4ff-83356ab9084c admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:03.288100 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0a60-2f0a-42c8-a4ff-83356ab9084c admin admin] PATH_INFO: `/v3/users/d2671661b6074dae8df089ee93f63dd5` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:03.289297 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb0a60-2f0a-42c8-a4ff-83356ab9084c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2671661b6074dae8df089ee93f63dd5)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:03.291420 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb0a60-2f0a-42c8-a4ff-83356ab9084c admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:03.480347 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9dfb0a60-2f0a-42c8-a4ff-83356ab9084c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2671661b6074dae8df089ee93f63dd5'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:03.487132 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9dfb0a60-2f0a-42c8-a4ff-83356ab9084c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2671661b6074dae8df089ee93f63dd5'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:03.488526 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9dfb0a60-2f0a-42c8-a4ff-83356ab9084c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2671661b6074dae8df089ee93f63dd5'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:03.500236 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9dfb0a60-2f0a-42c8-a4ff-83356ab9084c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2671661b6074dae8df089ee93f63dd5'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:03.500859 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-9dfb0a60-2f0a-42c8-a4ff-83356ab9084c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2671661b6074dae8df089ee93f63dd5'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:03.579513 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1461/2893] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:19:03 2022] DELETE /identity/v3/users/d2671661b6074dae8df089ee93f63dd5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:19:04.022287 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27651c-4c1d-420a-af27-a48a7c09ee06 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:04.023816 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-7b27651c-4c1d-420a-af27-a48a7c09ee06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:04.037925 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27651c-4c1d-420a-af27-a48a7c09ee06 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:04.093418 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9bd3f-b1d6-45f1-98f8-2b3b2d64c01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:04.094063 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9bd3f-b1d6-45f1-98f8-2b3b2d64c01a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:04.094350 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9bd3f-b1d6-45f1-98f8-2b3b2d64c01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:04.094632 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9bd3f-b1d6-45f1-98f8-2b3b2d64c01a admin admin] PATH_INFO: `/v3/projects/3d4243bb47c7475ea99264281ee348d0` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:04.095835 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9bd3f-b1d6-45f1-98f8-2b3b2d64c01a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d4243bb47c7475ea99264281ee348d0)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:04.098332 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9bd3f-b1d6-45f1-98f8-2b3b2d64c01a admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:04.232289 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-83b9bd3f-b1d6-45f1-98f8-2b3b2d64c01a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d4243bb47c7475ea99264281ee348d0', 'request_id': 'req-83b9bd3f-b1d6-45f1-98f8-2b3b2d64c01a'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:04.239072 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-83b9bd3f-b1d6-45f1-98f8-2b3b2d64c01a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d4243bb47c7475ea99264281ee348d0', 'request_id': 'req-83b9bd3f-b1d6-45f1-98f8-2b3b2d64c01a'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:04.300899 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-83b9bd3f-b1d6-45f1-98f8-2b3b2d64c01a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d4243bb47c7475ea99264281ee348d0', 'request_id': 'req-83b9bd3f-b1d6-45f1-98f8-2b3b2d64c01a'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:04.312290 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-83b9bd3f-b1d6-45f1-98f8-2b3b2d64c01a admin admin] The token cache is being invalidate because project 3d4243bb47c7475ea99264281ee348d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:19:04.312585 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-83b9bd3f-b1d6-45f1-98f8-2b3b2d64c01a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:04.313228 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-83b9bd3f-b1d6-45f1-98f8-2b3b2d64c01a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:04.314786 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1433/2894] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:19:04 2022] DELETE /identity/v3/projects/3d4243bb47c7475ea99264281ee348d0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:19:04.319694 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ded4d8-1d41-4974-aac0-1e7c8be9239a None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:04.320180 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ded4d8-1d41-4974-aac0-1e7c8be9239a None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:04.320342 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ded4d8-1d41-4974-aac0-1e7c8be9239a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:04.341352 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-60ded4d8-1d41-4974-aac0-1e7c8be9239a None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:19:04.342574 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-60ded4d8-1d41-4974-aac0-1e7c8be9239a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:04.346806 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:04.402136 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1462/2895] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:19:04.410188 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879009f4-eb4d-46a0-a76f-4577d0adc2d1 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:04.410485 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879009f4-eb4d-46a0-a76f-4577d0adc2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:04.410824 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879009f4-eb4d-46a0-a76f-4577d0adc2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:04.431569 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-879009f4-eb4d-46a0-a76f-4577d0adc2d1 None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:19:04.432799 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-879009f4-eb4d-46a0-a76f-4577d0adc2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:04.441656 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1434/2896] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:19:04.445854 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ded4d8-1d41-4974-aac0-1e7c8be9239a None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:04.455841 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ded4d8-1d41-4974-aac0-1e7c8be9239a None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:04.461047 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dbdd4-1dff-4b6a-9dc0-6f88d8090442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:04.461686 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dbdd4-1dff-4b6a-9dc0-6f88d8090442 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:04.461974 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dbdd4-1dff-4b6a-9dc0-6f88d8090442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:04.462260 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dbdd4-1dff-4b6a-9dc0-6f88d8090442 admin admin] PATH_INFO: `/v3/domains` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:04.463002 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dbdd4-1dff-4b6a-9dc0-6f88d8090442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:19:04.463319 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dbdd4-1dff-4b6a-9dc0-6f88d8090442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:04.464994 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dbdd4-1dff-4b6a-9dc0-6f88d8090442 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:04.476941 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1463/2897] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Aug 3 13:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:19:04.481141 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879009f4-eb4d-46a0-a76f-4577d0adc2d1 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:04.490996 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879009f4-eb4d-46a0-a76f-4577d0adc2d1 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:04.495673 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824237b-6592-437e-a9ff-898cbe33058e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:04.499064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824237b-6592-437e-a9ff-898cbe33058e admin admin] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:04.499064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824237b-6592-437e-a9ff-898cbe33058e admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:04.499064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824237b-6592-437e-a9ff-898cbe33058e admin admin] PATH_INFO: `/v3/projects` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:04.499064 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824237b-6592-437e-a9ff-898cbe33058e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:04.499438 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824237b-6592-437e-a9ff-898cbe33058e admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:04.599659 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1435/2898] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Aug 3 13:19:04 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:19:04.603987 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dbdd4-1dff-4b6a-9dc0-6f88d8090442 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:04.614577 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dbdd4-1dff-4b6a-9dc0-6f88d8090442 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:04.671007 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1585ca-26a5-466a-92f4-57ed991cf934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:04.671631 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1585ca-26a5-466a-92f4-57ed991cf934 admin admin] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:04.671920 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1585ca-26a5-466a-92f4-57ed991cf934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:04.672201 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1585ca-26a5-466a-92f4-57ed991cf934 admin admin] PATH_INFO: `/v3/users` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:04.672866 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1585ca-26a5-466a-92f4-57ed991cf934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:04.674802 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1585ca-26a5-466a-92f4-57ed991cf934 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:04.734675 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1464/2899] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Aug 3 13:19:04 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:19:04.739658 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824237b-6592-437e-a9ff-898cbe33058e admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:04.750193 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824237b-6592-437e-a9ff-898cbe33058e admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:04.755120 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f61a0-d20f-4dca-99cc-66b1ef5af08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:04.755723 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f61a0-d20f-4dca-99cc-66b1ef5af08d admin admin] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:04.756006 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f61a0-d20f-4dca-99cc-66b1ef5af08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:04.756282 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f61a0-d20f-4dca-99cc-66b1ef5af08d admin admin] PATH_INFO: `/v3/roles` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:04.756972 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f61a0-d20f-4dca-99cc-66b1ef5af08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:04.758559 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f61a0-d20f-4dca-99cc-66b1ef5af08d admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:04.768456 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1436/2900] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:19:04.772232 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1585ca-26a5-466a-92f4-57ed991cf934 admin admin] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:04.782090 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1585ca-26a5-466a-92f4-57ed991cf934 admin admin] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:04.787214 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f4cbb-8b25-4288-bfd9-8d80480217a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:04.787811 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f4cbb-8b25-4288-bfd9-8d80480217a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:04.788092 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f4cbb-8b25-4288-bfd9-8d80480217a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:04.788367 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f4cbb-8b25-4288-bfd9-8d80480217a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:04.789086 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f4cbb-8b25-4288-bfd9-8d80480217a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:04.790709 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f4cbb-8b25-4288-bfd9-8d80480217a8 admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:04.802010 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1465/2901] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Aug 3 13:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:19:04.805955 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f61a0-d20f-4dca-99cc-66b1ef5af08d admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:04.816014 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f61a0-d20f-4dca-99cc-66b1ef5af08d admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:04.820650 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3902920-bd21-4d1e-9e35-a5fc82960062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:04.821299 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3902920-bd21-4d1e-9e35-a5fc82960062 admin admin] REQUEST_METHOD: `PUT` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:04.821582 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3902920-bd21-4d1e-9e35-a5fc82960062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:04.821866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3902920-bd21-4d1e-9e35-a5fc82960062 admin admin] PATH_INFO: `/v3/projects/dcdb85a0e97a498ba3c84801d5a87c61/users/66011efd111b4472992ad4c66963def1/roles/26c9fe6916a4412d96492e41ff62cca6` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:04.836030 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3902920-bd21-4d1e-9e35-a5fc82960062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcdb85a0e97a498ba3c84801d5a87c61, user_id=66011efd111b4472992ad4c66963def1, role_id=26c9fe6916a4412d96492e41ff62cca6)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:04.838658 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3902920-bd21-4d1e-9e35-a5fc82960062 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:04.904934 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1437/2902] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Aug 3 13:19:04 2022] PUT /identity/v3/projects/dcdb85a0e97a498ba3c84801d5a87c61/users/66011efd111b4472992ad4c66963def1/roles/26c9fe6916a4412d96492e41ff62cca6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:19:04.910595 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2181f0-6d95-42f3-8c4f-ea21b40de1fe None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:04.910925 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2181f0-6d95-42f3-8c4f-ea21b40de1fe None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:04.911203 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2181f0-6d95-42f3-8c4f-ea21b40de1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:04.934205 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-af2181f0-6d95-42f3-8c4f-ea21b40de1fe None None] MFA Rules not processed for user `9b2212edbdbd4786821e28173abce27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:19:04.935822 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-af2181f0-6d95-42f3-8c4f-ea21b40de1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:05.005484 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1466/2903] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:19:05.016539 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3902920-bd21-4d1e-9e35-a5fc82960062 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:05.018460 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-d3902920-bd21-4d1e-9e35-a5fc82960062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:05.033484 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:05.077649 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3902920-bd21-4d1e-9e35-a5fc82960062 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:05.081872 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d410caf-a600-4c87-84b7-8f674710afe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:05.082543 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d410caf-a600-4c87-84b7-8f674710afe0 service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:05.082870 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d410caf-a600-4c87-84b7-8f674710afe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:05.083166 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d410caf-a600-4c87-84b7-8f674710afe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:05.092066 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d410caf-a600-4c87-84b7-8f674710afe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:05.094671 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d410caf-a600-4c87-84b7-8f674710afe0 service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:05.105157 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1438/2904] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:19:06.177085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170467c5-62b1-4132-9ba3-d3236b104c88 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:06.185755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170467c5-62b1-4132-9ba3-d3236b104c88 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:06.185755 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170467c5-62b1-4132-9ba3-d3236b104c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:06.206842 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-170467c5-62b1-4132-9ba3-d3236b104c88 None None] MFA Rules not processed for user `66011efd111b4472992ad4c66963def1`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:19:06.208084 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-170467c5-62b1-4132-9ba3-d3236b104c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:06.212287 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:06.277480 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1467/2905] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:19:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:19:06.289094 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d410caf-a600-4c87-84b7-8f674710afe0 service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:06.290587 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-4d410caf-a600-4c87-84b7-8f674710afe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:06.347982 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d410caf-a600-4c87-84b7-8f674710afe0 service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:06.351717 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a4766-eae6-416f-866b-ef5743d071c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:06.352336 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a4766-eae6-416f-866b-ef5743d071c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:06.352622 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a4766-eae6-416f-866b-ef5743d071c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:06.352903 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a4766-eae6-416f-866b-ef5743d071c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:06.361112 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a4766-eae6-416f-866b-ef5743d071c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:06.362540 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a4766-eae6-416f-866b-ef5743d071c7 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:06.371954 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1439/2906] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:19:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:19:08.018066 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7f9cb-5f60-4a18-9b1b-389596c54788 None None] REQUEST_METHOD: `POST` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:08.018587 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7f9cb-5f60-4a18-9b1b-389596c54788 None None] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:08.018696 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7f9cb-5f60-4a18-9b1b-389596c54788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:08.038086 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.auth.core [None req-10a7f9cb-5f60-4a18-9b1b-389596c54788 None None] MFA Rules not processed for user `66011efd111b4472992ad4c66963def1`. Rule list: `[]` (Enabled: `True`). {{(pid=81209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:19:08.039329 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-10a7f9cb-5f60-4a18-9b1b-389596c54788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:08.046129 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1468/2907] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:19:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:19:16.367996 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=46 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:18.032091 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=28 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:20:12.607171 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a4766-eae6-416f-866b-ef5743d071c7 service cinder] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:20:12.608602 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-334a4766-eae6-416f-866b-ef5743d071c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:20:12.620547 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a4766-eae6-416f-866b-ef5743d071c7 service cinder] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:20:12.624261 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d2864-25e5-4d29-9566-52e4b1392ed3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19337279eb414e62b529feb6e7c9b1b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:20:12.624866 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d2864-25e5-4d29-9566-52e4b1392ed3 service cinder] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:20:12.625151 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d2864-25e5-4d29-9566-52e4b1392ed3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:20:12.625428 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d2864-25e5-4d29-9566-52e4b1392ed3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:20:12.627196 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-787d2864-25e5-4d29-9566-52e4b1392ed3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:20:12.715342 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d2864-25e5-4d29-9566-52e4b1392ed3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:20:12.716786 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d2864-25e5-4d29-9566-52e4b1392ed3 service cinder] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:20:12.736685 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1440/2908] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:20:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:20:15.873732 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7f9cb-5f60-4a18-9b1b-389596c54788 None None] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:20:15.875180 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-10a7f9cb-5f60-4a18-9b1b-389596c54788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:20:15.887642 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7f9cb-5f60-4a18-9b1b-389596c54788 None None] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:20:15.891276 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a45100-9f89-43f0-be47-cfabcc24df50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:20:15.891885 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a45100-9f89-43f0-be47-cfabcc24df50 service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:20:15.892176 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a45100-9f89-43f0-be47-cfabcc24df50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:20:15.892454 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a45100-9f89-43f0-be47-cfabcc24df50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:20:15.894161 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-41a45100-9f89-43f0-be47-cfabcc24df50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:20:15.907915 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a45100-9f89-43f0-be47-cfabcc24df50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:20:15.909592 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a45100-9f89-43f0-be47-cfabcc24df50 service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:20:15.920632 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1469/2909] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:20:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:20:22.734055 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=46 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:20:25.915715 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=6 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:20:28.468801 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614b189-eb46-4d96-b19e-8fbc519730f3 None None] REQUEST_METHOD: `POST` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:20:28.469322 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614b189-eb46-4d96-b19e-8fbc519730f3 None None] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:20:28.469437 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614b189-eb46-4d96-b19e-8fbc519730f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:20:28.488184 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.auth.core [None req-d614b189-eb46-4d96-b19e-8fbc519730f3 None None] MFA Rules not processed for user `66011efd111b4472992ad4c66963def1`. Rule list: `[]` (Enabled: `True`). {{(pid=81208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:20:28.489395 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-d614b189-eb46-4d96-b19e-8fbc519730f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:20:28.496787 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1441/2910] 10.222.0.64 () {58 vars in 958 bytes} [Wed Aug 3 13:20:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:20:28.725770 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a45100-9f89-43f0-be47-cfabcc24df50 service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:20:28.734840 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a45100-9f89-43f0-be47-cfabcc24df50 service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:20:28.738447 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1501e-18f3-4738-a894-b07e10c2cd8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:20:28.739085 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1501e-18f3-4738-a894-b07e10c2cd8a service neutron] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:20:28.739369 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1501e-18f3-4738-a894-b07e10c2cd8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:20:28.739645 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1501e-18f3-4738-a894-b07e10c2cd8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:20:28.741376 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-56d1501e-18f3-4738-a894-b07e10c2cd8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:20:28.751368 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1501e-18f3-4738-a894-b07e10c2cd8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:20:28.752782 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1501e-18f3-4738-a894-b07e10c2cd8a service neutron] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:20:28.760637 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1470/2911] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:20:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:20:31.915043 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614b189-eb46-4d96-b19e-8fbc519730f3 None None] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:20:31.925011 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614b189-eb46-4d96-b19e-8fbc519730f3 None None] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:20:31.928620 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631d385-b777-4374-800d-1a9a2fbfadca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05c4c07ff52c43ebb5056484eac94afa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:20:31.929236 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631d385-b777-4374-800d-1a9a2fbfadca service neutron] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:20:31.929519 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631d385-b777-4374-800d-1a9a2fbfadca service neutron] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:20:31.929793 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631d385-b777-4374-800d-1a9a2fbfadca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:20:31.931604 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-9631d385-b777-4374-800d-1a9a2fbfadca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:20:31.940941 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631d385-b777-4374-800d-1a9a2fbfadca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:20:31.942391 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631d385-b777-4374-800d-1a9a2fbfadca service neutron] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:20:31.950269 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1442/2912] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:20:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:20:38.757147 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=6 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:20:41.946738 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=9 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:21:36.201723 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1501e-18f3-4738-a894-b07e10c2cd8a service neutron] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:21:36.203399 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-56d1501e-18f3-4738-a894-b07e10c2cd8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:21:36.281282 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1501e-18f3-4738-a894-b07e10c2cd8a service neutron] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:21:36.286966 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c7de7-188f-42a2-a7c5-9baef3e17d58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de27d25fad634658a1abcb776d9a7b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:21:36.295971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c7de7-188f-42a2-a7c5-9baef3e17d58 service placement] REQUEST_METHOD: `GET` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:21:36.295971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c7de7-188f-42a2-a7c5-9baef3e17d58 service placement] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:21:36.295971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c7de7-188f-42a2-a7c5-9baef3e17d58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:21:36.295971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.fernet_utils [None req-1e4c7de7-188f-42a2-a7c5-9baef3e17d58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:21:36.302820 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c7de7-188f-42a2-a7c5-9baef3e17d58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:21:36.304435 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c7de7-188f-42a2-a7c5-9baef3e17d58 service placement] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:21:36.323251 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1471/2913] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:21:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:21:36.337879 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631d385-b777-4374-800d-1a9a2fbfadca service neutron] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:21:36.356549 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631d385-b777-4374-800d-1a9a2fbfadca service neutron] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:21:36.363712 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579db9c-176f-476f-a69b-ebdccf138c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:21:36.364503 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579db9c-176f-476f-a69b-ebdccf138c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:21:36.364976 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579db9c-176f-476f-a69b-ebdccf138c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:21:36.365426 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579db9c-176f-476f-a69b-ebdccf138c67 admin admin] PATH_INFO: `/v3/users/66011efd111b4472992ad4c66963def1` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:21:36.371198 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579db9c-176f-476f-a69b-ebdccf138c67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66011efd111b4472992ad4c66963def1)` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:21:36.373184 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579db9c-176f-476f-a69b-ebdccf138c67 admin admin] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:21:36.531233 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-7579db9c-176f-476f-a69b-ebdccf138c67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66011efd111b4472992ad4c66963def1'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:36.538343 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-7579db9c-176f-476f-a69b-ebdccf138c67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66011efd111b4472992ad4c66963def1'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:36.587823 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-7579db9c-176f-476f-a69b-ebdccf138c67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66011efd111b4472992ad4c66963def1'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:36.588477 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-7579db9c-176f-476f-a69b-ebdccf138c67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66011efd111b4472992ad4c66963def1'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:36.600863 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.notifications [None req-7579db9c-176f-476f-a69b-ebdccf138c67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66011efd111b4472992ad4c66963def1'} {{(pid=81208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:36.607345 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1443/2914] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Aug 3 13:21:36 2022] DELETE /identity/v3/users/66011efd111b4472992ad4c66963def1 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:21:36.869877 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c7de7-188f-42a2-a7c5-9baef3e17d58 service placement] Authenticating user token {{(pid=81209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:21:36.880596 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c7de7-188f-42a2-a7c5-9baef3e17d58 service placement] Validating token access rules against request {{(pid=81209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:21:36.938971 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409779e-b9c1-4d5a-8966-1667c7ed836a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2212edbdbd4786821e28173abce27f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d023a6b024c4cbd9df738e8fd9e9a97', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:21:36.939620 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409779e-b9c1-4d5a-8966-1667c7ed836a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:21:36.939909 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409779e-b9c1-4d5a-8966-1667c7ed836a admin admin] SCRIPT_NAME: `/identity` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:21:36.940191 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409779e-b9c1-4d5a-8966-1667c7ed836a admin admin] PATH_INFO: `/v3/projects/dcdb85a0e97a498ba3c84801d5a87c61` {{(pid=81209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:21:36.941398 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409779e-b9c1-4d5a-8966-1667c7ed836a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcdb85a0e97a498ba3c84801d5a87c61)` {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:21:36.943430 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409779e-b9c1-4d5a-8966-1667c7ed836a admin admin] RBAC: Authorization granted {{(pid=81209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:21:37.052412 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e409779e-b9c1-4d5a-8966-1667c7ed836a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcdb85a0e97a498ba3c84801d5a87c61', 'request_id': 'req-e409779e-b9c1-4d5a-8966-1667c7ed836a'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:37.058682 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e409779e-b9c1-4d5a-8966-1667c7ed836a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcdb85a0e97a498ba3c84801d5a87c61', 'request_id': 'req-e409779e-b9c1-4d5a-8966-1667c7ed836a'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:37.125263 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e409779e-b9c1-4d5a-8966-1667c7ed836a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcdb85a0e97a498ba3c84801d5a87c61', 'request_id': 'req-e409779e-b9c1-4d5a-8966-1667c7ed836a'} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:37.137005 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e409779e-b9c1-4d5a-8966-1667c7ed836a admin admin] The token cache is being invalidate because project dcdb85a0e97a498ba3c84801d5a87c61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:21:37.137515 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e409779e-b9c1-4d5a-8966-1667c7ed836a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:37.138425 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG keystone.notifications [None req-e409779e-b9c1-4d5a-8966-1667c7ed836a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:37.140035 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: [pid: 81209|app: 0|req: 1472/2915] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Aug 3 13:21:36 2022] DELETE /identity/v3/projects/dcdb85a0e97a498ba3c84801d5a87c61 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:21:46.603836 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:21:47.133061 dv-cinder-850836-4-iscsi devstack@keystone.service[81209]: DEBUG dbcounter [-] [81209] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:22:47.386811 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579db9c-176f-476f-a69b-ebdccf138c67 admin admin] Authenticating user token {{(pid=81208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:22:47.389019 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-7579db9c-176f-476f-a69b-ebdccf138c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:22:47.459173 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579db9c-176f-476f-a69b-ebdccf138c67 admin admin] Validating token access rules against request {{(pid=81208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:22:47.519360 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9934a4c-eadc-4144-b501-088ad920fa87 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de27d25fad634658a1abcb776d9a7b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '020d395e82f0448f95789a896703ce98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:22:47.519975 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9934a4c-eadc-4144-b501-088ad920fa87 service placement] REQUEST_METHOD: `GET` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:22:47.520259 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9934a4c-eadc-4144-b501-088ad920fa87 service placement] SCRIPT_NAME: `/identity` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:22:47.520535 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9934a4c-eadc-4144-b501-088ad920fa87 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:22:47.522316 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.fernet_utils [None req-d9934a4c-eadc-4144-b501-088ad920fa87 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:22:47.535688 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9934a4c-eadc-4144-b501-088ad920fa87 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:22:47.537292 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9934a4c-eadc-4144-b501-088ad920fa87 service placement] RBAC: Authorization granted {{(pid=81208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:22:47.547579 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: [pid: 81208|app: 0|req: 1444/2916] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Aug 3 13:22:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:22:57.542780 dv-cinder-850836-4-iscsi devstack@keystone.service[81208]: DEBUG dbcounter [-] [81208] Writing DB stats keystone:SELECT=58 {{(pid=81208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}